-- Logs begin at Mon 2022-09-05 13:39:06 UTC, end at Mon 2022-09-05 14:55:20 UTC. -- Sep 05 14:13:23.162644 dv-cinder-842905-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 05 14:13:23.171808 dv-cinder-842905-3-smb devstack@keystone.service[81609]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 05 14:13:23.173935 dv-cinder-842905-3-smb devstack@keystone.service[81609]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 5 14:13:23 2022] *** Sep 05 14:13:23.173935 dv-cinder-842905-3-smb devstack@keystone.service[81609]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 05 14:13:23.173935 dv-cinder-842905-3-smb devstack@keystone.service[81609]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 05 14:13:23.173935 dv-cinder-842905-3-smb devstack@keystone.service[81609]: nodename: dv-cinder-842905-3-smb Sep 05 14:13:23.173935 dv-cinder-842905-3-smb devstack@keystone.service[81609]: machine: x86_64 Sep 05 14:13:23.173935 dv-cinder-842905-3-smb devstack@keystone.service[81609]: clock source: unix Sep 05 14:13:23.173935 dv-cinder-842905-3-smb devstack@keystone.service[81609]: pcre jit disabled Sep 05 14:13:23.173935 dv-cinder-842905-3-smb devstack@keystone.service[81609]: detected number of CPU cores: 4 Sep 05 14:13:23.173935 dv-cinder-842905-3-smb devstack@keystone.service[81609]: current working directory: / Sep 05 14:13:23.173935 dv-cinder-842905-3-smb devstack@keystone.service[81609]: detected binary path: /usr/bin/uwsgi-core Sep 05 14:13:23.173935 dv-cinder-842905-3-smb devstack@keystone.service[81609]: your processes number limit is 47680 Sep 05 14:13:23.173935 dv-cinder-842905-3-smb devstack@keystone.service[81609]: your memory page size is 4096 bytes Sep 05 14:13:23.173935 dv-cinder-842905-3-smb devstack@keystone.service[81609]: detected max file descriptor number: 2048 Sep 05 14:13:23.173935 dv-cinder-842905-3-smb devstack@keystone.service[81609]: lock engine: pthread robust mutexes Sep 05 14:13:23.174685 dv-cinder-842905-3-smb devstack@keystone.service[81609]: thunder lock: enabled Sep 05 14:13:23.174685 dv-cinder-842905-3-smb devstack@keystone.service[81609]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 05 14:13:23.174685 dv-cinder-842905-3-smb devstack@keystone.service[81609]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 05 14:13:23.214293 dv-cinder-842905-3-smb devstack@keystone.service[81609]: Python main interpreter initialized at 0x55e1a789d9c0 Sep 05 14:13:23.214293 dv-cinder-842905-3-smb devstack@keystone.service[81609]: python threads support enabled Sep 05 14:13:23.214293 dv-cinder-842905-3-smb devstack@keystone.service[81609]: your server socket listen backlog is limited to 100 connections Sep 05 14:13:23.214293 dv-cinder-842905-3-smb devstack@keystone.service[81609]: your mercy for graceful operations on workers is 90 seconds Sep 05 14:13:23.214674 dv-cinder-842905-3-smb devstack@keystone.service[81609]: mapped 403077 bytes (393 KB) for 2 cores Sep 05 14:13:23.214750 dv-cinder-842905-3-smb devstack@keystone.service[81609]: *** Operational MODE: preforking *** Sep 05 14:13:23.215012 dv-cinder-842905-3-smb devstack@keystone.service[81609]: *** uWSGI is running in multiple interpreter mode *** Sep 05 14:13:23.215012 dv-cinder-842905-3-smb devstack@keystone.service[81609]: spawned uWSGI master process (pid: 81609) Sep 05 14:13:23.215214 dv-cinder-842905-3-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 05 14:13:23.216027 dv-cinder-842905-3-smb devstack@keystone.service[81609]: spawned uWSGI worker 1 (pid: 81623, cores: 1) Sep 05 14:13:23.216118 dv-cinder-842905-3-smb devstack@keystone.service[81609]: spawned uWSGI worker 2 (pid: 81624, cores: 1) Sep 05 14:13:23.217299 dv-cinder-842905-3-smb devstack@keystone.service[81609]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 05 14:13:27.556051 dv-cinder-842905-3-smb devstack@keystone.service[81623]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 14:13:27.556051 dv-cinder-842905-3-smb devstack@keystone.service[81623]: from cryptography.utils import int_from_bytes Sep 05 14:13:27.556826 dv-cinder-842905-3-smb devstack@keystone.service[81623]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 14:13:27.556826 dv-cinder-842905-3-smb devstack@keystone.service[81623]: from cryptography.utils import int_from_bytes Sep 05 14:13:27.556938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 14:13:27.556938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: from cryptography.utils import int_from_bytes Sep 05 14:13:27.556938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 14:13:27.556938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: from cryptography.utils import int_from_bytes Sep 05 14:13:27.619025 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 14:13:27.619208 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 14:13:27.619290 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 14:13:27.619383 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] command line args: [] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 14:13:27.619457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 14:13:27.619606 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] command line args: [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 14:13:27.619685 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 14:13:27.619818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ================================================================================ {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 14:13:27.619903 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 14:13:27.620053 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ================================================================================ {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 14:13:27.620141 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] admin_token = **** {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.620311 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] config_dir = [] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.620387 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] admin_token = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.620502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.620584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] config_dir = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.620686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] config_source = [] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.620775 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.620852 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] debug = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.620924 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] config_source = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.621089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.621354 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] debug = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.621432 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.621518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.621660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.621864 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.622060 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.622172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.622527 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.622678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.622850 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] list_limit = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.623087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.623267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] log_config_append = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.623560 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] list_limit = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.623723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.623895 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] log_config_append = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.624064 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] log_dir = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.624230 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.624374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] log_file = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.624555 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] log_dir = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.624731 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.624906 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] log_file = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.629990 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.630084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.630157 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.630235 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.630313 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.630393 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.630463 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.630541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.630625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.630698 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.630768 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.630838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.630914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.630990 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.631071 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.631143 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.631212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.631286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.631357 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.631425 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.631505 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.631582 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.631652 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.631721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.631802 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.631879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.631956 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.632028 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.632028 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.632151 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.632151 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] publish_errors = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.632290 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.632380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.632449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] publish_errors = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.632568 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.632647 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.632716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.632784 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.632858 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.632934 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.633023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.633124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.633198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] standard_threads = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.633272 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.633350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.633427 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] standard_threads = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.633499 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.633499 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.633635 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.633705 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] use_journal = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.633784 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.633860 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] use_json = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.633930 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.633998 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] use_stderr = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.634073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] use_journal = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.634148 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] use_syslog = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.634225 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] use_json = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.634301 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.634370 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] use_stderr = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.634443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.634552 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] use_syslog = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.634632 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.634775 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:13:27.634849 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.634924 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.634994 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.635062 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.635131 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.635207 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.635285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.635350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.635419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.635487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.635561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.635645 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.635722 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.635797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.635867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.635935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.636003 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.636079 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.636155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.636229 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.636305 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.636375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.636443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.636529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.636600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.636673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.637310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.637376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.637444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.637518 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.637582 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.637651 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.637709 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.637777 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.637857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.637928 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.638002 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.638071 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.638138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.638138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.638274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.638274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.638404 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.638404 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.638525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.638599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.638744 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.638823 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.638893 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.638961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.639034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.639109 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.639189 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.639259 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.639336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.639405 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.639405 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.639534 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.639610 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.639684 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.639753 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.639827 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.639900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.639969 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.640044 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.640114 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.640182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.640249 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.640317 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.640384 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.640459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.640528 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.640596 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.640663 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.640736 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.640805 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.640882 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.640952 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.641020 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.641144 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.641260 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.641337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.641479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.641557 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.641617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.641682 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.641746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.641804 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.641871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.641930 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.641991 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.642092 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.642161 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.642326 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.642393 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.642572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.642641 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.642804 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.642907 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.643056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.643172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.643288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.643426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.643539 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.643647 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.643789 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.643892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.644029 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.644141 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.644249 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.644354 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.644490 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.644596 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.644711 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.644855 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.644961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.645129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.645240 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.645391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.645512 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.645658 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.645765 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.645898 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.646007 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.646114 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.646261 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.646371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.646484 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.646627 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.646739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.646873 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.646992 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.647100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.647207 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.647279 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.647430 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.647509 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.647627 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.647700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.647769 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.647844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.647946 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.648074 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.648223 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.648298 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.648368 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.648538 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.648642 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.648783 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.648870 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.649020 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.649120 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.649292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.649369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.649529 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.649619 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.649763 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.649848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.650002 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.650124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.650236 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.650316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.650471 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.650551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.650721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.650804 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.650964 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.651047 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.651204 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.651283 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.651442 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.651526 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.651678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.651760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.651910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.651992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.652153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.652311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.653162 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.653314 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.653456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.653456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.653705 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.653835 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.653964 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.654093 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.654235 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.654365 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.654495 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.654623 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.654753 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.654893 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.655032 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.655162 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.655292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.655421 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.655551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.655680 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.655818 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.655948 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.656085 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.656215 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.656356 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.656486 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.656624 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.656765 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] auth.external = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.656895 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.657025 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.657181 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.657312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.657456 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.657614 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.657760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.657892 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] auth.password = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.658022 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.658152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] auth.token = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.658281 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.658411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.658559 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.658691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.658821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] auth.external = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.658952 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.659082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.659211 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.659211 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.659468 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.659601 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.659732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.659862 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.659992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] auth.password = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.660131 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] credential.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.660279 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] auth.token = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.660491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.660601 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.660698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.660795 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.660899 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.661009 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.661142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.661241 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.661336 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.661431 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.666413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.666502 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.666575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.666646 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.666715 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.666785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] credential.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.666870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.666945 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.667015 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.667084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.667154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.667223 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.667301 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.667373 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.667442 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.667511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.667580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.667649 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.667796 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.667871 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.667941 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] federation.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.668058 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.668131 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.668211 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.668284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.668354 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.668424 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.668493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.668562 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.668894 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.668978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.669077 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.669154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.669224 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.669294 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.669377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.669451 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.669521 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.669590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.669660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.669735 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.669851 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.669934 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.670011 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.670082 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.670151 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.670220 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.670297 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.670369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.670438 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.670506 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.670506 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.670631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.670708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.670779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.670854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.670930 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.671001 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.671070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.671146 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.671217 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.671285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.671355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.671424 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.671424 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.671562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.671635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.671704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.671773 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.671842 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.671911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.672004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.672078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.672148 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.672217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.672287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.672355 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.672433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.672506 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.672576 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.672644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.672713 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.672783 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.672866 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.672938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.673006 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.673089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.673151 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.673220 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.673220 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.673366 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.673444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.673514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.673582 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.673657 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.673833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.673931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.674003 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.674072 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.674142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.674221 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.674293 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.674369 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.674441 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.674510 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.674580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.674657 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.674728 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.674797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.674867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.674936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.675253 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.675338 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.675411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.675480 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.675549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.675618 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.675688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.675765 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.675826 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.675940 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.676028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.676099 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.676168 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.676247 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.676319 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.676388 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.676457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.676526 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.676600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.676679 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.676751 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.676820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.676889 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.676958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.677027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.677128 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.677204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.677274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.677344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.677419 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.677542 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.677633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.677777 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.677865 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.678018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.678098 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.678277 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.678366 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.678510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.678693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.678772 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.678939 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.679016 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.679186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.679265 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.679445 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.679528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.679676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.679753 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.679913 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.679992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.680151 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.680229 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.680387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.680464 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.680619 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.680697 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.680864 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.680979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.681180 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.681249 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.681378 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.681458 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.681606 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.681684 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.681852 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.681931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.682085 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.682164 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.682329 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.682406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.682565 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.682642 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.682800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.682879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.683036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.683113 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.683270 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.683354 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.683517 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.683634 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.683793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.683888 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.684032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.684110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.684287 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.684452 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.684529 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.684713 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.684790 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.684967 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.685081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.685227 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.685305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.685464 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.685541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.685708 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.685864 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.685940 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.686010 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.686181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.686274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.686448 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.686538 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.686633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] resource.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.686712 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.686881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.686960 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.687129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.687216 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.687364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.687442 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.687611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.687688 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.687860 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.687939 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.688094 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.688172 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.688339 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.688416 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.688574 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.688653 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.688811 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.688887 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.689045 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] role.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.689144 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.689337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.689413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] role.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.689536 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.689613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.689779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.689855 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.690025 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.690103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.690274 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.690352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.690515 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.690590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.690761 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.690839 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.691008 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.691091 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.691247 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.691323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.691492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.691570 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.691723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.691799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.691964 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.692039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.692204 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] role.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.692289 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.692449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.692525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] role.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.692703 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.692806 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.693037 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.693138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.693329 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.693416 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.693584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.693680 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.693833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.693915 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.694081 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.694158 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.694329 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.694406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.694563 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.694642 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.694816 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.694892 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.695053 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.695130 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.695291 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.695368 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.695521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.695598 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.695758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.695843 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.695990 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.696067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.696239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.696411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.696488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.696654 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.696733 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.696912 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.696989 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.697194 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.697285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.697426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.697504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.697661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] token.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.697739 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.697898 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.697974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.698145 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.698230 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.698381 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.698458 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.698635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.698712 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.698882 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.699029 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.699110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.699181 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.699875 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.700038 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.700126 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.700332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.700405 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.700556 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.700638 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.700804 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.700891 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.701037 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.701148 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.701302 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.701379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.701540 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.701630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.701783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.701861 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.702025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.702113 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.702280 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.702357 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.702523 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.702601 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.connection = **** {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.702770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.702846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.703019 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.703096 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.703256 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.703335 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.703496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.703572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.703729 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.703806 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.703966 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.704045 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.704199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.704276 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.704438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.704579 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.704663 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.704727 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.704905 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.704987 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.705179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.705260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.705415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.705496 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.705667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.705820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.705896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.705989 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.706132 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.706259 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.connection = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.706365 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.706510 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.706587 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.706764 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.706841 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.706980 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 14:13:27.707065 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.707238 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.707479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.707720 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.707962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.708205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.708453 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.708695 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.708943 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.709210 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.709465 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.709706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.710042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.710273 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.710487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.710727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:13:27.710901 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 14:13:27.736391 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:27.736619 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:27.736841 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:27.739884 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:27.740120 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:27.740351 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:27.745217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:27.749752 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:27.774665 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:27.774890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:27.779467 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:27.783044 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:27.834647 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:27.834808 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:27.883148 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:27.883379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:27.884550 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:27.884792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.044469 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.044697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.044916 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.045035 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.045150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.045283 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.045382 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.045512 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.045608 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.045737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.045961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.046183 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.076572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.076762 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.076875 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.076996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.077107 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.077254 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.077338 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.077472 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.077555 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.077685 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.077766 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.077896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.077986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.078112 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.089007 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.089430 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.102523 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.102758 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.102918 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.103010 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.103151 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.103235 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.103378 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.103472 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.103603 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.103688 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.103825 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.103908 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.104040 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.104252 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 14:13:28.120640 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.120852 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 05 14:13:28.121015 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.121741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 05 14:13:28.121973 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.121973 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 05 14:13:28.122116 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.122240 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.122351 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 05 14:13:28.122509 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.122628 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.122773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.122892 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.123034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.123152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.123409 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.132729 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.133014 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.133119 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.133356 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.133463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.133597 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.133681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.133877 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.141195 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.142466 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.144112 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.144405 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.144491 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.144690 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.144776 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.144975 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.145088 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.145283 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.145366 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.145549 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.145645 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.145815 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.145898 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.146085 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.146165 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.146358 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.146439 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.146626 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.146706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.146896 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.146978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.147159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.169796 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.170200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.171256 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.171541 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.171680 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.171971 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.176431 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.176714 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.176978 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.177104 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.177293 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.177585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.183333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.184140 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.184510 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.184801 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.189869 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.190160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.190443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.190523 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.194098 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.194185 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.194259 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.194332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.194401 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.194486 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.194562 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.194635 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.194706 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.194777 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.194777 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.194777 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.207291 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.207572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.208177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.208470 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.211475 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.212319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.214725 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.215674 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.216106 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.216406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.219960 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.220585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.223105 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.223700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.226378 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.226676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.226961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.227042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.227243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.227350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.227529 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.227653 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.227824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.227920 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.228114 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.228397 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.244249 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.244538 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.244816 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.244909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.245094 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.245208 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.245417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.245685 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.252215 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.252665 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.253781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.254278 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.255300 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.255585 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.255819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.256104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.258305 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.258590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.258814 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.258897 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.259108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.259189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.259403 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.259512 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.259695 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.260093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.270839 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.271124 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.271410 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.274301 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.274388 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.274462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.274535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.274607 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.274938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.275016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.275089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.275160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.275160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.275160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.288477 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.289550 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.291395 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.292472 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.294873 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.296162 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.296306 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.297657 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.297810 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.298094 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.298490 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.299142 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.299442 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.299848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.305130 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.306560 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.306643 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.308019 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.309490 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.314372 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.314372 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.314372 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.314556 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.314556 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.314556 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.314556 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.318231 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.318532 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.318823 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.320074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.320369 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.320656 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.325759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.326020 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.326314 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.326568 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.326853 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.327124 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.327393 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.327654 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.327920 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.328007 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 14:13:28.328206 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.328286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.328490 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.328571 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.328748 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.328829 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.329009 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.329118 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.329292 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.329374 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.329620 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.329893 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.330167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.330458 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.330744 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.331018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.331286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.331561 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 14:13:28.364213 dv-cinder-842905-3-smb devstack@keystone.service[81624]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e1a789d9c0 pid: 81624 (default app) Sep 05 14:13:28.367123 dv-cinder-842905-3-smb devstack@keystone.service[81623]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e1a789d9c0 pid: 81623 (default app) Sep 05 14:13:28.367484 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda43b8-9d74-41fd-aed1-c674fd450dcf None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:28.367770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda43b8-9d74-41fd-aed1-c674fd450dcf None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:28.368043 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda43b8-9d74-41fd-aed1-c674fd450dcf None None] PATH_INFO: `/v3` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:28.372331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Mon Sep 5 14:13:28 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:35.791463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c1776-f758-4d2e-9892-4f4bc3e58027 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:35.791990 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c1776-f758-4d2e-9892-4f4bc3e58027 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:35.791990 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c1776-f758-4d2e-9892-4f4bc3e58027 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:35.796944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:13:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:13:35.802405 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3070b-2ec5-4864-bfe3-b9c535b2ac1a None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:35.802856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3070b-2ec5-4864-bfe3-b9c535b2ac1a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:35.802974 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3070b-2ec5-4864-bfe3-b9c535b2ac1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:35.878763 dv-cinder-842905-3-smb devstack@keystone.service[81624]: INFO dbcounter [None req-97b3070b-2ec5-4864-bfe3-b9c535b2ac1a None None] Registered counter for database keystone Sep 05 14:13:35.900424 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG oslo_db.sqlalchemy.engines [None req-97b3070b-2ec5-4864-bfe3-b9c535b2ac1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 14:13:35.906850 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writer thread running {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 14:13:36.087500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG passlib.handlers.bcrypt [None req-97b3070b-2ec5-4864-bfe3-b9c535b2ac1a None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81624) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 05 14:13:36.087812 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG passlib.handlers.bcrypt [None req-97b3070b-2ec5-4864-bfe3-b9c535b2ac1a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81624) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 05 14:13:36.146986 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-97b3070b-2ec5-4864-bfe3-b9c535b2ac1a None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:13:36.148608 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-97b3070b-2ec5-4864-bfe3-b9c535b2ac1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:13:36.285476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:13:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 05 14:13:36.577649 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c1776-f758-4d2e-9892-4f4bc3e58027 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:36.646641 dv-cinder-842905-3-smb devstack@keystone.service[81623]: INFO dbcounter [None req-ca6c1776-f758-4d2e-9892-4f4bc3e58027 None None] Registered counter for database keystone Sep 05 14:13:36.665582 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG oslo_db.sqlalchemy.engines [None req-ca6c1776-f758-4d2e-9892-4f4bc3e58027 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 14:13:36.672461 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writer thread running {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 14:13:36.789345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c1776-f758-4d2e-9892-4f4bc3e58027 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:36.794101 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f92fb9-094a-407d-946b-e41e4824b2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:36.794725 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f92fb9-094a-407d-946b-e41e4824b2cb admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:36.795005 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f92fb9-094a-407d-946b-e41e4824b2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:36.795273 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f92fb9-094a-407d-946b-e41e4824b2cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:36.803706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f92fb9-094a-407d-946b-e41e4824b2cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:36.856811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: WARNING keystone.common.rbac_enforcer.enforcer [None req-00f92fb9-094a-407d-946b-e41e4824b2cb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 05 14:13:36.857115 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f92fb9-094a-407d-946b-e41e4824b2cb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:36.866486 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Sep 5 14:13:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 14:13:36.872567 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3070b-2ec5-4864-bfe3-b9c535b2ac1a None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:36.887237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3070b-2ec5-4864-bfe3-b9c535b2ac1a None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:36.891648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af79c87-76e1-4086-9270-ccd666e8e2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:36.892748 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af79c87-76e1-4086-9270-ccd666e8e2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:36.893026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af79c87-76e1-4086-9270-ccd666e8e2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:36.893325 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af79c87-76e1-4086-9270-ccd666e8e2e4 admin admin] PATH_INFO: `/v3/projects/c738420b616e421c9aa849509b94fc5a` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:36.894877 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af79c87-76e1-4086-9270-ccd666e8e2e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=c738420b616e421c9aa849509b94fc5a)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:36.948582 dv-cinder-842905-3-smb devstack@keystone.service[81624]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3af79c87-76e1-4086-9270-ccd666e8e2e4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 05 14:13:36.948921 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af79c87-76e1-4086-9270-ccd666e8e2e4 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:36.954169 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Sep 5 14:13:36 2022] GET /identity/v3/projects/c738420b616e421c9aa849509b94fc5a => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:13:38.830511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c7b2e-a62c-4332-bba4-e8e25558a1ef None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:38.831065 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c7b2e-a62c-4332-bba4-e8e25558a1ef None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:38.831065 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c7b2e-a62c-4332-bba4-e8e25558a1ef None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:38.835274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:13:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:13:38.840638 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7187f3-517e-4fda-a879-1e1c391e2447 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:38.841028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7187f3-517e-4fda-a879-1e1c391e2447 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:38.841243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7187f3-517e-4fda-a879-1e1c391e2447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:38.862046 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-fe7187f3-517e-4fda-a879-1e1c391e2447 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:13:38.863571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fe7187f3-517e-4fda-a879-1e1c391e2447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:13:38.871980 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:13:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 05 14:13:39.140954 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c7b2e-a62c-4332-bba4-e8e25558a1ef None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:39.153681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c7b2e-a62c-4332-bba4-e8e25558a1ef None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:39.157856 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56f976-bbef-4c2a-bccd-3f86b9d81284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:39.158447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56f976-bbef-4c2a-bccd-3f86b9d81284 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:39.158728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56f976-bbef-4c2a-bccd-3f86b9d81284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:39.159000 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56f976-bbef-4c2a-bccd-3f86b9d81284 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:39.166584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56f976-bbef-4c2a-bccd-3f86b9d81284 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:39.168829 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56f976-bbef-4c2a-bccd-3f86b9d81284 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:39.177723 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Sep 5 14:13:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 14:13:39.183008 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7187f3-517e-4fda-a879-1e1c391e2447 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:39.192009 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7187f3-517e-4fda-a879-1e1c391e2447 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:39.196318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8520a-f6a0-4546-ac4f-40df012faf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:39.196938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8520a-f6a0-4546-ac4f-40df012faf5a admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:39.197253 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8520a-f6a0-4546-ac4f-40df012faf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:39.197526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8520a-f6a0-4546-ac4f-40df012faf5a admin admin] PATH_INFO: `/v3/users/7609e1a1df8f4af7ad4a5bc5e3426829` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:39.198824 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8520a-f6a0-4546-ac4f-40df012faf5a admin admin] RBAC: Authorizing `identity:get_user(user_id=7609e1a1df8f4af7ad4a5bc5e3426829)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:39.201439 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8520a-f6a0-4546-ac4f-40df012faf5a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:39.206684 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Mon Sep 5 14:13:39 2022] GET /identity/v3/users/7609e1a1df8f4af7ad4a5bc5e3426829 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:41.187396 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c3f55-c63f-4eff-8620-6ae9466445a9 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:41.187932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c3f55-c63f-4eff-8620-6ae9466445a9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:41.187932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c3f55-c63f-4eff-8620-6ae9466445a9 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:41.189290 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:13:41.194383 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db707eb-f297-4fac-957b-d9a99e12b3d9 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:41.194797 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db707eb-f297-4fac-957b-d9a99e12b3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:41.194944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db707eb-f297-4fac-957b-d9a99e12b3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:41.213900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-3db707eb-f297-4fac-957b-d9a99e12b3d9 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:13:41.215672 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3db707eb-f297-4fac-957b-d9a99e12b3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:13:41.246325 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51663301-1580-4401-8268-db04f53bc930 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:41.246603 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51663301-1580-4401-8268-db04f53bc930 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:41.246881 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51663301-1580-4401-8268-db04f53bc930 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:41.248198 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:13:41.253471 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2ce6d-a1fa-4207-8cf2-df342d01f74b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:41.253762 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2ce6d-a1fa-4207-8cf2-df342d01f74b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:41.254038 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2ce6d-a1fa-4207-8cf2-df342d01f74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:41.297190 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG passlib.handlers.bcrypt [None req-cfa2ce6d-a1fa-4207-8cf2-df342d01f74b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81623) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 05 14:13:41.297572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG passlib.handlers.bcrypt [None req-cfa2ce6d-a1fa-4207-8cf2-df342d01f74b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81623) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 05 14:13:41.308768 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:13:41.347261 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-cfa2ce6d-a1fa-4207-8cf2-df342d01f74b None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:13:41.348872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cfa2ce6d-a1fa-4207-8cf2-df342d01f74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:13:41.447175 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:13:41.575809 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db707eb-f297-4fac-957b-d9a99e12b3d9 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:41.601422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:41.684412 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db707eb-f297-4fac-957b-d9a99e12b3d9 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:41.717786 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c90ce-24df-4731-ab9e-5669ff529549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:41.718361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c90ce-24df-4731-ab9e-5669ff529549 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:41.718640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c90ce-24df-4731-ab9e-5669ff529549 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:41.718913 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c90ce-24df-4731-ab9e-5669ff529549 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:41.727061 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2ce6d-a1fa-4207-8cf2-df342d01f74b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:41.730076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c90ce-24df-4731-ab9e-5669ff529549 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:13:41.739496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-a41c90ce-24df-4731-ab9e-5669ff529549 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:13:41.739496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:13:41.739496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:13:41.739496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:13:41.739496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:13:41.739496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:13:41.739496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:13:41.739496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:13:41.739496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:13:41.739496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:13:41.739496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:13:41.739496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:13:41.739496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:13:41.739496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:13:41.739496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:13:41.739496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:13:41.740497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:13:41.740497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:13:41.740497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:13:41.740497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:13:41.740497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:13:41.740497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:13:41.740497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:13:41.740497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:13:41.740497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:13:41.740497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:13:41.740497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:13:41.740497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:13:41.740497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:13:41.740497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:13:41.740497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:13:41.740497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:13:41.741362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:13:41.741362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:13:41.741362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:13:41.741362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:13:41.741362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:13:41.741362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:13:41.741362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:13:41.741362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:13:41.741362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:13:41.741362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:13:41.741362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:13:41.741362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:13:41.741362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:13:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:13:41.746397 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c90ce-24df-4731-ab9e-5669ff529549 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:41.826791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2ce6d-a1fa-4207-8cf2-df342d01f74b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:41.829101 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:41.830907 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:41.848497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c90ce-24df-4731-ab9e-5669ff529549 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:41.864848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94686b-e554-47be-ab0b-1b1fd08b6b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:41.865732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94686b-e554-47be-ab0b-1b1fd08b6b1f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:41.866017 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94686b-e554-47be-ab0b-1b1fd08b6b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:41.866288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94686b-e554-47be-ab0b-1b1fd08b6b1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:41.882534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39c551-626d-4884-935f-7807b05343ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:41.883146 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39c551-626d-4884-935f-7807b05343ba None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:41.883425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39c551-626d-4884-935f-7807b05343ba None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:41.883696 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39c551-626d-4884-935f-7807b05343ba None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:41.884364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39c551-626d-4884-935f-7807b05343ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:13:41.884668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39c551-626d-4884-935f-7807b05343ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:41.886110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39c551-626d-4884-935f-7807b05343ba None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:41.900296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 8/15] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:13:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:13:41.906547 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39c551-626d-4884-935f-7807b05343ba None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:41.940838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec94686b-e554-47be-ab0b-1b1fd08b6b1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:41.942477 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec94686b-e554-47be-ab0b-1b1fd08b6b1f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:42.019200 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39c551-626d-4884-935f-7807b05343ba None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:42.040217 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 8/16] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:13:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 14:13:42.046276 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94686b-e554-47be-ab0b-1b1fd08b6b1f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:42.049258 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:42.054057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07be626-e4e3-4656-af60-5f3b6a44f785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:42.054695 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07be626-e4e3-4656-af60-5f3b6a44f785 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:42.054965 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07be626-e4e3-4656-af60-5f3b6a44f785 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:42.055233 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07be626-e4e3-4656-af60-5f3b6a44f785 None admin] PATH_INFO: `/v3/users/7609e1a1df8f4af7ad4a5bc5e3426829` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:42.056355 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07be626-e4e3-4656-af60-5f3b6a44f785 None admin] RBAC: Authorizing `identity:get_user(user_id=7609e1a1df8f4af7ad4a5bc5e3426829)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:42.057916 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07be626-e4e3-4656-af60-5f3b6a44f785 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:42.059662 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:13:41 2022] GET /identity/v3/users/7609e1a1df8f4af7ad4a5bc5e3426829 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:13:42.065372 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07be626-e4e3-4656-af60-5f3b6a44f785 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:42.084130 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:42.147312 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94686b-e554-47be-ab0b-1b1fd08b6b1f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:42.169846 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07be626-e4e3-4656-af60-5f3b6a44f785 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:42.181329 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531eb40-73af-48f1-8a88-e947c3a22370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:42.182176 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531eb40-73af-48f1-8a88-e947c3a22370 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:42.182458 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531eb40-73af-48f1-8a88-e947c3a22370 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:42.182730 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531eb40-73af-48f1-8a88-e947c3a22370 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:42.201539 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531eb40-73af-48f1-8a88-e947c3a22370 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:42.203113 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531eb40-73af-48f1-8a88-e947c3a22370 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:42.204142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7389146-ddc8-429c-b260-63cf96c3068a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:42.204917 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7389146-ddc8-429c-b260-63cf96c3068a None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:42.205283 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7389146-ddc8-429c-b260-63cf96c3068a None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:42.205561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7389146-ddc8-429c-b260-63cf96c3068a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:42.207744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7389146-ddc8-429c-b260-63cf96c3068a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:42.209241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7389146-ddc8-429c-b260-63cf96c3068a None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:42.210799 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 10/18] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:13:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:13:42.216845 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7389146-ddc8-429c-b260-63cf96c3068a None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:42.221799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-d531eb40-73af-48f1-8a88-e947c3a22370 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:13:42.221799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:13:42.221799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:13:42.221799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:13:42.221799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:13:42.221799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:13:42.221799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:13:42.221799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:13:42.221799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:13:42.221799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:13:42.221799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:13:42.221799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:13:42.221799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:13:42.221799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:13:42.221799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:13:42.221799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:13:42.222900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:13:42.222900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:13:42.222900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:13:42.222900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:13:42.222900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:13:42.222900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:13:42.222900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:13:42.222900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:13:42.222900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:13:42.222900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:13:42.222900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:13:42.222900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:13:42.222900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:13:42.222900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:13:42.222900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:13:42.222900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:13:42.222900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:13:42.223703 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:13:42.223703 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:13:42.223703 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:13:42.223703 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 9/19] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:13:42.228877 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531eb40-73af-48f1-8a88-e947c3a22370 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:42.287558 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:42.304670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:42.323765 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7389146-ddc8-429c-b260-63cf96c3068a None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:42.332828 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531eb40-73af-48f1-8a88-e947c3a22370 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:42.359091 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ce14b-eb74-4e1f-a458-2d2dc9c0a87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:42.359704 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ce14b-eb74-4e1f-a458-2d2dc9c0a87a None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:42.359985 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ce14b-eb74-4e1f-a458-2d2dc9c0a87a None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:42.360262 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ce14b-eb74-4e1f-a458-2d2dc9c0a87a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:42.360993 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ce14b-eb74-4e1f-a458-2d2dc9c0a87a None admin] RBAC: Adding query filter params (role.id=f22e6e660eab44c5be25e3dee1e3042c, scope.domain.id=default, user.id=7609e1a1df8f4af7ad4a5bc5e3426829) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:13:42.361333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ce14b-eb74-4e1f-a458-2d2dc9c0a87a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:42.362806 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ce14b-eb74-4e1f-a458-2d2dc9c0a87a None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:42.367970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3939b-cf05-4941-a553-47c0262096db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:42.368601 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3939b-cf05-4941-a553-47c0262096db None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:42.368884 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3939b-cf05-4941-a553-47c0262096db None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:42.369187 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3939b-cf05-4941-a553-47c0262096db None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:42.369364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 11/20] 10.222.0.23 () {56 vars in 1322 bytes} [Mon Sep 5 14:13:42 2022] GET /identity/v3/role_assignments?user.id=7609e1a1df8f4af7ad4a5bc5e3426829&scope.domain.id=default&role.id=f22e6e660eab44c5be25e3dee1e3042c => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:13:42.369836 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3939b-cf05-4941-a553-47c0262096db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:13:42.370141 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3939b-cf05-4941-a553-47c0262096db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:42.371705 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3939b-cf05-4941-a553-47c0262096db None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:42.391713 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 10/21] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:13:44.613088 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f570355-c3a6-4859-bc27-6bf841fe0b08 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:44.613632 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f570355-c3a6-4859-bc27-6bf841fe0b08 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:44.613632 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f570355-c3a6-4859-bc27-6bf841fe0b08 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:44.614983 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 12/22] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:13:44.620283 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e919d-02c6-4660-b320-bdf365b53cab None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:44.621664 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e919d-02c6-4660-b320-bdf365b53cab None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:44.622168 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e919d-02c6-4660-b320-bdf365b53cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:44.650065 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7f3e919d-02c6-4660-b320-bdf365b53cab None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:13:44.651652 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7f3e919d-02c6-4660-b320-bdf365b53cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:13:44.661454 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209617e3-e611-4d60-9470-7a947171670b None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:44.662047 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209617e3-e611-4d60-9470-7a947171670b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:44.662584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209617e3-e611-4d60-9470-7a947171670b None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:44.664396 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 13/23] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:13:44.669408 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac580d-766d-4d08-a588-56d60f7b7877 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:44.669946 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac580d-766d-4d08-a588-56d60f7b7877 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:44.670429 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac580d-766d-4d08-a588-56d60f7b7877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:44.703467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-20ac580d-766d-4d08-a588-56d60f7b7877 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:13:44.708619 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-20ac580d-766d-4d08-a588-56d60f7b7877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:13:44.802574 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 11/24] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:13:44.804227 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e1125-f94f-4cd1-8882-312e3af6309a None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:44.805924 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e1125-f94f-4cd1-8882-312e3af6309a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:44.806421 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e1125-f94f-4cd1-8882-312e3af6309a None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:44.809981 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 12/25] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:13:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:13:44.813754 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de97ec-dad3-43c2-ac9f-73403a215d29 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:44.814253 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de97ec-dad3-43c2-ac9f-73403a215d29 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:44.814734 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de97ec-dad3-43c2-ac9f-73403a215d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:44.846735 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d3de97ec-dad3-43c2-ac9f-73403a215d29 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:13:44.849274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d3de97ec-dad3-43c2-ac9f-73403a215d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:13:44.851035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 14/26] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:13:44.907102 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:44.938977 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 13/27] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:13:45.241239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55d5dd-e5ff-4130-801e-9d55d08cd8ef None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:45.241661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55d5dd-e5ff-4130-801e-9d55d08cd8ef None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:45.242039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55d5dd-e5ff-4130-801e-9d55d08cd8ef None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:45.243630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 15/28] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:13:45.248980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27bd0c-0046-47ff-a306-b74eb909fb66 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:45.249414 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27bd0c-0046-47ff-a306-b74eb909fb66 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:45.249791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27bd0c-0046-47ff-a306-b74eb909fb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:45.272536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3e27bd0c-0046-47ff-a306-b74eb909fb66 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:13:45.273777 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3e27bd0c-0046-47ff-a306-b74eb909fb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:13:45.350202 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55d5dd-e5ff-4130-801e-9d55d08cd8ef None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:45.369747 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 14/29] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:13:45.400945 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27bd0c-0046-47ff-a306-b74eb909fb66 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:45.485487 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:45.533138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55d5dd-e5ff-4130-801e-9d55d08cd8ef None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:45.572333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cb035-0a0c-4121-a511-531a54fbda7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:45.572967 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cb035-0a0c-4121-a511-531a54fbda7c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:45.573325 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cb035-0a0c-4121-a511-531a54fbda7c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:45.573595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cb035-0a0c-4121-a511-531a54fbda7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:45.584060 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27bd0c-0046-47ff-a306-b74eb909fb66 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:45.589086 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cb035-0a0c-4121-a511-531a54fbda7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:13:45.593713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-4f0cb035-0a0c-4121-a511-531a54fbda7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:13:45.593713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:13:45.593713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:13:45.593713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:13:45.593713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:13:45.593713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:13:45.593713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:13:45.593713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:13:45.593713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:13:45.593713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:13:45.593713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:13:45.593713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:13:45.593713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:13:45.593713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:13:45.593713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:13:45.593713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:13:45.594552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:13:45.594552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:13:45.594552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:13:45.594552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:13:45.594552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:13:45.594552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:13:45.594552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:13:45.594552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:13:45.594552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:13:45.594552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:13:45.594552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:13:45.594552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:13:45.594552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:13:45.594552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:13:45.594552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:13:45.594552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:13:45.595312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:13:45.595312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:13:45.595312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:13:45.595312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:13:45.595312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:13:45.595312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:13:45.595312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:13:45.595312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:13:45.595312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:13:45.595312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:13:45.595312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:13:45.595312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:13:45.595312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 16/30] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:13:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:13:45.595925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cb035-0a0c-4121-a511-531a54fbda7c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:45.599940 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:45.659823 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73c4ac-fccb-45d2-8f77-6bbd6dd8a143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:45.660488 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73c4ac-fccb-45d2-8f77-6bbd6dd8a143 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:45.660785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73c4ac-fccb-45d2-8f77-6bbd6dd8a143 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:45.661081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73c4ac-fccb-45d2-8f77-6bbd6dd8a143 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:45.679098 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73c4ac-fccb-45d2-8f77-6bbd6dd8a143 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:45.681646 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73c4ac-fccb-45d2-8f77-6bbd6dd8a143 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:45.708876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-dc73c4ac-fccb-45d2-8f77-6bbd6dd8a143 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:13:45.708876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:13:45.708876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:13:45.708876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:13:45.708876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:13:45.708876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:13:45.708876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:13:45.708876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:13:45.708876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:13:45.708876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:13:45.708876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:13:45.708876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:13:45.708876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:13:45.708876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:13:45.708876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:13:45.708876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:13:45.709809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:13:45.709809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:13:45.709809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:13:45.709809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:13:45.709809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:13:45.709809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:13:45.709809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:13:45.709809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:13:45.709809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:13:45.709809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:13:45.709809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:13:45.709809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:13:45.709809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:13:45.709809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:13:45.709809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:13:45.709809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:13:45.709809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:13:45.710611 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:13:45.710611 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:13:45.710611 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:13:45.710611 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 15/31] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:13:45.711253 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73c4ac-fccb-45d2-8f77-6bbd6dd8a143 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:45.752843 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cb035-0a0c-4121-a511-531a54fbda7c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:45.790955 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4e4e1-a577-40cc-b04e-93931b1afbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:45.791907 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4e4e1-a577-40cc-b04e-93931b1afbee None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:45.792404 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4e4e1-a577-40cc-b04e-93931b1afbee None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:45.794011 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4e4e1-a577-40cc-b04e-93931b1afbee None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:45.794949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4e4e1-a577-40cc-b04e-93931b1afbee None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:45.796596 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4e4e1-a577-40cc-b04e-93931b1afbee None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:45.801007 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:45.825619 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73c4ac-fccb-45d2-8f77-6bbd6dd8a143 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:45.862728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d728db1-b27b-4ac4-a27b-7f3a288f025e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:45.863341 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728db1-b27b-4ac4-a27b-7f3a288f025e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:45.863623 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728db1-b27b-4ac4-a27b-7f3a288f025e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:45.863908 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d728db1-b27b-4ac4-a27b-7f3a288f025e None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:45.864581 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d728db1-b27b-4ac4-a27b-7f3a288f025e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:13:45.864875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d728db1-b27b-4ac4-a27b-7f3a288f025e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:45.866283 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d728db1-b27b-4ac4-a27b-7f3a288f025e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:45.883155 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 16/32] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:13:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:45.883155 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d728db1-b27b-4ac4-a27b-7f3a288f025e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:45.909592 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:45.993245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d728db1-b27b-4ac4-a27b-7f3a288f025e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:46.034344 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1ad52-6eba-4fe2-aa14-20f46435645a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:46.035273 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1ad52-6eba-4fe2-aa14-20f46435645a None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:46.035754 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1ad52-6eba-4fe2-aa14-20f46435645a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:46.036226 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1ad52-6eba-4fe2-aa14-20f46435645a None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:46.037155 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1ad52-6eba-4fe2-aa14-20f46435645a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:46.038909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1ad52-6eba-4fe2-aa14-20f46435645a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:46.048740 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 17/33] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Sep 5 14:13:45 2022] POST /identity/v3/roles => generated 219 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:13:46.053186 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4e4e1-a577-40cc-b04e-93931b1afbee None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:46.211032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4e4e1-a577-40cc-b04e-93931b1afbee None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:46.249412 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0462e-880c-406e-9221-28c2770236c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:46.250032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0462e-880c-406e-9221-28c2770236c9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:46.250317 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0462e-880c-406e-9221-28c2770236c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:46.250597 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0462e-880c-406e-9221-28c2770236c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:46.251252 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0462e-880c-406e-9221-28c2770236c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:13:46.251559 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0462e-880c-406e-9221-28c2770236c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:46.253125 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0462e-880c-406e-9221-28c2770236c9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:46.273366 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 18/34] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:46.273537 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 17/35] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Sep 5 14:13:45 2022] POST /identity/v3/roles => generated 225 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:13:46.273870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0462e-880c-406e-9221-28c2770236c9 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:46.274847 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075df26-88e1-4ad8-9873-f87b389d6851 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:46.275136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075df26-88e1-4ad8-9873-f87b389d6851 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:46.275589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075df26-88e1-4ad8-9873-f87b389d6851 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:46.277632 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 18/36] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:13:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:13:46.281882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075df26-88e1-4ad8-9873-f87b389d6851 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:46.355358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:46.410069 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:46.411427 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0462e-880c-406e-9221-28c2770236c9 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:46.435848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075df26-88e1-4ad8-9873-f87b389d6851 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:46.456215 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922176b-94b2-4152-8e34-8e1d0893f45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:46.456867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922176b-94b2-4152-8e34-8e1d0893f45c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:46.457183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922176b-94b2-4152-8e34-8e1d0893f45c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:46.457465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922176b-94b2-4152-8e34-8e1d0893f45c None admin] PATH_INFO: `/v3/users/7609e1a1df8f4af7ad4a5bc5e3426829` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:46.458734 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922176b-94b2-4152-8e34-8e1d0893f45c None admin] RBAC: Authorizing `identity:get_user(user_id=7609e1a1df8f4af7ad4a5bc5e3426829)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:46.460209 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922176b-94b2-4152-8e34-8e1d0893f45c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:46.462095 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 19/37] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:13:46 2022] GET /identity/v3/users/7609e1a1df8f4af7ad4a5bc5e3426829 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:46.463112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bcb18-29de-447f-b84e-352218d6e3f3 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:46.463398 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bcb18-29de-447f-b84e-352218d6e3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:46.463670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bcb18-29de-447f-b84e-352218d6e3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:46.476027 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308dda3-6fbd-4c5b-bf64-78df6fb69ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:46.476653 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308dda3-6fbd-4c5b-bf64-78df6fb69ef7 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:46.476941 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308dda3-6fbd-4c5b-bf64-78df6fb69ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:46.477252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308dda3-6fbd-4c5b-bf64-78df6fb69ef7 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:46.478180 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308dda3-6fbd-4c5b-bf64-78df6fb69ef7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:46.479770 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308dda3-6fbd-4c5b-bf64-78df6fb69ef7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:46.487877 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-107bcb18-29de-447f-b84e-352218d6e3f3 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:13:46.490185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-107bcb18-29de-447f-b84e-352218d6e3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:13:46.563178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 20/38] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:13:46.564574 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c58e30-0ee6-4d26-b5ca-84fa58b39576 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:46.564865 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c58e30-0ee6-4d26-b5ca-84fa58b39576 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:46.565166 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c58e30-0ee6-4d26-b5ca-84fa58b39576 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:46.566559 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 21/39] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:13:46.569613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 19/40] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 5 14:13:46 2022] POST /identity/v3/projects => generated 301 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:13:46.571322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c58e30-0ee6-4d26-b5ca-84fa58b39576 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:46.572347 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c31de-5762-41a9-beba-b75014c2c0ce None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:46.572648 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c31de-5762-41a9-beba-b75014c2c0ce None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:46.572999 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c31de-5762-41a9-beba-b75014c2c0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:46.598557 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7b4c31de-5762-41a9-beba-b75014c2c0ce None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:13:46.603382 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7b4c31de-5762-41a9-beba-b75014c2c0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:13:46.641001 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:46.688911 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 20/41] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:13:46.699473 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c58e30-0ee6-4d26-b5ca-84fa58b39576 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:46.737924 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f613c-cd68-470c-b764-d0e6afa2fb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:46.738573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f613c-cd68-470c-b764-d0e6afa2fb65 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:46.738854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f613c-cd68-470c-b764-d0e6afa2fb65 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:46.739124 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f613c-cd68-470c-b764-d0e6afa2fb65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:46.740269 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f613c-cd68-470c-b764-d0e6afa2fb65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:46.741794 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f613c-cd68-470c-b764-d0e6afa2fb65 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:46.743375 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 22/42] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:13:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:46.750097 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c31de-5762-41a9-beba-b75014c2c0ce None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:46.818550 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:46.859105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c31de-5762-41a9-beba-b75014c2c0ce None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:46.884504 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f613c-cd68-470c-b764-d0e6afa2fb65 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:46.895719 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4406e2b-46e0-44ca-9828-3cea31eb356a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:46.896323 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4406e2b-46e0-44ca-9828-3cea31eb356a None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:46.896609 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4406e2b-46e0-44ca-9828-3cea31eb356a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:46.896890 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4406e2b-46e0-44ca-9828-3cea31eb356a None admin] PATH_INFO: `/v3/domains/default/users/7609e1a1df8f4af7ad4a5bc5e3426829/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:46.899524 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4406e2b-46e0-44ca-9828-3cea31eb356a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7609e1a1df8f4af7ad4a5bc5e3426829, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:46.901922 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4406e2b-46e0-44ca-9828-3cea31eb356a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:46.997977 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 21/43] 10.222.0.23 () {58 vars in 1361 bytes} [Mon Sep 5 14:13:46 2022] PUT /identity/v3/domains/default/users/7609e1a1df8f4af7ad4a5bc5e3426829/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:13:46.999238 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4406e2b-46e0-44ca-9828-3cea31eb356a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:47.111941 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f613c-cd68-470c-b764-d0e6afa2fb65 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:47.120728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4406e2b-46e0-44ca-9828-3cea31eb356a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:47.136832 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:47.151229 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:47.160120 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1738df-4e98-4e1e-ac95-c63e1180a563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:47.160740 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1738df-4e98-4e1e-ac95-c63e1180a563 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:47.161154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1738df-4e98-4e1e-ac95-c63e1180a563 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:47.161483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1738df-4e98-4e1e-ac95-c63e1180a563 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:47.162175 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1738df-4e98-4e1e-ac95-c63e1180a563 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:47.163663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1738df-4e98-4e1e-ac95-c63e1180a563 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:47.163830 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78ec08-f649-4bef-9d4a-1e3df0b31026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:47.164468 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78ec08-f649-4bef-9d4a-1e3df0b31026 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:47.164746 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78ec08-f649-4bef-9d4a-1e3df0b31026 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:47.165018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78ec08-f649-4bef-9d4a-1e3df0b31026 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:47.166182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78ec08-f649-4bef-9d4a-1e3df0b31026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:47.168150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78ec08-f649-4bef-9d4a-1e3df0b31026 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:47.169766 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 22/44] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:13:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:47.175133 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78ec08-f649-4bef-9d4a-1e3df0b31026 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:47.221213 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 23/45] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Sep 5 14:13:46 2022] POST /identity/v3/roles => generated 223 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:13:47.399795 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78ec08-f649-4bef-9d4a-1e3df0b31026 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:47.436831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3e3ea-322d-4577-abae-86abc1440c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:47.437444 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3e3ea-322d-4577-abae-86abc1440c35 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:47.437727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3e3ea-322d-4577-abae-86abc1440c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:47.438598 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3e3ea-322d-4577-abae-86abc1440c35 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:47.438736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3e3ea-322d-4577-abae-86abc1440c35 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:47.440116 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3e3ea-322d-4577-abae-86abc1440c35 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:47.523091 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 5 14:13:47 2022] POST /identity/v3/projects => generated 312 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:13:48.933036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ac644-cacd-4445-a258-11f9e50050cc None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:48.933639 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ac644-cacd-4445-a258-11f9e50050cc None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:48.933800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ac644-cacd-4445-a258-11f9e50050cc None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:48.935138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 24/47] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:13:48.940402 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9f799-20c6-4745-9fec-a1b2e4e442fa None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:48.940829 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9f799-20c6-4745-9fec-a1b2e4e442fa None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:48.940954 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9f799-20c6-4745-9fec-a1b2e4e442fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:48.959110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-16e9f799-20c6-4745-9fec-a1b2e4e442fa None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:13:48.960284 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-16e9f799-20c6-4745-9fec-a1b2e4e442fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:13:48.994672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:49.025207 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 24/48] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:13:49.294541 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ac644-cacd-4445-a258-11f9e50050cc None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:49.400140 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ac644-cacd-4445-a258-11f9e50050cc None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:49.434430 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8a03b-1bd0-44c1-bc71-d5cf673df922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:49.435060 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8a03b-1bd0-44c1-bc71-d5cf673df922 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:49.435340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8a03b-1bd0-44c1-bc71-d5cf673df922 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:49.435612 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8a03b-1bd0-44c1-bc71-d5cf673df922 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:49.441442 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425feeb-bf6b-45e0-bc35-b89c257e4d46 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:49.441737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425feeb-bf6b-45e0-bc35-b89c257e4d46 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:49.442013 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425feeb-bf6b-45e0-bc35-b89c257e4d46 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:49.443358 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 25/49] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:13:49.446303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8a03b-1bd0-44c1-bc71-d5cf673df922 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:13:49.448249 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae03acc-cb31-4c5d-b336-607f724ac110 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:49.448539 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae03acc-cb31-4c5d-b336-607f724ac110 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:49.448816 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae03acc-cb31-4c5d-b336-607f724ac110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:49.451792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-d5d8a03b-1bd0-44c1-bc71-d5cf673df922 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:13:49.451792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:13:49.451792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:13:49.451792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:13:49.451792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:13:49.451792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:13:49.451792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:13:49.451792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:13:49.451792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:13:49.451792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:13:49.451792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:13:49.451792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:13:49.451792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:13:49.451792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:13:49.451792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:13:49.451792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:13:49.452754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:13:49.452754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:13:49.452754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:13:49.452754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:13:49.452754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:13:49.452754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:13:49.452754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:13:49.452754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:13:49.452754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:13:49.452754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:13:49.452754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:13:49.452754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:13:49.452754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:13:49.452754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:13:49.452754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:13:49.452754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:13:49.453599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:13:49.453599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:13:49.453599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:13:49.453599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:13:49.453599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:13:49.453599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:13:49.453599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:13:49.453599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:13:49.453599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:13:49.453599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:13:49.453599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:13:49.453599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:13:49.453599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 25/50] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:13:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:13:49.459019 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8a03b-1bd0-44c1-bc71-d5cf673df922 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:49.471622 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-fae03acc-cb31-4c5d-b336-607f724ac110 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:13:49.472820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fae03acc-cb31-4c5d-b336-607f724ac110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:13:49.500760 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:49.539454 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 26/51] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:13:49.560131 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8a03b-1bd0-44c1-bc71-d5cf673df922 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:49.593765 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad1770-616e-48ed-82c7-db3811e86ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:49.594369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad1770-616e-48ed-82c7-db3811e86ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:49.594652 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad1770-616e-48ed-82c7-db3811e86ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:49.594928 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad1770-616e-48ed-82c7-db3811e86ad2 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:49.595590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad1770-616e-48ed-82c7-db3811e86ad2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:13:49.595897 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad1770-616e-48ed-82c7-db3811e86ad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:49.597339 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad1770-616e-48ed-82c7-db3811e86ad2 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:49.605763 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 26/52] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:13:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:13:49.611381 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae03acc-cb31-4c5d-b336-607f724ac110 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:49.709274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae03acc-cb31-4c5d-b336-607f724ac110 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:49.710771 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:49.742121 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75647bd-bcdc-45e3-85fb-ffd07502131e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:49.742743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75647bd-bcdc-45e3-85fb-ffd07502131e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:49.743024 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75647bd-bcdc-45e3-85fb-ffd07502131e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:49.743299 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75647bd-bcdc-45e3-85fb-ffd07502131e None admin] PATH_INFO: `/v3/users/7609e1a1df8f4af7ad4a5bc5e3426829` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:49.744557 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75647bd-bcdc-45e3-85fb-ffd07502131e None admin] RBAC: Authorizing `identity:get_user(user_id=7609e1a1df8f4af7ad4a5bc5e3426829)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:49.747023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75647bd-bcdc-45e3-85fb-ffd07502131e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:49.748733 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 27/53] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:13:49 2022] GET /identity/v3/users/7609e1a1df8f4af7ad4a5bc5e3426829 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:49.754250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad1770-616e-48ed-82c7-db3811e86ad2 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:49.807504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75647bd-bcdc-45e3-85fb-ffd07502131e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:49.852835 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad1770-616e-48ed-82c7-db3811e86ad2 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:49.854387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:49.889952 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e823a6-3d96-4b9e-b0d0-f281b46ee3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:49.890581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e823a6-3d96-4b9e-b0d0-f281b46ee3ab None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:49.890863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e823a6-3d96-4b9e-b0d0-f281b46ee3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:49.891134 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e823a6-3d96-4b9e-b0d0-f281b46ee3ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:49.892245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e823a6-3d96-4b9e-b0d0-f281b46ee3ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:49.893752 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e823a6-3d96-4b9e-b0d0-f281b46ee3ab None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:49.895305 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 27/54] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:13:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:49.900956 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e823a6-3d96-4b9e-b0d0-f281b46ee3ab None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:49.907996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75647bd-bcdc-45e3-85fb-ffd07502131e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:49.942284 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004a2c6-c16f-48a5-ac4f-04729d14c729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:49.942902 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004a2c6-c16f-48a5-ac4f-04729d14c729 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:49.943182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004a2c6-c16f-48a5-ac4f-04729d14c729 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:49.943451 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004a2c6-c16f-48a5-ac4f-04729d14c729 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:49.944677 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004a2c6-c16f-48a5-ac4f-04729d14c729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:49.946147 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004a2c6-c16f-48a5-ac4f-04729d14c729 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:49.947683 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 28/55] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:13:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:13:49.953316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004a2c6-c16f-48a5-ac4f-04729d14c729 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:49.992323 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:50.000920 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e823a6-3d96-4b9e-b0d0-f281b46ee3ab None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:50.034521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a30fa5-a6c6-4a28-8e10-fb817eae4a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:50.035055 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a30fa5-a6c6-4a28-8e10-fb817eae4a26 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:50.035334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a30fa5-a6c6-4a28-8e10-fb817eae4a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:50.035604 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a30fa5-a6c6-4a28-8e10-fb817eae4a26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:50.036319 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a30fa5-a6c6-4a28-8e10-fb817eae4a26 None admin] RBAC: Adding query filter params (role.id=f22e6e660eab44c5be25e3dee1e3042c, scope.domain.id=default, user.id=7609e1a1df8f4af7ad4a5bc5e3426829) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:13:50.036629 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a30fa5-a6c6-4a28-8e10-fb817eae4a26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:50.038088 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a30fa5-a6c6-4a28-8e10-fb817eae4a26 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:50.044833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 28/56] 10.222.0.23 () {56 vars in 1322 bytes} [Mon Sep 5 14:13:49 2022] GET /identity/v3/role_assignments?user.id=7609e1a1df8f4af7ad4a5bc5e3426829&scope.domain.id=default&role.id=f22e6e660eab44c5be25e3dee1e3042c => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:13:50.052125 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004a2c6-c16f-48a5-ac4f-04729d14c729 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:50.088688 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18b1c5-4852-47d1-9f9c-e0f38d31737b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:50.089353 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18b1c5-4852-47d1-9f9c-e0f38d31737b None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:50.090255 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18b1c5-4852-47d1-9f9c-e0f38d31737b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:50.090541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18b1c5-4852-47d1-9f9c-e0f38d31737b None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:50.091225 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18b1c5-4852-47d1-9f9c-e0f38d31737b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:50.092728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18b1c5-4852-47d1-9f9c-e0f38d31737b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:50.175204 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 29/57] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Sep 5 14:13:49 2022] POST /identity/v3/projects => generated 298 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:13:52.070002 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4586514-ba24-4992-9d24-5adf7cda481b None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:52.070549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4586514-ba24-4992-9d24-5adf7cda481b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:52.070549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4586514-ba24-4992-9d24-5adf7cda481b None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:52.071881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 29/58] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:13:52.077165 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b5789-8cfb-4a3c-9487-6c9afe880f55 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:52.077590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b5789-8cfb-4a3c-9487-6c9afe880f55 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:52.077731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b5789-8cfb-4a3c-9487-6c9afe880f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:52.096197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-660b5789-8cfb-4a3c-9487-6c9afe880f55 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:13:52.097438 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-660b5789-8cfb-4a3c-9487-6c9afe880f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:13:52.162105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 30/59] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:13:52.429541 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4586514-ba24-4992-9d24-5adf7cda481b None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:52.465735 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:52.529019 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4586514-ba24-4992-9d24-5adf7cda481b None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:52.561253 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480428f0-bdf1-403b-9e56-d8a7a282cd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:52.561867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480428f0-bdf1-403b-9e56-d8a7a282cd7d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:52.562143 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480428f0-bdf1-403b-9e56-d8a7a282cd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:52.562417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480428f0-bdf1-403b-9e56-d8a7a282cd7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:52.563503 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480428f0-bdf1-403b-9e56-d8a7a282cd7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:52.564938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480428f0-bdf1-403b-9e56-d8a7a282cd7d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:52.566503 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 30/60] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:13:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:52.571933 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b5789-8cfb-4a3c-9487-6c9afe880f55 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:52.592918 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:52.668697 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b5789-8cfb-4a3c-9487-6c9afe880f55 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:52.702592 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a522d-b410-49ee-8a0b-90868083b89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:52.703142 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a522d-b410-49ee-8a0b-90868083b89d None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:52.703429 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a522d-b410-49ee-8a0b-90868083b89d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:52.703708 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a522d-b410-49ee-8a0b-90868083b89d None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:52.704366 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a522d-b410-49ee-8a0b-90868083b89d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:52.705837 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a522d-b410-49ee-8a0b-90868083b89d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:52.801600 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 31/61] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 5 14:13:52 2022] POST /identity/v3/users => generated 275 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:13:55.901731 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d3298-4f89-4028-a387-319211f5addc None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:55.902389 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d3298-4f89-4028-a387-319211f5addc None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:55.902661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d3298-4f89-4028-a387-319211f5addc None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:55.903862 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 31/62] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:13:55.927776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8a424-972c-4c1f-bcc8-3b346678b572 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:55.928478 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8a424-972c-4c1f-bcc8-3b346678b572 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:55.928478 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8a424-972c-4c1f-bcc8-3b346678b572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:55.952684 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a4e8a424-972c-4c1f-bcc8-3b346678b572 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:13:55.954227 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a4e8a424-972c-4c1f-bcc8-3b346678b572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:13:56.000950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd344d56-e5c0-4e48-841c-c09515f8c8f9 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:56.001276 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd344d56-e5c0-4e48-841c-c09515f8c8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:56.001552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd344d56-e5c0-4e48-841c-c09515f8c8f9 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:56.002897 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 32/63] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:13:56.014331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718f412-c458-4355-a42a-47506c7bc096 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:56.014619 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718f412-c458-4355-a42a-47506c7bc096 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:56.014875 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718f412-c458-4355-a42a-47506c7bc096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:56.047495 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 32/64] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:13:56.048481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-f718f412-c458-4355-a42a-47506c7bc096 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:13:56.049716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f718f412-c458-4355-a42a-47506c7bc096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:13:56.104403 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e0b0f-a529-471c-8ba1-ec15ecb68542 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:56.104711 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e0b0f-a529-471c-8ba1-ec15ecb68542 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:56.105027 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e0b0f-a529-471c-8ba1-ec15ecb68542 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:56.106768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 33/65] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:13:56.112010 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea517788-f234-4749-a6c4-e273208e47d7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:56.112551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea517788-f234-4749-a6c4-e273208e47d7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:56.113047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea517788-f234-4749-a6c4-e273208e47d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:56.129341 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:56.142921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ea517788-f234-4749-a6c4-e273208e47d7 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:13:56.144350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ea517788-f234-4749-a6c4-e273208e47d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:13:56.176277 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 33/66] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:13:56.263942 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 34/67] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:13:56.348711 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd5f65-6056-4721-906e-d95984ed19fe None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:56.348988 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd5f65-6056-4721-906e-d95984ed19fe None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:56.349287 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd5f65-6056-4721-906e-d95984ed19fe None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:56.350689 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 34/68] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:13:56.356642 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec267bdf-ef96-4624-8957-afe8fc060785 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:56.356995 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec267bdf-ef96-4624-8957-afe8fc060785 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:56.357304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec267bdf-ef96-4624-8957-afe8fc060785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:56.373238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd5f65-6056-4721-906e-d95984ed19fe None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:56.388731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ec267bdf-ef96-4624-8957-afe8fc060785 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:13:56.389943 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ec267bdf-ef96-4624-8957-afe8fc060785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:13:56.425433 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:56.506211 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 35/69] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:13:56.530533 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd5f65-6056-4721-906e-d95984ed19fe None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:56.541483 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec267bdf-ef96-4624-8957-afe8fc060785 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:56.566990 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c610e2-8532-4b44-a2a4-97060b0e2f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:56.567624 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c610e2-8532-4b44-a2a4-97060b0e2f09 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:56.567900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c610e2-8532-4b44-a2a4-97060b0e2f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:56.568169 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c610e2-8532-4b44-a2a4-97060b0e2f09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:56.581164 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c610e2-8532-4b44-a2a4-97060b0e2f09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:13:56.586949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-b2c610e2-8532-4b44-a2a4-97060b0e2f09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:13:56.586949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:13:56.586949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:13:56.586949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:13:56.586949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:13:56.586949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:13:56.586949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:13:56.586949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:13:56.586949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:13:56.586949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:13:56.586949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:13:56.586949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:13:56.586949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:13:56.586949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:13:56.586949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:13:56.586949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:13:56.587781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:13:56.587781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:13:56.587781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:13:56.587781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:13:56.587781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:13:56.587781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:13:56.587781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:13:56.587781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:13:56.587781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:13:56.587781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:13:56.587781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:13:56.587781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:13:56.587781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:13:56.587781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:13:56.587781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:13:56.587781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:13:56.588510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:13:56.588510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:13:56.588510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:13:56.588510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:13:56.588510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:13:56.588510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:13:56.588510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:13:56.588510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:13:56.588510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:13:56.588510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:13:56.588510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:13:56.588510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:13:56.588510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 35/70] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:13:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:13:56.591408 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1c207-b9f1-45b0-8d2c-07b0a5d34b18 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:56.591708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1c207-b9f1-45b0-8d2c-07b0a5d34b18 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:56.596228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1c207-b9f1-45b0-8d2c-07b0a5d34b18 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:56.596228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 36/71] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:13:56.597975 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1c207-b9f1-45b0-8d2c-07b0a5d34b18 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:56.621812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:56.660319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec267bdf-ef96-4624-8957-afe8fc060785 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:56.697536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95dc2c-8105-4d58-9e3f-258e07053441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:56.698514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95dc2c-8105-4d58-9e3f-258e07053441 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:56.699915 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95dc2c-8105-4d58-9e3f-258e07053441 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:56.700453 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95dc2c-8105-4d58-9e3f-258e07053441 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:56.700931 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:56.714604 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1c207-b9f1-45b0-8d2c-07b0a5d34b18 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:56.720171 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95dc2c-8105-4d58-9e3f-258e07053441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:13:56.726861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-9f95dc2c-8105-4d58-9e3f-258e07053441 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:13:56.726861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:13:56.726861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:13:56.726861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:13:56.726861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:13:56.726861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:13:56.726861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:13:56.726861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:13:56.726861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:13:56.726861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:13:56.726861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:13:56.726861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:13:56.726861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:13:56.726861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:13:56.726861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:13:56.726861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:13:56.727728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:13:56.727728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:13:56.727728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:13:56.727728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:13:56.727728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:13:56.727728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:13:56.727728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:13:56.727728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:13:56.727728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:13:56.727728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:13:56.727728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:13:56.727728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:13:56.727728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:13:56.727728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:13:56.727728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:13:56.727728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:13:56.728470 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:13:56.728470 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:13:56.728470 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:13:56.728470 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:13:56.728470 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:13:56.728470 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:13:56.728470 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:13:56.728470 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:13:56.728470 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:13:56.728470 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:13:56.728470 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:13:56.728470 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:13:56.728470 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 36/72] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:13:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:13:56.729422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f81cc-ed1b-487c-8874-4aa8a7ca066e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:56.730266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f81cc-ed1b-487c-8874-4aa8a7ca066e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:56.730686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f81cc-ed1b-487c-8874-4aa8a7ca066e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:56.749809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c92f81cc-ed1b-487c-8874-4aa8a7ca066e None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:13:56.750972 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c92f81cc-ed1b-487c-8874-4aa8a7ca066e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:13:56.759370 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763df89-42a3-4f7d-b017-23fe4ef534ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:56.760881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763df89-42a3-4f7d-b017-23fe4ef534ae None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:56.761507 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763df89-42a3-4f7d-b017-23fe4ef534ae None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:56.762467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763df89-42a3-4f7d-b017-23fe4ef534ae None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:56.763611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763df89-42a3-4f7d-b017-23fe4ef534ae None admin] RBAC: Adding query filter params (name=member) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:13:56.764109 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763df89-42a3-4f7d-b017-23fe4ef534ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:56.766447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763df89-42a3-4f7d-b017-23fe4ef534ae None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:56.778406 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 37/73] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:13:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:56.779931 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763df89-42a3-4f7d-b017-23fe4ef534ae None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:56.819980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 37/74] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:13:56.820833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f81cc-ed1b-487c-8874-4aa8a7ca066e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:56.880539 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:56.897249 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763df89-42a3-4f7d-b017-23fe4ef534ae None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:56.926909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f81cc-ed1b-487c-8874-4aa8a7ca066e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:56.932834 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe63d7-07dd-4964-adbf-1546622944a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:56.933546 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe63d7-07dd-4964-adbf-1546622944a4 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:56.933827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe63d7-07dd-4964-adbf-1546622944a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:56.934498 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe63d7-07dd-4964-adbf-1546622944a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:56.945601 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe63d7-07dd-4964-adbf-1546622944a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:13:56.951302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-cdbe63d7-07dd-4964-adbf-1546622944a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:13:56.951302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:13:56.951302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:13:56.951302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:13:56.951302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:13:56.951302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:13:56.951302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:13:56.951302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:13:56.951302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:13:56.951302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:13:56.951302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:13:56.951302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:13:56.951302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:13:56.951302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:13:56.951302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:13:56.951302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:13:56.952136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:13:56.952136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:13:56.952136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:13:56.952136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:13:56.952136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:13:56.952136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:13:56.952136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:13:56.952136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:13:56.952136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:13:56.952136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:13:56.952136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:13:56.952136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:13:56.952136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:13:56.952136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:13:56.952136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:13:56.952136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:13:56.952893 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:13:56.952893 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:13:56.952893 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:13:56.952893 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:13:56.952893 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:13:56.952893 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:13:56.952893 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:13:56.952893 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:13:56.952893 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:13:56.952893 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:13:56.952893 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:13:56.952893 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:13:56.952893 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 38/75] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 5 14:13:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:13:56.956589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe63d7-07dd-4964-adbf-1546622944a4 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:56.974512 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88facf96-902f-41dc-9ce1-35dc6a596da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:56.975314 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88facf96-902f-41dc-9ce1-35dc6a596da7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:56.975708 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88facf96-902f-41dc-9ce1-35dc6a596da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:56.976056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88facf96-902f-41dc-9ce1-35dc6a596da7 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:56.976597 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:56.976836 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88facf96-902f-41dc-9ce1-35dc6a596da7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:13:56.977261 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88facf96-902f-41dc-9ce1-35dc6a596da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:56.978752 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88facf96-902f-41dc-9ce1-35dc6a596da7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:56.988871 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 38/76] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:13:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:56.990232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88facf96-902f-41dc-9ce1-35dc6a596da7 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:57.075422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe63d7-07dd-4964-adbf-1546622944a4 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:57.096400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88facf96-902f-41dc-9ce1-35dc6a596da7 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:57.111389 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37c6d8-8d2d-4245-a1fd-33851196c55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:57.112025 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37c6d8-8d2d-4245-a1fd-33851196c55d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:57.112305 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37c6d8-8d2d-4245-a1fd-33851196c55d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:57.112580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37c6d8-8d2d-4245-a1fd-33851196c55d None admin] PATH_INFO: `/v3/users/93259f28708c46c3b1101160a1a44db1` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:57.114073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:57.126439 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37c6d8-8d2d-4245-a1fd-33851196c55d None admin] RBAC: Authorizing `identity:get_user(user_id=93259f28708c46c3b1101160a1a44db1)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:57.127902 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37c6d8-8d2d-4245-a1fd-33851196c55d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:57.129543 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 39/77] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:13:56 2022] GET /identity/v3/users/93259f28708c46c3b1101160a1a44db1 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:57.134575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37c6d8-8d2d-4245-a1fd-33851196c55d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:57.134685 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805f178-8301-40ef-b502-f531cd810df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:57.134685 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805f178-8301-40ef-b502-f531cd810df4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:57.134685 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805f178-8301-40ef-b502-f531cd810df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:57.134685 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805f178-8301-40ef-b502-f531cd810df4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:57.142686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805f178-8301-40ef-b502-f531cd810df4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:13:57.147589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-3805f178-8301-40ef-b502-f531cd810df4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:13:57.147589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:13:57.147589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:13:57.147589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:13:57.147589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:13:57.147589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:13:57.147589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:13:57.147589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:13:57.147589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:13:57.147589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:13:57.147589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:13:57.147589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:13:57.147589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:13:57.147589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:13:57.147589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:13:57.147589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:13:57.148410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:13:57.148410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:13:57.148410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:13:57.148410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:13:57.148410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:13:57.148410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:13:57.148410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:13:57.148410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:13:57.148410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:13:57.148410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:13:57.148410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:13:57.148410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:13:57.148410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:13:57.148410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:13:57.148410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:13:57.148410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:13:57.149563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:13:57.149563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:13:57.149563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:13:57.149563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:13:57.149563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:13:57.149563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:13:57.149563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:13:57.149563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:13:57.149563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:13:57.149563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:13:57.149563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:13:57.149563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:13:57.149563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 39/78] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:13:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:13:57.153960 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805f178-8301-40ef-b502-f531cd810df4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:57.201160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:57.229455 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37c6d8-8d2d-4245-a1fd-33851196c55d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:57.257508 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805f178-8301-40ef-b502-f531cd810df4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:57.264762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2401a6-2490-45c3-8a20-f7c260461505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:57.265415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2401a6-2490-45c3-8a20-f7c260461505 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:57.265698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2401a6-2490-45c3-8a20-f7c260461505 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:57.265974 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2401a6-2490-45c3-8a20-f7c260461505 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:57.266635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2401a6-2490-45c3-8a20-f7c260461505 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:13:57.266951 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2401a6-2490-45c3-8a20-f7c260461505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:57.268383 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2401a6-2490-45c3-8a20-f7c260461505 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:57.276237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 40/79] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:13:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:57.282266 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2401a6-2490-45c3-8a20-f7c260461505 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:57.291800 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c834dbd-12c0-435a-af41-b5170607547a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:57.292484 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c834dbd-12c0-435a-af41-b5170607547a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:57.292974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c834dbd-12c0-435a-af41-b5170607547a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:57.293520 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c834dbd-12c0-435a-af41-b5170607547a None admin] PATH_INFO: `/v3/users/7609e1a1df8f4af7ad4a5bc5e3426829` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:57.294685 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c834dbd-12c0-435a-af41-b5170607547a None admin] RBAC: Authorizing `identity:get_user(user_id=7609e1a1df8f4af7ad4a5bc5e3426829)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:57.296113 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c834dbd-12c0-435a-af41-b5170607547a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:57.297719 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 40/80] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:13:57 2022] GET /identity/v3/users/7609e1a1df8f4af7ad4a5bc5e3426829 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:57.298479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c834dbd-12c0-435a-af41-b5170607547a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:57.344513 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:57.381077 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2401a6-2490-45c3-8a20-f7c260461505 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:57.396637 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c834dbd-12c0-435a-af41-b5170607547a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:57.417769 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924ab66-516a-4a85-b4cb-61fff8898c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:57.418801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924ab66-516a-4a85-b4cb-61fff8898c6e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:57.419199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924ab66-516a-4a85-b4cb-61fff8898c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:57.419479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924ab66-516a-4a85-b4cb-61fff8898c6e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:57.420645 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924ab66-516a-4a85-b4cb-61fff8898c6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:57.422163 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924ab66-516a-4a85-b4cb-61fff8898c6e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:57.423736 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 41/81] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:13:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:57.426226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924ab66-516a-4a85-b4cb-61fff8898c6e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:57.428979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:57.437269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33d3c5-5047-49a1-83c4-8b0ed75fb79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:57.437879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33d3c5-5047-49a1-83c4-8b0ed75fb79b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:57.443559 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33d3c5-5047-49a1-83c4-8b0ed75fb79b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:57.443559 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33d3c5-5047-49a1-83c4-8b0ed75fb79b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:57.506823 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33d3c5-5047-49a1-83c4-8b0ed75fb79b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:57.508304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33d3c5-5047-49a1-83c4-8b0ed75fb79b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:57.531648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924ab66-516a-4a85-b4cb-61fff8898c6e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:57.554927 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:57.567595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718d7bc-c8a6-441e-bd4d-10ade8c5ba8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:57.568391 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718d7bc-c8a6-441e-bd4d-10ade8c5ba8d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:57.568677 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718d7bc-c8a6-441e-bd4d-10ade8c5ba8d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:57.569181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718d7bc-c8a6-441e-bd4d-10ade8c5ba8d None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:57.569706 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718d7bc-c8a6-441e-bd4d-10ade8c5ba8d None admin] RBAC: Adding query filter params (name=member) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:13:57.570014 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718d7bc-c8a6-441e-bd4d-10ade8c5ba8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:57.571418 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718d7bc-c8a6-441e-bd4d-10ade8c5ba8d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:57.579340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 42/82] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:13:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:57.580162 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718d7bc-c8a6-441e-bd4d-10ade8c5ba8d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:57.608452 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 41/83] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:13:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:13:57.609254 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33d3c5-5047-49a1-83c4-8b0ed75fb79b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:57.646937 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:57.685021 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718d7bc-c8a6-441e-bd4d-10ade8c5ba8d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:57.705164 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33d3c5-5047-49a1-83c4-8b0ed75fb79b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:57.718655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b4ba8-5900-43ad-b8f4-2eeb662420dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:57.719281 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b4ba8-5900-43ad-b8f4-2eeb662420dc None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:57.719563 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b4ba8-5900-43ad-b8f4-2eeb662420dc None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:57.719837 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b4ba8-5900-43ad-b8f4-2eeb662420dc None admin] PATH_INFO: `/v3/users/93259f28708c46c3b1101160a1a44db1` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:57.720962 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b4ba8-5900-43ad-b8f4-2eeb662420dc None admin] RBAC: Authorizing `identity:get_user(user_id=93259f28708c46c3b1101160a1a44db1)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:57.722444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b4ba8-5900-43ad-b8f4-2eeb662420dc None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:57.724010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 43/84] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:13:57 2022] GET /identity/v3/users/93259f28708c46c3b1101160a1a44db1 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:57.724755 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b4ba8-5900-43ad-b8f4-2eeb662420dc None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:57.742722 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5781728-7ac9-4268-98e9-60104934428f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:57.743417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5781728-7ac9-4268-98e9-60104934428f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:57.743718 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5781728-7ac9-4268-98e9-60104934428f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:57.743988 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5781728-7ac9-4268-98e9-60104934428f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:57.759556 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:57.819184 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5781728-7ac9-4268-98e9-60104934428f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:57.820701 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5781728-7ac9-4268-98e9-60104934428f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:57.827016 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b4ba8-5900-43ad-b8f4-2eeb662420dc None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:57.856078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:57.860972 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c1423-0171-4c35-a218-843d9fef81a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:57.861540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c1423-0171-4c35-a218-843d9fef81a4 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:57.861816 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c1423-0171-4c35-a218-843d9fef81a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:57.862088 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c1423-0171-4c35-a218-843d9fef81a4 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:57.862754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c1423-0171-4c35-a218-843d9fef81a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:57.864171 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c1423-0171-4c35-a218-843d9fef81a4 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:57.918611 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 42/85] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:13:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:13:57.924146 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5781728-7ac9-4268-98e9-60104934428f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:57.944390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 44/86] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 5 14:13:57 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:13:57.945297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c1423-0171-4c35-a218-843d9fef81a4 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:57.974431 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:58.044465 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5781728-7ac9-4268-98e9-60104934428f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:58.076297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c1423-0171-4c35-a218-843d9fef81a4 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:58.085075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe7194-ae6e-458d-ba2a-1d0630f5678f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:58.085730 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe7194-ae6e-458d-ba2a-1d0630f5678f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:58.086786 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe7194-ae6e-458d-ba2a-1d0630f5678f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:58.086786 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe7194-ae6e-458d-ba2a-1d0630f5678f None admin] PATH_INFO: `/v3/users/93259f28708c46c3b1101160a1a44db1` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:58.087465 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe7194-ae6e-458d-ba2a-1d0630f5678f None admin] RBAC: Authorizing `identity:get_user(user_id=93259f28708c46c3b1101160a1a44db1)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:58.088921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe7194-ae6e-458d-ba2a-1d0630f5678f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:58.095408 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 43/87] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:13:57 2022] GET /identity/v3/users/93259f28708c46c3b1101160a1a44db1 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:58.095408 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe7194-ae6e-458d-ba2a-1d0630f5678f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:58.123003 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcbc6c-4c14-4eab-a777-1828c17c2d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:58.123577 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcbc6c-4c14-4eab-a777-1828c17c2d42 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:58.123859 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcbc6c-4c14-4eab-a777-1828c17c2d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:58.124132 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcbc6c-4c14-4eab-a777-1828c17c2d42 None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:58.125819 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcbc6c-4c14-4eab-a777-1828c17c2d42 None admin] RBAC: Authorizing `identity:get_project(project_id=3d25847b7b534c73bfb985bc2a1852cc)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:58.127302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcbc6c-4c14-4eab-a777-1828c17c2d42 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:58.128959 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 45/88] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:13:57 2022] GET /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:58.131549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcbc6c-4c14-4eab-a777-1828c17c2d42 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:58.197281 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:58.230743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe7194-ae6e-458d-ba2a-1d0630f5678f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:58.249983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:58.261169 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcbc6c-4c14-4eab-a777-1828c17c2d42 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:58.275097 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3982b18-a892-4d71-90a9-bd09b6ebe425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:58.275968 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3982b18-a892-4d71-90a9-bd09b6ebe425 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:58.276253 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3982b18-a892-4d71-90a9-bd09b6ebe425 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:58.277581 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3982b18-a892-4d71-90a9-bd09b6ebe425 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:58.304960 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd9c46-9eb5-4d4b-a27b-9bcb385aee43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:58.305898 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd9c46-9eb5-4d4b-a27b-9bcb385aee43 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:58.306326 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd9c46-9eb5-4d4b-a27b-9bcb385aee43 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:58.306747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd9c46-9eb5-4d4b-a27b-9bcb385aee43 None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:58.308566 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd9c46-9eb5-4d4b-a27b-9bcb385aee43 None admin] RBAC: Authorizing `identity:get_project(project_id=3d25847b7b534c73bfb985bc2a1852cc)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:58.310397 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd9c46-9eb5-4d4b-a27b-9bcb385aee43 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:58.312218 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 46/89] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:13:58 2022] GET /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:58.312828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd9c46-9eb5-4d4b-a27b-9bcb385aee43 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:58.379060 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3982b18-a892-4d71-90a9-bd09b6ebe425 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:58.380973 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3982b18-a892-4d71-90a9-bd09b6ebe425 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:58.423214 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd9c46-9eb5-4d4b-a27b-9bcb385aee43 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:58.449636 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:58.461981 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085c80a-0b04-48b6-8675-d8d59da73afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:58.462907 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085c80a-0b04-48b6-8675-d8d59da73afc None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:58.463356 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085c80a-0b04-48b6-8675-d8d59da73afc None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:58.463656 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085c80a-0b04-48b6-8675-d8d59da73afc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:58.549992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 44/90] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:13:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:13:58.555584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3982b18-a892-4d71-90a9-bd09b6ebe425 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:58.556637 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085c80a-0b04-48b6-8675-d8d59da73afc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:58.558887 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085c80a-0b04-48b6-8675-d8d59da73afc None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:58.571957 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:58.672048 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3982b18-a892-4d71-90a9-bd09b6ebe425 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:58.688675 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 47/91] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:13:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:13:58.689976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085c80a-0b04-48b6-8675-d8d59da73afc None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:58.713980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79dfc85-8ebc-42a1-bf72-c5d23cbb7aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:58.714745 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dfc85-8ebc-42a1-bf72-c5d23cbb7aec None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:58.715051 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dfc85-8ebc-42a1-bf72-c5d23cbb7aec None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:58.715396 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dfc85-8ebc-42a1-bf72-c5d23cbb7aec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:58.716188 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79dfc85-8ebc-42a1-bf72-c5d23cbb7aec None admin] RBAC: Adding query filter params (role.id=d818d9cd93494e0b8e7b6d6539bc808d, scope.project.id=3d25847b7b534c73bfb985bc2a1852cc, user.id=93259f28708c46c3b1101160a1a44db1) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:13:58.716565 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79dfc85-8ebc-42a1-bf72-c5d23cbb7aec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:58.718315 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79dfc85-8ebc-42a1-bf72-c5d23cbb7aec None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:58.722030 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:58.727308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 45/92] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:13:58 2022] GET /identity/v3/role_assignments?user.id=93259f28708c46c3b1101160a1a44db1&scope.project.id=3d25847b7b534c73bfb985bc2a1852cc&role.id=d818d9cd93494e0b8e7b6d6539bc808d => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:58.728297 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79dfc85-8ebc-42a1-bf72-c5d23cbb7aec None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:58.891693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:58.894126 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085c80a-0b04-48b6-8675-d8d59da73afc None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:58.936307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79dfc85-8ebc-42a1-bf72-c5d23cbb7aec None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:58.962897 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93544b-6b5e-4e36-8d74-5ffed5c985c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:58.964175 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93544b-6b5e-4e36-8d74-5ffed5c985c8 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:58.966312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93544b-6b5e-4e36-8d74-5ffed5c985c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:58.966769 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93544b-6b5e-4e36-8d74-5ffed5c985c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:58.967673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93544b-6b5e-4e36-8d74-5ffed5c985c8 None admin] RBAC: Adding query filter params (role.id=f22e6e660eab44c5be25e3dee1e3042c, scope.project.id=3d25847b7b534c73bfb985bc2a1852cc, user.id=7609e1a1df8f4af7ad4a5bc5e3426829) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:13:58.969032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93544b-6b5e-4e36-8d74-5ffed5c985c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:58.972149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93544b-6b5e-4e36-8d74-5ffed5c985c8 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:58.984440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 48/93] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:13:58 2022] GET /identity/v3/role_assignments?user.id=7609e1a1df8f4af7ad4a5bc5e3426829&scope.project.id=3d25847b7b534c73bfb985bc2a1852cc&role.id=f22e6e660eab44c5be25e3dee1e3042c => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:58.986469 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93544b-6b5e-4e36-8d74-5ffed5c985c8 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:59.009108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795fd07-eaf3-43a2-9988-22dcb2aad38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:59.010419 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795fd07-eaf3-43a2-9988-22dcb2aad38a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:59.011195 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795fd07-eaf3-43a2-9988-22dcb2aad38a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:59.012436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795fd07-eaf3-43a2-9988-22dcb2aad38a None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:59.014735 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795fd07-eaf3-43a2-9988-22dcb2aad38a None admin] RBAC: Authorizing `identity:get_project(project_id=3d25847b7b534c73bfb985bc2a1852cc)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:59.017178 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795fd07-eaf3-43a2-9988-22dcb2aad38a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:59.020946 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 46/94] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:13:58 2022] GET /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:59.027687 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795fd07-eaf3-43a2-9988-22dcb2aad38a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:59.150520 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:13:59.189326 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93544b-6b5e-4e36-8d74-5ffed5c985c8 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:59.278786 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795fd07-eaf3-43a2-9988-22dcb2aad38a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:59.280772 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f3416-9842-4555-bed1-41fe523aba44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:59.281449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f3416-9842-4555-bed1-41fe523aba44 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:59.281733 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f3416-9842-4555-bed1-41fe523aba44 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:59.282011 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f3416-9842-4555-bed1-41fe523aba44 None admin] PATH_INFO: `/v3/projects/3b3e5b21b51d46b7b919b2692877fcf0` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:59.283343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f3416-9842-4555-bed1-41fe523aba44 None admin] RBAC: Authorizing `identity:get_project(project_id=3b3e5b21b51d46b7b919b2692877fcf0)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:59.284826 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f3416-9842-4555-bed1-41fe523aba44 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:59.287864 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 49/95] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:13:58 2022] GET /identity/v3/projects/3b3e5b21b51d46b7b919b2692877fcf0 => generated 312 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:59.298584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f3416-9842-4555-bed1-41fe523aba44 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:13:59.393791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37db07e-ce4e-4834-9452-1a64c7264ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:59.394432 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37db07e-ce4e-4834-9452-1a64c7264ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:59.394723 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37db07e-ce4e-4834-9452-1a64c7264ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:59.395004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37db07e-ce4e-4834-9452-1a64c7264ca5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:59.395752 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37db07e-ce4e-4834-9452-1a64c7264ca5 None admin] RBAC: Adding query filter params (role.id=a1ffbcf6f60f4aea99c7eb1dbcb34582, scope.project.id=3d25847b7b534c73bfb985bc2a1852cc, user.id=93259f28708c46c3b1101160a1a44db1) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:13:59.396070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37db07e-ce4e-4834-9452-1a64c7264ca5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:59.397667 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37db07e-ce4e-4834-9452-1a64c7264ca5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:59.419825 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 47/96] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:13:59 2022] GET /identity/v3/role_assignments?user.id=93259f28708c46c3b1101160a1a44db1&scope.project.id=3d25847b7b534c73bfb985bc2a1852cc&role.id=a1ffbcf6f60f4aea99c7eb1dbcb34582 => generated 259 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:13:59.449470 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f3416-9842-4555-bed1-41fe523aba44 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:13:59.506880 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c4b12-d7b3-4e0d-8f76-4e89142c74d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:13:59.507526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c4b12-d7b3-4e0d-8f76-4e89142c74d4 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:13:59.507814 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c4b12-d7b3-4e0d-8f76-4e89142c74d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:13:59.508093 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c4b12-d7b3-4e0d-8f76-4e89142c74d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:13:59.508858 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c4b12-d7b3-4e0d-8f76-4e89142c74d4 None admin] RBAC: Adding query filter params (role.id=d818d9cd93494e0b8e7b6d6539bc808d, scope.project.id=3b3e5b21b51d46b7b919b2692877fcf0, user.id=93259f28708c46c3b1101160a1a44db1) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:13:59.509211 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c4b12-d7b3-4e0d-8f76-4e89142c74d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:13:59.510772 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c4b12-d7b3-4e0d-8f76-4e89142c74d4 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:13:59.517346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 50/97] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:13:59 2022] GET /identity/v3/role_assignments?user.id=93259f28708c46c3b1101160a1a44db1&scope.project.id=3b3e5b21b51d46b7b919b2692877fcf0&role.id=d818d9cd93494e0b8e7b6d6539bc808d => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:00.463088 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6bd19-aa29-4e64-bfe1-4f9cf67a3592 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:00.463585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6bd19-aa29-4e64-bfe1-4f9cf67a3592 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:00.463658 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6bd19-aa29-4e64-bfe1-4f9cf67a3592 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:00.465538 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 48/98] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:00.471164 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5e1d2-3526-446e-8a25-185e3a73bb34 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:00.471593 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5e1d2-3526-446e-8a25-185e3a73bb34 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:00.471896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5e1d2-3526-446e-8a25-185e3a73bb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:00.497420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114850c2-db03-4485-8375-d480862b56bc None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:00.497714 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114850c2-db03-4485-8375-d480862b56bc None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:00.497996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114850c2-db03-4485-8375-d480862b56bc None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:00.499326 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 49/99] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:14:00.500581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c0f5e1d2-3526-446e-8a25-185e3a73bb34 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:00.501829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c0f5e1d2-3526-446e-8a25-185e3a73bb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:00.504777 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaa59f-a247-413f-b489-40f032a3465c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:00.505084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaa59f-a247-413f-b489-40f032a3465c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:00.505366 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaa59f-a247-413f-b489-40f032a3465c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:00.530999 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-46eaa59f-a247-413f-b489-40f032a3465c None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:00.532209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-46eaa59f-a247-413f-b489-40f032a3465c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:00.539504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:00.540247 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:00.643740 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 51/100] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:00.651271 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 50/101] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:14:01.066200 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5e1d2-3526-446e-8a25-185e3a73bb34 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:01.241968 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eaa59f-a247-413f-b489-40f032a3465c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:01.263174 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5e1d2-3526-446e-8a25-185e3a73bb34 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:01.371728 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd610b-4ef9-4ddb-b1c5-9a695dc97184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:01.372341 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd610b-4ef9-4ddb-b1c5-9a695dc97184 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:01.372671 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd610b-4ef9-4ddb-b1c5-9a695dc97184 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:01.372949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd610b-4ef9-4ddb-b1c5-9a695dc97184 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:01.418000 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd610b-4ef9-4ddb-b1c5-9a695dc97184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:01.428034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-f5dd610b-4ef9-4ddb-b1c5-9a695dc97184 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 14:14:01.428034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:01.428034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:01.428034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:01.428034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:01.428034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:01.428034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:01.428034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:01.428034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:01.428034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:01.428034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:01.428034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:01.428034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:01.428034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:01.428034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:01.428034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:01.428942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:01.428942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:01.428942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:01.428942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:01.428942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:01.428942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:01.428942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:01.428942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:01.428942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:01.428942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:01.428942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:01.428942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:01.428942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:01.428942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:01.428942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:01.428942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:01.429729 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:01.429729 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:01.429729 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:01.429729 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:01.429729 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:01.429729 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:01.429729 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:01.429729 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:01.429729 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:01.429729 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:01.429729 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 14:14:01.429729 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:01.429729 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 52/102] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:01.436166 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd610b-4ef9-4ddb-b1c5-9a695dc97184 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:01.473102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:01.502563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eaa59f-a247-413f-b489-40f032a3465c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:01.566728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b25f57-d42f-404d-8039-4f7fbb48ccab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:01.568774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b25f57-d42f-404d-8039-4f7fbb48ccab None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:01.568774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b25f57-d42f-404d-8039-4f7fbb48ccab None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:01.568774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b25f57-d42f-404d-8039-4f7fbb48ccab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:01.569665 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b25f57-d42f-404d-8039-4f7fbb48ccab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:01.571504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b25f57-d42f-404d-8039-4f7fbb48ccab None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:01.572362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 51/103] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:14:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:01.578452 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b25f57-d42f-404d-8039-4f7fbb48ccab None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:01.601546 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:01.726693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b25f57-d42f-404d-8039-4f7fbb48ccab None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:01.762390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd610b-4ef9-4ddb-b1c5-9a695dc97184 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:01.769280 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bbe66-f38e-45a7-8b4b-9484cfcbd7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:01.769972 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bbe66-f38e-45a7-8b4b-9484cfcbd7c0 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:01.770260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bbe66-f38e-45a7-8b4b-9484cfcbd7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:01.771901 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bbe66-f38e-45a7-8b4b-9484cfcbd7c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:01.771901 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bbe66-f38e-45a7-8b4b-9484cfcbd7c0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:01.772856 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bbe66-f38e-45a7-8b4b-9484cfcbd7c0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:01.822522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b28675-0013-40e2-ad27-6a98e3af3f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:01.823153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b28675-0013-40e2-ad27-6a98e3af3f75 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:01.823486 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b28675-0013-40e2-ad27-6a98e3af3f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:01.823833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b28675-0013-40e2-ad27-6a98e3af3f75 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:01.824513 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b28675-0013-40e2-ad27-6a98e3af3f75 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:01.824817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b28675-0013-40e2-ad27-6a98e3af3f75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:01.827515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b28675-0013-40e2-ad27-6a98e3af3f75 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:01.837366 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 53/104] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:01.838624 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2906f94-5ed3-4667-975e-345e01466ae7 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:01.839029 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2906f94-5ed3-4667-975e-345e01466ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:01.839889 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2906f94-5ed3-4667-975e-345e01466ae7 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:01.841560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 54/105] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:01.846962 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50449425-339b-4450-9a84-0a188b026543 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:01.847250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50449425-339b-4450-9a84-0a188b026543 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:01.847532 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50449425-339b-4450-9a84-0a188b026543 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:01.848891 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 55/106] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:01.851020 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50449425-339b-4450-9a84-0a188b026543 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:01.888695 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 52/107] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 5 14:14:01 2022] POST /identity/v3/projects => generated 302 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:14:01.890715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ab232-839d-4dcf-83e7-41341d50b54a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:01.891057 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ab232-839d-4dcf-83e7-41341d50b54a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:01.891341 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ab232-839d-4dcf-83e7-41341d50b54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:01.930214 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-447ab232-839d-4dcf-83e7-41341d50b54a None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:01.931486 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-447ab232-839d-4dcf-83e7-41341d50b54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:01.971889 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:02.036848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:02.038985 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50449425-339b-4450-9a84-0a188b026543 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:02.051510 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 53/108] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:02.052854 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eda096-2ee7-4a8c-a23c-aac55e821c97 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:02.053182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eda096-2ee7-4a8c-a23c-aac55e821c97 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:02.054084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eda096-2ee7-4a8c-a23c-aac55e821c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:02.077377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e5eda096-2ee7-4a8c-a23c-aac55e821c97 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:02.078654 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e5eda096-2ee7-4a8c-a23c-aac55e821c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:02.113387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a654b1f-35de-4194-b081-9d84747fe1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:02.114201 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a654b1f-35de-4194-b081-9d84747fe1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:02.114588 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a654b1f-35de-4194-b081-9d84747fe1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:02.114905 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a654b1f-35de-4194-b081-9d84747fe1d8 None admin] PATH_INFO: `/v3/users/5ab2c3ccd994410b9b324438a050f121` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:02.141224 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a654b1f-35de-4194-b081-9d84747fe1d8 None admin] RBAC: Authorizing `identity:get_user(user_id=5ab2c3ccd994410b9b324438a050f121)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:02.142723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a654b1f-35de-4194-b081-9d84747fe1d8 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:02.144696 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 56/109] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:01 2022] GET /identity/v3/users/5ab2c3ccd994410b9b324438a050f121 => generated 289 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:02.154060 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a654b1f-35de-4194-b081-9d84747fe1d8 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:02.168019 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 54/110] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:02.319738 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a654b1f-35de-4194-b081-9d84747fe1d8 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:02.358137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:02.364300 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b76e8d-af90-489c-a2ed-869764af9d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:02.365034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b76e8d-af90-489c-a2ed-869764af9d6d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:02.365353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b76e8d-af90-489c-a2ed-869764af9d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:02.365630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b76e8d-af90-489c-a2ed-869764af9d6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:02.409349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eda096-2ee7-4a8c-a23c-aac55e821c97 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:02.457493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b76e8d-af90-489c-a2ed-869764af9d6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:02.458987 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b76e8d-af90-489c-a2ed-869764af9d6d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:02.563743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eda096-2ee7-4a8c-a23c-aac55e821c97 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:02.577580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 57/111] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 14:14:02.578833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5ffb9-c23a-4529-9549-f43ac5a7c406 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:02.579123 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5ffb9-c23a-4529-9549-f43ac5a7c406 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:02.579402 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5ffb9-c23a-4529-9549-f43ac5a7c406 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:02.581159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 58/112] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:02.581947 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5ffb9-c23a-4529-9549-f43ac5a7c406 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:02.588325 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:02.603541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4299139-2cc1-45f9-a077-bdc24ea50099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:02.604182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4299139-2cc1-45f9-a077-bdc24ea50099 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:02.604462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4299139-2cc1-45f9-a077-bdc24ea50099 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:02.604735 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4299139-2cc1-45f9-a077-bdc24ea50099 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:02.615343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:02.615582 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4299139-2cc1-45f9-a077-bdc24ea50099 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:02.621820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-b4299139-2cc1-45f9-a077-bdc24ea50099 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:02.621820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:02.621820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:02.621820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:02.621820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:02.621820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:02.621820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:02.621820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:02.621820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:02.621820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:02.621820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:02.621820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:02.621820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:02.621820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:02.621820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:02.621820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:02.624311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:02.624311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:02.624311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:02.624311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:02.624311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:02.624311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:02.624311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:02.624311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:02.624311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:02.624311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:02.624311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:02.624311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:02.624311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:02.624311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:02.624311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:02.624311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:02.626266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:02.626266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:02.626266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:02.626266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:02.626266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:02.626266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:02.626266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:02.626266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:02.626266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:02.626266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:02.626266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:02.626266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:02.626266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 55/113] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:14:02.626266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33506c58-f87d-4e37-a31d-6fbc78d672e3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:02.627952 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33506c58-f87d-4e37-a31d-6fbc78d672e3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:02.627952 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33506c58-f87d-4e37-a31d-6fbc78d672e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:02.644518 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-33506c58-f87d-4e37-a31d-6fbc78d672e3 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:02.645732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-33506c58-f87d-4e37-a31d-6fbc78d672e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:02.697651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5ffb9-c23a-4529-9549-f43ac5a7c406 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:02.719952 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 56/114] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:02.720819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33506c58-f87d-4e37-a31d-6fbc78d672e3 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:02.742000 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced7b90-9623-4fb1-9d68-9237f22175c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:02.743027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced7b90-9623-4fb1-9d68-9237f22175c7 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:02.743512 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced7b90-9623-4fb1-9d68-9237f22175c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:02.744588 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced7b90-9623-4fb1-9d68-9237f22175c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:02.761351 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced7b90-9623-4fb1-9d68-9237f22175c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:02.767830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-7ced7b90-9623-4fb1-9d68-9237f22175c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:14:02.767830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:02.767830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:02.767830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:02.767830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:02.767830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:02.767830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:02.767830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:02.767830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:02.767830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:02.767830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:02.767830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:02.767830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:02.767830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:02.767830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:02.767830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:02.768732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:02.768732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:02.768732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:02.768732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:02.768732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:02.768732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:02.768732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:02.768732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:02.768732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:02.768732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:02.768732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:02.768732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:02.768732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:02.768732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:02.768732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:02.768732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:02.769534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:02.769534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:02.769534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:02.769534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:02.769534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:02.769534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:02.769534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:02.769534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:02.769534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:02.769534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:02.769534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:14:02.769534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:02.770885 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 59/115] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:14:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:02.773900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced7b90-9623-4fb1-9d68-9237f22175c7 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:02.848990 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33506c58-f87d-4e37-a31d-6fbc78d672e3 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:02.864659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:02.902014 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed5ba9-dcd7-4bd1-b7a5-7372327d8b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:02.902507 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed5ba9-dcd7-4bd1-b7a5-7372327d8b18 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:02.902787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed5ba9-dcd7-4bd1-b7a5-7372327d8b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:02.903108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed5ba9-dcd7-4bd1-b7a5-7372327d8b18 None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:02.904171 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:02.905438 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed5ba9-dcd7-4bd1-b7a5-7372327d8b18 None admin] RBAC: Authorizing `identity:get_project(project_id=3d25847b7b534c73bfb985bc2a1852cc)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:02.907570 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed5ba9-dcd7-4bd1-b7a5-7372327d8b18 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:02.910379 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 57/116] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:02 2022] GET /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:02.911911 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa84886-47fc-49e3-8add-2b80db35de1f None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:02.912201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa84886-47fc-49e3-8add-2b80db35de1f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:02.912476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa84886-47fc-49e3-8add-2b80db35de1f None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:02.914408 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 58/117] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:02.915291 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa84886-47fc-49e3-8add-2b80db35de1f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:02.917248 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced7b90-9623-4fb1-9d68-9237f22175c7 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:02.963629 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5cfa8-52e4-477f-8769-978839c4b5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:02.964726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5cfa8-52e4-477f-8769-978839c4b5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:02.965369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5cfa8-52e4-477f-8769-978839c4b5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:02.966381 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5cfa8-52e4-477f-8769-978839c4b5b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:02.967274 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5cfa8-52e4-477f-8769-978839c4b5b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:02.967768 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5cfa8-52e4-477f-8769-978839c4b5b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:02.970253 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5cfa8-52e4-477f-8769-978839c4b5b6 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:02.982099 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 60/118] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:02.983882 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e24da-69a4-4a72-bb8a-cff1558fc0fb None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:02.984607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e24da-69a4-4a72-bb8a-cff1558fc0fb None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:02.985346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e24da-69a4-4a72-bb8a-cff1558fc0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:03.007310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-2b2e24da-69a4-4a72-bb8a-cff1558fc0fb None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:03.008511 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2b2e24da-69a4-4a72-bb8a-cff1558fc0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:03.038641 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa84886-47fc-49e3-8add-2b80db35de1f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:03.075514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0813b5-11e2-4f8f-a2a3-b7905ace2087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:03.076176 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0813b5-11e2-4f8f-a2a3-b7905ace2087 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:03.076457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0813b5-11e2-4f8f-a2a3-b7905ace2087 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:03.076728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0813b5-11e2-4f8f-a2a3-b7905ace2087 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:03.077443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0813b5-11e2-4f8f-a2a3-b7905ace2087 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:03.077745 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0813b5-11e2-4f8f-a2a3-b7905ace2087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:03.079139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0813b5-11e2-4f8f-a2a3-b7905ace2087 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:03.079903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 61/119] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:03.081109 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e24da-69a4-4a72-bb8a-cff1558fc0fb None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:03.087548 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 59/120] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:03.088187 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0813b5-11e2-4f8f-a2a3-b7905ace2087 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:03.155912 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:03.205461 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:03.238530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e24da-69a4-4a72-bb8a-cff1558fc0fb None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:03.239636 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0813b5-11e2-4f8f-a2a3-b7905ace2087 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:03.281969 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78609786-f8d0-4a47-b88a-febc78eb6791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:03.282938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78609786-f8d0-4a47-b88a-febc78eb6791 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:03.283422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78609786-f8d0-4a47-b88a-febc78eb6791 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:03.283886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c14974-34ef-49d5-9e27-e693a386e7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:03.284205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78609786-f8d0-4a47-b88a-febc78eb6791 None admin] PATH_INFO: `/v3/users/93259f28708c46c3b1101160a1a44db1` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:03.284497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c14974-34ef-49d5-9e27-e693a386e7ae None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:03.284774 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c14974-34ef-49d5-9e27-e693a386e7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:03.285045 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c14974-34ef-49d5-9e27-e693a386e7ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:03.285905 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c14974-34ef-49d5-9e27-e693a386e7ae None admin] RBAC: Adding query filter params (role.id=35ba371f3216414e950ba78ba9587bed, scope.project.id=3d25847b7b534c73bfb985bc2a1852cc, user.id=5ab2c3ccd994410b9b324438a050f121) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:03.286215 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c14974-34ef-49d5-9e27-e693a386e7ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:03.286611 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78609786-f8d0-4a47-b88a-febc78eb6791 None admin] RBAC: Authorizing `identity:get_user(user_id=93259f28708c46c3b1101160a1a44db1)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:03.287734 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c14974-34ef-49d5-9e27-e693a386e7ae None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:03.288473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78609786-f8d0-4a47-b88a-febc78eb6791 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:03.291101 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 60/121] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:03 2022] GET /identity/v3/users/93259f28708c46c3b1101160a1a44db1 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:03.292490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78609786-f8d0-4a47-b88a-febc78eb6791 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:03.297096 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 62/122] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:14:03 2022] GET /identity/v3/role_assignments?user.id=5ab2c3ccd994410b9b324438a050f121&scope.project.id=3d25847b7b534c73bfb985bc2a1852cc&role.id=35ba371f3216414e950ba78ba9587bed => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:03.297096 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c14974-34ef-49d5-9e27-e693a386e7ae None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:03.433855 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c14974-34ef-49d5-9e27-e693a386e7ae None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:03.448917 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78609786-f8d0-4a47-b88a-febc78eb6791 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:03.460044 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:03.488478 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f53b14-4a74-4cf7-a90c-00d5a801c8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:03.489320 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f53b14-4a74-4cf7-a90c-00d5a801c8b7 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:03.489700 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f53b14-4a74-4cf7-a90c-00d5a801c8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:03.490093 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f53b14-4a74-4cf7-a90c-00d5a801c8b7 None admin] PATH_INFO: `/v3/users/7609e1a1df8f4af7ad4a5bc5e3426829` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:03.491431 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f53b14-4a74-4cf7-a90c-00d5a801c8b7 None admin] RBAC: Authorizing `identity:get_user(user_id=7609e1a1df8f4af7ad4a5bc5e3426829)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:03.493308 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f53b14-4a74-4cf7-a90c-00d5a801c8b7 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:03.496936 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 63/123] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:03 2022] GET /identity/v3/users/7609e1a1df8f4af7ad4a5bc5e3426829 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:03.496936 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f53b14-4a74-4cf7-a90c-00d5a801c8b7 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:03.510978 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c143d0-2c5c-4897-a87c-5aec2ea51267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:03.512207 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c143d0-2c5c-4897-a87c-5aec2ea51267 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:03.512504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c143d0-2c5c-4897-a87c-5aec2ea51267 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:03.512787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c143d0-2c5c-4897-a87c-5aec2ea51267 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:03.515250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:03.529304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c143d0-2c5c-4897-a87c-5aec2ea51267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:03.536983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-c9c143d0-2c5c-4897-a87c-5aec2ea51267 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:03.536983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:03.536983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:03.536983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:03.536983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:03.536983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:03.536983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:03.536983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:03.536983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:03.536983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:03.536983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:03.536983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:03.536983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:03.536983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:03.536983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:03.536983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:03.538093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:03.538093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:03.538093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:03.538093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:03.538093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:03.538093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:03.538093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:03.538093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:03.538093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:03.538093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:03.538093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:03.538093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:03.538093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:03.538093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:03.538093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:03.538093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:03.539150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:03.539150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:03.539150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:03.539150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:03.539150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:03.539150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:03.539150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:03.539150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:03.539150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:03.539150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:03.539150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:03.539150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:03.543752 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 61/124] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:03.545207 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c143d0-2c5c-4897-a87c-5aec2ea51267 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:03.619287 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f53b14-4a74-4cf7-a90c-00d5a801c8b7 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:03.664743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c143d0-2c5c-4897-a87c-5aec2ea51267 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:03.670413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2394cc9-b8d7-48e0-a6d4-0313579c3e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:03.671058 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2394cc9-b8d7-48e0-a6d4-0313579c3e1a None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:03.671344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2394cc9-b8d7-48e0-a6d4-0313579c3e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:03.671621 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2394cc9-b8d7-48e0-a6d4-0313579c3e1a None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:03.672765 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2394cc9-b8d7-48e0-a6d4-0313579c3e1a None admin] RBAC: Authorizing `identity:get_project(project_id=3d25847b7b534c73bfb985bc2a1852cc)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:03.674798 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2394cc9-b8d7-48e0-a6d4-0313579c3e1a None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:03.677743 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 64/125] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:03 2022] GET /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:03.678864 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2394cc9-b8d7-48e0-a6d4-0313579c3e1a None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:03.703095 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d0484-9cdf-4472-8b16-f2121e5c7755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:03.703856 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d0484-9cdf-4472-8b16-f2121e5c7755 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:03.704282 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d0484-9cdf-4472-8b16-f2121e5c7755 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:03.704635 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d0484-9cdf-4472-8b16-f2121e5c7755 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:03.717471 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d0484-9cdf-4472-8b16-f2121e5c7755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:03.722673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-879d0484-9cdf-4472-8b16-f2121e5c7755 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:03.722673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:03.722673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:03.722673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:03.722673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:03.722673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:03.722673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:03.722673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:03.722673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:03.722673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:03.722673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:03.722673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:03.722673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:03.722673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:03.722673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:03.722673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:03.724798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:03.724798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:03.724798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:03.724798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:03.724798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:03.724798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:03.724798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:03.724798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:03.724798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:03.724798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:03.724798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:03.724798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:03.724798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:03.724798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:03.724798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:03.724798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:03.726794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:03.726794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:03.726794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:03.726794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:03.726794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:03.726794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:03.726794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:03.726794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:03.726794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:03.726794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:03.726794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:03.726794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:03.726794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 62/126] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 5 14:14:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:03.726794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d0484-9cdf-4472-8b16-f2121e5c7755 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:03.759226 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:03.801510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:03.826655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2394cc9-b8d7-48e0-a6d4-0313579c3e1a None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:03.840161 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d0484-9cdf-4472-8b16-f2121e5c7755 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:03.865348 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cff2b-53f9-4547-b554-4aaf02053a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:03.866069 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cff2b-53f9-4547-b554-4aaf02053a3b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:03.866267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cff2b-53f9-4547-b554-4aaf02053a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:03.866526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cff2b-53f9-4547-b554-4aaf02053a3b None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:03.867645 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cff2b-53f9-4547-b554-4aaf02053a3b None admin] RBAC: Authorizing `identity:get_project(project_id=3d25847b7b534c73bfb985bc2a1852cc)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:03.869426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cff2b-53f9-4547-b554-4aaf02053a3b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:03.871497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 65/127] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:03 2022] GET /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:03.876634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cff2b-53f9-4547-b554-4aaf02053a3b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:03.881147 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112325e-1dd6-4b9d-9913-98c95f9d7e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:03.882034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112325e-1dd6-4b9d-9913-98c95f9d7e29 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:03.882504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112325e-1dd6-4b9d-9913-98c95f9d7e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:03.882968 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112325e-1dd6-4b9d-9913-98c95f9d7e29 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:03.883846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112325e-1dd6-4b9d-9913-98c95f9d7e29 None admin] RBAC: Adding query filter params (name=member) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:03.884339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112325e-1dd6-4b9d-9913-98c95f9d7e29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:03.885950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112325e-1dd6-4b9d-9913-98c95f9d7e29 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:03.895662 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 63/128] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:03.896794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112325e-1dd6-4b9d-9913-98c95f9d7e29 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:03.988083 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cff2b-53f9-4547-b554-4aaf02053a3b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:03.992264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:04.002910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112325e-1dd6-4b9d-9913-98c95f9d7e29 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:04.026530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd612b6-4e79-46a1-8f00-46ef06c83494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:04.027230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd612b6-4e79-46a1-8f00-46ef06c83494 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:04.027514 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd612b6-4e79-46a1-8f00-46ef06c83494 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:04.027787 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd612b6-4e79-46a1-8f00-46ef06c83494 None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc/users/93259f28708c46c3b1101160a1a44db1/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:04.030015 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd612b6-4e79-46a1-8f00-46ef06c83494 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d25847b7b534c73bfb985bc2a1852cc, user_id=93259f28708c46c3b1101160a1a44db1, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:04.031575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd612b6-4e79-46a1-8f00-46ef06c83494 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:04.040256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e8924-752e-42b1-9c76-3323452fc20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:04.041012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e8924-752e-42b1-9c76-3323452fc20d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:04.041393 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e8924-752e-42b1-9c76-3323452fc20d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:04.041731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e8924-752e-42b1-9c76-3323452fc20d None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:04.042642 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e8924-752e-42b1-9c76-3323452fc20d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:04.043067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e8924-752e-42b1-9c76-3323452fc20d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:04.044524 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e8924-752e-42b1-9c76-3323452fc20d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:04.057126 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 64/129] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:14:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:04.057126 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e8924-752e-42b1-9c76-3323452fc20d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:04.100867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 66/130] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:14:03 2022] PUT /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc/users/93259f28708c46c3b1101160a1a44db1/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:14:04.102621 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd612b6-4e79-46a1-8f00-46ef06c83494 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:04.119318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:04.239786 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd612b6-4e79-46a1-8f00-46ef06c83494 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:04.247800 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e8924-752e-42b1-9c76-3323452fc20d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:04.284672 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f896201-c472-44db-9009-854961981a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:04.285343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f896201-c472-44db-9009-854961981a1b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:04.285623 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f896201-c472-44db-9009-854961981a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:04.285896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f896201-c472-44db-9009-854961981a1b None admin] PATH_INFO: `/v3/users/93259f28708c46c3b1101160a1a44db1` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:04.287691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f896201-c472-44db-9009-854961981a1b None admin] RBAC: Authorizing `identity:get_user(user_id=93259f28708c46c3b1101160a1a44db1)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:04.289193 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f896201-c472-44db-9009-854961981a1b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:04.291423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 67/131] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:04 2022] GET /identity/v3/users/93259f28708c46c3b1101160a1a44db1 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:04.292817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f896201-c472-44db-9009-854961981a1b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:04.316252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6609b9-d084-4c9b-87c3-8165d5f0bed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:04.317558 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6609b9-d084-4c9b-87c3-8165d5f0bed0 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:04.318047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6609b9-d084-4c9b-87c3-8165d5f0bed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:04.318858 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6609b9-d084-4c9b-87c3-8165d5f0bed0 None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc/users/7609e1a1df8f4af7ad4a5bc5e3426829/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:04.321014 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6609b9-d084-4c9b-87c3-8165d5f0bed0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d25847b7b534c73bfb985bc2a1852cc, user_id=7609e1a1df8f4af7ad4a5bc5e3426829, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:04.323112 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6609b9-d084-4c9b-87c3-8165d5f0bed0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:04.394932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:04.419227 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f896201-c472-44db-9009-854961981a1b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:04.457407 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 65/132] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:14:04 2022] PUT /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc/users/7609e1a1df8f4af7ad4a5bc5e3426829/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:14:04.458464 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6609b9-d084-4c9b-87c3-8165d5f0bed0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:04.460099 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406d84d-f5c6-42a3-91d4-95e89b20321b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:04.461088 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406d84d-f5c6-42a3-91d4-95e89b20321b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:04.461569 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406d84d-f5c6-42a3-91d4-95e89b20321b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:04.462080 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406d84d-f5c6-42a3-91d4-95e89b20321b None admin] PATH_INFO: `/v3/users/93259f28708c46c3b1101160a1a44db1` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:04.463631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406d84d-f5c6-42a3-91d4-95e89b20321b None admin] RBAC: Authorizing `identity:get_user(user_id=93259f28708c46c3b1101160a1a44db1)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:04.465502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406d84d-f5c6-42a3-91d4-95e89b20321b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:04.467465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 68/133] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:04 2022] GET /identity/v3/users/93259f28708c46c3b1101160a1a44db1 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:04.474784 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406d84d-f5c6-42a3-91d4-95e89b20321b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:04.485299 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:04.647753 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406d84d-f5c6-42a3-91d4-95e89b20321b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:04.689967 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e284063-ba1b-4da0-ab17-abf190f8eec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:04.690515 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6609b9-d084-4c9b-87c3-8165d5f0bed0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:04.691513 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e284063-ba1b-4da0-ab17-abf190f8eec2 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:04.692185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e284063-ba1b-4da0-ab17-abf190f8eec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:04.692670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e284063-ba1b-4da0-ab17-abf190f8eec2 None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:04.694909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e284063-ba1b-4da0-ab17-abf190f8eec2 None admin] RBAC: Authorizing `identity:get_project(project_id=3d25847b7b534c73bfb985bc2a1852cc)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:04.696567 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e284063-ba1b-4da0-ab17-abf190f8eec2 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:04.700022 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 69/134] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:04 2022] GET /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:04.701284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc767a5d-17cb-4384-b022-5af23d057d5a None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:04.701575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc767a5d-17cb-4384-b022-5af23d057d5a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:04.702244 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc767a5d-17cb-4384-b022-5af23d057d5a None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:04.703908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 70/135] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:04.704982 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc767a5d-17cb-4384-b022-5af23d057d5a None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:04.726233 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:04.734115 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f0a45-21e8-44d4-881f-2011619c8c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:04.735260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f0a45-21e8-44d4-881f-2011619c8c78 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:04.735574 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f0a45-21e8-44d4-881f-2011619c8c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:04.736163 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f0a45-21e8-44d4-881f-2011619c8c78 None admin] PATH_INFO: `/v3/projects/3b3e5b21b51d46b7b919b2692877fcf0` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:04.737551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f0a45-21e8-44d4-881f-2011619c8c78 None admin] RBAC: Authorizing `identity:get_project(project_id=3b3e5b21b51d46b7b919b2692877fcf0)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:04.739723 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f0a45-21e8-44d4-881f-2011619c8c78 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:04.741874 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 66/136] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:04 2022] GET /identity/v3/projects/3b3e5b21b51d46b7b919b2692877fcf0 => generated 312 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:04.743321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b3954-4722-4406-bdb6-868cc0f1f73d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:04.743787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b3954-4722-4406-bdb6-868cc0f1f73d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:04.744074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b3954-4722-4406-bdb6-868cc0f1f73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:04.774364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e52b3954-4722-4406-bdb6-868cc0f1f73d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:04.775585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e52b3954-4722-4406-bdb6-868cc0f1f73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:04.881327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc767a5d-17cb-4384-b022-5af23d057d5a None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:04.913564 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 67/137] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:04.921406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b3954-4722-4406-bdb6-868cc0f1f73d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:04.945315 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:04.960033 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73f30d-8668-4beb-a942-0924ae55f29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:04.960783 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73f30d-8668-4beb-a942-0924ae55f29a None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:04.961080 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73f30d-8668-4beb-a942-0924ae55f29a None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:04.961382 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73f30d-8668-4beb-a942-0924ae55f29a None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc/users/93259f28708c46c3b1101160a1a44db1/roles/a1ffbcf6f60f4aea99c7eb1dbcb34582` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:04.966320 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73f30d-8668-4beb-a942-0924ae55f29a None admin] RBAC: Authorizing `identity:create_grant(project_id=3d25847b7b534c73bfb985bc2a1852cc, user_id=93259f28708c46c3b1101160a1a44db1, role_id=a1ffbcf6f60f4aea99c7eb1dbcb34582)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:04.967842 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73f30d-8668-4beb-a942-0924ae55f29a None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:05.053764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 71/138] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:14:04 2022] PUT /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc/users/93259f28708c46c3b1101160a1a44db1/roles/a1ffbcf6f60f4aea99c7eb1dbcb34582 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:14:05.070999 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b3954-4722-4406-bdb6-868cc0f1f73d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:05.121858 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868affd8-7e82-4b99-9ef1-9a4a9cb5e1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:05.122942 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868affd8-7e82-4b99-9ef1-9a4a9cb5e1c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:05.123419 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868affd8-7e82-4b99-9ef1-9a4a9cb5e1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:05.123896 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868affd8-7e82-4b99-9ef1-9a4a9cb5e1c1 None admin] PATH_INFO: `/v3/projects/3b3e5b21b51d46b7b919b2692877fcf0/users/93259f28708c46c3b1101160a1a44db1/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:05.130748 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868affd8-7e82-4b99-9ef1-9a4a9cb5e1c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b3e5b21b51d46b7b919b2692877fcf0, user_id=93259f28708c46c3b1101160a1a44db1, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:05.132610 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868affd8-7e82-4b99-9ef1-9a4a9cb5e1c1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:05.209646 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 68/139] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:14:04 2022] PUT /identity/v3/projects/3b3e5b21b51d46b7b919b2692877fcf0/users/93259f28708c46c3b1101160a1a44db1/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:14:05.300427 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73f30d-8668-4beb-a942-0924ae55f29a None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:05.395401 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:05.422110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73f30d-8668-4beb-a942-0924ae55f29a None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:05.470831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d5f7f-8fe4-4eda-98ba-d367c9d02bee None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:05.471436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d5f7f-8fe4-4eda-98ba-d367c9d02bee None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:05.471710 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d5f7f-8fe4-4eda-98ba-d367c9d02bee None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:05.473260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 69/140] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:14:05.481194 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb51ad-f74a-4902-a1ce-a0f3cc25e025 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:05.481194 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb51ad-f74a-4902-a1ce-a0f3cc25e025 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:05.481194 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb51ad-f74a-4902-a1ce-a0f3cc25e025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:05.481852 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429195c4-43ba-4673-81b9-03fcbfea312f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:05.482498 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429195c4-43ba-4673-81b9-03fcbfea312f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:05.482772 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429195c4-43ba-4673-81b9-03fcbfea312f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:05.483038 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429195c4-43ba-4673-81b9-03fcbfea312f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:05.484841 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429195c4-43ba-4673-81b9-03fcbfea312f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:05.485673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429195c4-43ba-4673-81b9-03fcbfea312f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:05.487241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 72/141] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:14:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:05.492534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429195c4-43ba-4673-81b9-03fcbfea312f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:05.512564 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-fadb51ad-f74a-4902-a1ce-a0f3cc25e025 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:05.514191 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fadb51ad-f74a-4902-a1ce-a0f3cc25e025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:05.592891 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 70/142] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:14:05.596267 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:05.704858 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429195c4-43ba-4673-81b9-03fcbfea312f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:05.748521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a50c0-839b-45eb-a168-9ef68151d987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:05.749169 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a50c0-839b-45eb-a168-9ef68151d987 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:05.749449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a50c0-839b-45eb-a168-9ef68151d987 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:05.749713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a50c0-839b-45eb-a168-9ef68151d987 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:05.750371 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a50c0-839b-45eb-a168-9ef68151d987 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:05.751817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a50c0-839b-45eb-a168-9ef68151d987 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:05.860129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:05.866000 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 73/143] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 5 14:14:05 2022] POST /identity/v3/users => generated 283 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:14:05.942776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb51ad-f74a-4902-a1ce-a0f3cc25e025 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:06.053442 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb51ad-f74a-4902-a1ce-a0f3cc25e025 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:06.091293 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c57c2c-f852-4297-9e70-9d10b223709e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:06.092403 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c57c2c-f852-4297-9e70-9d10b223709e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:06.092883 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c57c2c-f852-4297-9e70-9d10b223709e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:06.093380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c57c2c-f852-4297-9e70-9d10b223709e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:06.105766 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c57c2c-f852-4297-9e70-9d10b223709e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:06.111043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-47c57c2c-f852-4297-9e70-9d10b223709e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 14:14:06.111043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:06.111043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:06.111043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:06.111043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:06.111043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:06.111043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:06.111043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:06.111043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:06.111043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:06.111043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:06.111043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:06.111043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:06.111043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:06.111043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:06.111043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:06.111875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:06.111875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:06.111875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:06.111875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:06.111875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:06.111875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:06.111875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:06.111875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:06.111875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:06.111875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:06.111875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:06.111875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:06.111875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:06.111875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:06.111875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:06.111875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:06.112637 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:06.112637 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:06.112637 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:06.112637 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:06.112637 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:06.112637 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:06.112637 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:06.112637 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:06.112637 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:06.112637 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:06.112637 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 14:14:06.112637 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:06.115018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 71/144] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:06.121482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a50c0-839b-45eb-a168-9ef68151d987 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:06.225989 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a50c0-839b-45eb-a168-9ef68151d987 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:06.278925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd5390-e9a3-42d0-96ca-19a67000327d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:06.279568 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd5390-e9a3-42d0-96ca-19a67000327d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:06.279845 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd5390-e9a3-42d0-96ca-19a67000327d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:06.280115 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd5390-e9a3-42d0-96ca-19a67000327d None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:06.280798 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd5390-e9a3-42d0-96ca-19a67000327d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:06.281125 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd5390-e9a3-42d0-96ca-19a67000327d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:06.282568 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd5390-e9a3-42d0-96ca-19a67000327d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:06.297618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 74/145] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:06.303668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c57c2c-f852-4297-9e70-9d10b223709e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:06.367634 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:06.411500 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c57c2c-f852-4297-9e70-9d10b223709e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:06.449385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe0976-f84a-43d4-b432-710e3df931ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:06.450025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe0976-f84a-43d4-b432-710e3df931ec None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:06.450311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe0976-f84a-43d4-b432-710e3df931ec None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:06.450591 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe0976-f84a-43d4-b432-710e3df931ec None admin] PATH_INFO: `/v3/users/5ab2c3ccd994410b9b324438a050f121` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:06.451903 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe0976-f84a-43d4-b432-710e3df931ec None admin] RBAC: Authorizing `identity:get_user(user_id=5ab2c3ccd994410b9b324438a050f121)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:06.453412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe0976-f84a-43d4-b432-710e3df931ec None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:06.455055 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 72/146] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:06 2022] GET /identity/v3/users/5ab2c3ccd994410b9b324438a050f121 => generated 289 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:06.460868 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd5390-e9a3-42d0-96ca-19a67000327d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:06.539758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:06.586137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd5390-e9a3-42d0-96ca-19a67000327d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:06.630636 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c266c-ebf9-4c5a-a704-ef1911d5f3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:06.631283 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c266c-ebf9-4c5a-a704-ef1911d5f3de None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:06.631562 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c266c-ebf9-4c5a-a704-ef1911d5f3de None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:06.631841 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c266c-ebf9-4c5a-a704-ef1911d5f3de None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:06.632993 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c266c-ebf9-4c5a-a704-ef1911d5f3de None admin] RBAC: Authorizing `identity:get_project(project_id=3d25847b7b534c73bfb985bc2a1852cc)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:06.634554 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c266c-ebf9-4c5a-a704-ef1911d5f3de None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:06.637313 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 75/147] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:06 2022] GET /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:06.642966 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe0976-f84a-43d4-b432-710e3df931ec None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:06.771517 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe0976-f84a-43d4-b432-710e3df931ec None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:06.804344 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:06.814523 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49010b63-a00a-4890-9758-fe3f25d1415c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:06.819883 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49010b63-a00a-4890-9758-fe3f25d1415c None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:06.819883 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49010b63-a00a-4890-9758-fe3f25d1415c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:06.819883 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49010b63-a00a-4890-9758-fe3f25d1415c None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc/users/5ab2c3ccd994410b9b324438a050f121/roles/35ba371f3216414e950ba78ba9587bed` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:06.819883 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49010b63-a00a-4890-9758-fe3f25d1415c None admin] RBAC: Authorizing `identity:create_grant(project_id=3d25847b7b534c73bfb985bc2a1852cc, user_id=5ab2c3ccd994410b9b324438a050f121, role_id=35ba371f3216414e950ba78ba9587bed)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:06.819883 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49010b63-a00a-4890-9758-fe3f25d1415c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:06.906697 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 73/148] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:14:06 2022] PUT /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc/users/5ab2c3ccd994410b9b324438a050f121/roles/35ba371f3216414e950ba78ba9587bed => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:14:07.014433 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f6509-bd1e-473d-ae8e-9ba1121790d9 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:07.014922 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f6509-bd1e-473d-ae8e-9ba1121790d9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:07.014992 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f6509-bd1e-473d-ae8e-9ba1121790d9 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:07.016436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 76/149] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:07.022830 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce864e2b-92c4-4d46-b667-0ef69622da0b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:07.023808 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce864e2b-92c4-4d46-b667-0ef69622da0b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:07.024280 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce864e2b-92c4-4d46-b667-0ef69622da0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:07.055125 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ce864e2b-92c4-4d46-b667-0ef69622da0b None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:07.056756 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ce864e2b-92c4-4d46-b667-0ef69622da0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:07.154828 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 74/150] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:14:07.373006 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d528cb-79c8-442e-bdb5-5699409f1d48 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:07.373374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d528cb-79c8-442e-bdb5-5699409f1d48 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:07.373587 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d528cb-79c8-442e-bdb5-5699409f1d48 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:07.375082 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 77/151] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:07.380264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6120a2-c844-4741-9f32-1be09ebd87e1 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:07.380784 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6120a2-c844-4741-9f32-1be09ebd87e1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:07.381285 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6120a2-c844-4741-9f32-1be09ebd87e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:07.403451 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-eb6120a2-c844-4741-9f32-1be09ebd87e1 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:07.404615 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-eb6120a2-c844-4741-9f32-1be09ebd87e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:07.490536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 75/152] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:07.674288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d528cb-79c8-442e-bdb5-5699409f1d48 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:07.794157 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d528cb-79c8-442e-bdb5-5699409f1d48 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:07.828121 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:07.835841 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa9fb2-b97a-4c83-b626-f79ae5c5670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:07.836477 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa9fb2-b97a-4c83-b626-f79ae5c5670a None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:07.836752 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa9fb2-b97a-4c83-b626-f79ae5c5670a None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:07.837064 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa9fb2-b97a-4c83-b626-f79ae5c5670a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:07.849038 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa9fb2-b97a-4c83-b626-f79ae5c5670a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:07.853867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-42aa9fb2-b97a-4c83-b626-f79ae5c5670a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:07.853867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:07.853867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:07.853867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:07.853867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:07.853867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:07.853867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:07.853867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:07.853867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:07.853867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:07.853867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:07.853867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:07.853867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:07.853867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:07.853867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:07.853867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:07.854717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:07.854717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:07.854717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:07.854717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:07.854717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:07.854717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:07.854717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:07.854717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:07.854717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:07.854717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:07.854717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:07.854717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:07.854717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:07.854717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:07.854717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:07.854717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:07.855978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:07.855978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:07.855978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:07.855978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:07.855978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:07.855978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:07.855978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:07.855978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:07.855978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:07.855978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:07.855978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:07.855978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:07.855978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 78/153] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:14:07.864794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6120a2-c844-4741-9f32-1be09ebd87e1 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:07.947933 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:08.020815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6120a2-c844-4741-9f32-1be09ebd87e1 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:08.064602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3b889-189f-4b02-821f-c1871555f4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:08.065352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3b889-189f-4b02-821f-c1871555f4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:08.065505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3b889-189f-4b02-821f-c1871555f4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:08.065692 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3b889-189f-4b02-821f-c1871555f4b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:08.066367 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3b889-189f-4b02-821f-c1871555f4b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:08.066671 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3b889-189f-4b02-821f-c1871555f4b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:08.068072 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3b889-189f-4b02-821f-c1871555f4b0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:08.076199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f3328-5497-46cb-a158-ee033c6abdae None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:08.076782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f3328-5497-46cb-a158-ee033c6abdae None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:08.076782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f3328-5497-46cb-a158-ee033c6abdae None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:08.078348 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 79/154] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:08.080531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 76/155] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:08.083490 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad64ac0-e8f4-4133-99b9-c206e1cb9a3a None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:08.083769 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad64ac0-e8f4-4133-99b9-c206e1cb9a3a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:08.084040 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad64ac0-e8f4-4133-99b9-c206e1cb9a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:08.085649 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3b889-189f-4b02-821f-c1871555f4b0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:08.103297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-9ad64ac0-e8f4-4133-99b9-c206e1cb9a3a None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:08.104483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9ad64ac0-e8f4-4133-99b9-c206e1cb9a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:08.257306 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3b889-189f-4b02-821f-c1871555f4b0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:08.273674 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 80/156] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:14:08.274539 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad64ac0-e8f4-4133-99b9-c206e1cb9a3a None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:08.275663 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:08.320054 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc074e-f3c2-4dd8-a2b9-ee92e7dfd05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:08.320611 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc074e-f3c2-4dd8-a2b9-ee92e7dfd05b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:08.323016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc074e-f3c2-4dd8-a2b9-ee92e7dfd05b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:08.323297 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc074e-f3c2-4dd8-a2b9-ee92e7dfd05b None admin] PATH_INFO: `/v3/users/93259f28708c46c3b1101160a1a44db1` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:08.325268 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc074e-f3c2-4dd8-a2b9-ee92e7dfd05b None admin] RBAC: Authorizing `identity:get_user(user_id=93259f28708c46c3b1101160a1a44db1)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:08.326736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc074e-f3c2-4dd8-a2b9-ee92e7dfd05b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:08.337846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 77/157] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:08 2022] GET /identity/v3/users/93259f28708c46c3b1101160a1a44db1 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:08.341675 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc074e-f3c2-4dd8-a2b9-ee92e7dfd05b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:08.440064 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad64ac0-e8f4-4133-99b9-c206e1cb9a3a None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:08.462017 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:08.483421 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871ccde-18f5-40db-a5c8-ca66a2b3daef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:08.484909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871ccde-18f5-40db-a5c8-ca66a2b3daef None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:08.485453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871ccde-18f5-40db-a5c8-ca66a2b3daef None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:08.485856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871ccde-18f5-40db-a5c8-ca66a2b3daef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:08.501204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871ccde-18f5-40db-a5c8-ca66a2b3daef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:08.507515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-d871ccde-18f5-40db-a5c8-ca66a2b3daef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:14:08.507515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:08.507515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:08.507515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:08.507515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:08.507515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:08.507515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:08.507515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:08.507515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:08.507515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:08.507515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:08.507515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:08.507515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:08.507515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:08.507515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:08.507515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:08.508600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:08.508600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:08.508600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:08.508600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:08.508600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:08.508600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:08.508600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:08.508600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:08.508600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:08.508600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:08.508600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:08.508600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:08.508600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:08.508600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:08.508600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:08.508600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:08.509387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:08.509387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:08.509387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:08.509387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:08.509387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:08.509387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:08.509387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:08.509387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:08.509387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:08.509387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:08.509387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:14:08.509387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:08.512651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 81/158] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:14:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:08.514730 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ebc20-a943-41c1-a9d0-b87e8d500b65 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:08.515197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ebc20-a943-41c1-a9d0-b87e8d500b65 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:08.515647 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ebc20-a943-41c1-a9d0-b87e8d500b65 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:08.522294 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 82/159] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:08.524461 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ebc20-a943-41c1-a9d0-b87e8d500b65 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:08.559501 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc074e-f3c2-4dd8-a2b9-ee92e7dfd05b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:08.656778 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e7c93-2149-48d7-a75f-5b0fc7aa90a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:08.656778 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e7c93-2149-48d7-a75f-5b0fc7aa90a0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:08.656778 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e7c93-2149-48d7-a75f-5b0fc7aa90a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:08.657119 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e7c93-2149-48d7-a75f-5b0fc7aa90a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:08.691273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ebc20-a943-41c1-a9d0-b87e8d500b65 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:08.759978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c2424-0550-41bb-8c63-778fa1808dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:08.762081 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c2424-0550-41bb-8c63-778fa1808dec None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:08.763519 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:08.765457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c2424-0550-41bb-8c63-778fa1808dec None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:08.766365 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c2424-0550-41bb-8c63-778fa1808dec None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:08.767325 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c2424-0550-41bb-8c63-778fa1808dec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:08.769432 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c2424-0550-41bb-8c63-778fa1808dec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:08.777860 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c2424-0550-41bb-8c63-778fa1808dec None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:08.794117 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e7c93-2149-48d7-a75f-5b0fc7aa90a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:08.795480 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 83/160] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:08.796179 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e7c93-2149-48d7-a75f-5b0fc7aa90a0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:08.796919 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630a282-2765-46f2-ad50-aa29fedfc688 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:08.797233 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630a282-2765-46f2-ad50-aa29fedfc688 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:08.797509 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630a282-2765-46f2-ad50-aa29fedfc688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:08.836988 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-0630a282-2765-46f2-ad50-aa29fedfc688 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:08.838520 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0630a282-2765-46f2-ad50-aa29fedfc688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:08.906284 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 78/161] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:14:08.907486 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e7c93-2149-48d7-a75f-5b0fc7aa90a0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:08.950620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:08.997604 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:09.019908 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e7c93-2149-48d7-a75f-5b0fc7aa90a0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:09.043465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 84/162] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:09.044331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630a282-2765-46f2-ad50-aa29fedfc688 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:09.061872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df88f42-1798-4f49-b948-00ab9541a0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:09.063134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df88f42-1798-4f49-b948-00ab9541a0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:09.063605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df88f42-1798-4f49-b948-00ab9541a0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:09.064086 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df88f42-1798-4f49-b948-00ab9541a0b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:09.086548 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df88f42-1798-4f49-b948-00ab9541a0b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:09.098466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-6df88f42-1798-4f49-b948-00ab9541a0b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:09.098466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:09.098466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:09.098466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:09.098466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:09.098466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:09.098466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:09.098466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:09.098466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:09.098466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:09.098466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:09.098466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:09.098466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:09.098466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:09.098466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:09.098466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:09.099327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:09.099327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:09.099327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:09.099327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:09.099327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:09.099327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:09.099327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:09.099327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:09.099327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:09.099327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:09.099327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:09.099327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:09.099327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:09.099327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:09.099327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:09.099327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:09.100081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:09.100081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:09.100081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:09.100081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:09.100081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:09.100081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:09.100081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:09.100081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:09.100081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:09.100081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:09.100081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:09.100081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:09.102516 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 79/163] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:09.103501 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df88f42-1798-4f49-b948-00ab9541a0b3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:09.226016 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630a282-2765-46f2-ad50-aa29fedfc688 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:09.289886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9a622-abe3-46a6-9fba-222666b1de55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:09.290537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9a622-abe3-46a6-9fba-222666b1de55 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:09.290816 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9a622-abe3-46a6-9fba-222666b1de55 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:09.291091 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9a622-abe3-46a6-9fba-222666b1de55 None admin] PATH_INFO: `/v3/users/7609e1a1df8f4af7ad4a5bc5e3426829` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:09.292608 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9a622-abe3-46a6-9fba-222666b1de55 None admin] RBAC: Authorizing `identity:get_user(user_id=7609e1a1df8f4af7ad4a5bc5e3426829)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:09.294629 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9a622-abe3-46a6-9fba-222666b1de55 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:09.296270 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 85/164] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:09 2022] GET /identity/v3/users/7609e1a1df8f4af7ad4a5bc5e3426829 => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:09.297088 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9a622-abe3-46a6-9fba-222666b1de55 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:09.320373 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df88f42-1798-4f49-b948-00ab9541a0b3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:09.376633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78923f71-ee61-4c8d-9918-6db8afa2ee6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:09.377634 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78923f71-ee61-4c8d-9918-6db8afa2ee6c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:09.378246 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78923f71-ee61-4c8d-9918-6db8afa2ee6c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:09.378770 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78923f71-ee61-4c8d-9918-6db8afa2ee6c None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:09.380778 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78923f71-ee61-4c8d-9918-6db8afa2ee6c None admin] RBAC: Authorizing `identity:get_project(project_id=3d25847b7b534c73bfb985bc2a1852cc)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:09.380937 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:09.382846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78923f71-ee61-4c8d-9918-6db8afa2ee6c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:09.384486 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 80/165] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:09 2022] GET /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:09.395475 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78923f71-ee61-4c8d-9918-6db8afa2ee6c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:09.409447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:09.494280 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9a622-abe3-46a6-9fba-222666b1de55 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:09.578369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440f3fb-6c1a-461b-9144-27c148f3067d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:09.579002 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440f3fb-6c1a-461b-9144-27c148f3067d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:09.579284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440f3fb-6c1a-461b-9144-27c148f3067d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:09.579551 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440f3fb-6c1a-461b-9144-27c148f3067d None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:09.580223 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440f3fb-6c1a-461b-9144-27c148f3067d None admin] RBAC: Adding query filter params (name=member) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:09.580521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440f3fb-6c1a-461b-9144-27c148f3067d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:09.580757 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78923f71-ee61-4c8d-9918-6db8afa2ee6c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:09.581942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440f3fb-6c1a-461b-9144-27c148f3067d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:09.599342 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 86/166] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:09.600093 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440f3fb-6c1a-461b-9144-27c148f3067d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:09.617191 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cc02d-79b6-4352-9ec6-80190366ae0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:09.617804 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cc02d-79b6-4352-9ec6-80190366ae0e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:09.618079 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cc02d-79b6-4352-9ec6-80190366ae0e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:09.618352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cc02d-79b6-4352-9ec6-80190366ae0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:09.691764 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705cc02d-79b6-4352-9ec6-80190366ae0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:09.693265 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705cc02d-79b6-4352-9ec6-80190366ae0e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:09.702138 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:09.803538 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 81/167] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:14:09.804442 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cc02d-79b6-4352-9ec6-80190366ae0e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:09.885427 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:09.894936 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440f3fb-6c1a-461b-9144-27c148f3067d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:09.912255 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cc02d-79b6-4352-9ec6-80190366ae0e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:09.921409 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:09.949951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9ec4d-2a8c-49b6-8ac0-696d28458765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:09.950872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9ec4d-2a8c-49b6-8ac0-696d28458765 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:09.951271 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9ec4d-2a8c-49b6-8ac0-696d28458765 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:09.951637 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9ec4d-2a8c-49b6-8ac0-696d28458765 None admin] PATH_INFO: `/v3/users/93259f28708c46c3b1101160a1a44db1` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:09.952914 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9ec4d-2a8c-49b6-8ac0-696d28458765 None admin] RBAC: Authorizing `identity:get_user(user_id=93259f28708c46c3b1101160a1a44db1)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:09.954814 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9ec4d-2a8c-49b6-8ac0-696d28458765 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:09.956390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 82/168] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:09 2022] GET /identity/v3/users/93259f28708c46c3b1101160a1a44db1 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:09.957178 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9ec4d-2a8c-49b6-8ac0-696d28458765 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:10.034476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb767c-c0af-409b-bc42-53e7e51c42b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:10.035095 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb767c-c0af-409b-bc42-53e7e51c42b1 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:10.035374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb767c-c0af-409b-bc42-53e7e51c42b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:10.035647 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb767c-c0af-409b-bc42-53e7e51c42b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:10.036389 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb767c-c0af-409b-bc42-53e7e51c42b1 None admin] RBAC: Adding query filter params (role.id=d818d9cd93494e0b8e7b6d6539bc808d, scope.project.id=3d25847b7b534c73bfb985bc2a1852cc, user.id=93259f28708c46c3b1101160a1a44db1) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:10.036699 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb767c-c0af-409b-bc42-53e7e51c42b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:10.038188 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb767c-c0af-409b-bc42-53e7e51c42b1 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:10.055494 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 87/169] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:14:09 2022] GET /identity/v3/role_assignments?user.id=93259f28708c46c3b1101160a1a44db1&scope.project.id=3d25847b7b534c73bfb985bc2a1852cc&role.id=d818d9cd93494e0b8e7b6d6539bc808d => generated 608 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:10.056097 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb767c-c0af-409b-bc42-53e7e51c42b1 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:10.072570 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9ec4d-2a8c-49b6-8ac0-696d28458765 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:10.124785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8929d0-92e8-44f3-b71c-ad34222fc7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:10.125487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8929d0-92e8-44f3-b71c-ad34222fc7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:10.125774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8929d0-92e8-44f3-b71c-ad34222fc7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:10.126048 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8929d0-92e8-44f3-b71c-ad34222fc7e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:10.146799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8929d0-92e8-44f3-b71c-ad34222fc7e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:10.162493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-6b8929d0-92e8-44f3-b71c-ad34222fc7e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:10.162493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:10.162493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:10.162493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:10.162493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:10.162493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:10.162493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:10.162493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:10.162493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:10.162493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:10.162493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:10.162493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:10.162493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:10.162493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:10.162493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:10.162493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:10.163474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:10.163474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:10.163474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:10.163474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:10.163474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:10.163474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:10.163474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:10.163474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:10.163474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:10.163474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:10.163474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:10.163474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:10.163474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:10.163474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:10.163474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:10.163474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:10.164286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:10.164286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:10.164286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:10.164286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:10.164286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:10.164286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:10.164286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:10.164286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:10.164286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:10.164286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:10.164286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:10.164286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:10.164286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 83/170] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 5 14:14:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:10.164944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8929d0-92e8-44f3-b71c-ad34222fc7e9 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:10.218664 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:10.295769 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb767c-c0af-409b-bc42-53e7e51c42b1 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:10.367295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8929d0-92e8-44f3-b71c-ad34222fc7e9 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:10.371663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b4fc2-8d93-4d68-b07a-ffd16c7378c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:10.374140 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b4fc2-8d93-4d68-b07a-ffd16c7378c2 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:10.374652 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b4fc2-8d93-4d68-b07a-ffd16c7378c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:10.375142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b4fc2-8d93-4d68-b07a-ffd16c7378c2 None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:10.378249 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b4fc2-8d93-4d68-b07a-ffd16c7378c2 None admin] RBAC: Authorizing `identity:get_project(project_id=3d25847b7b534c73bfb985bc2a1852cc)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:10.380027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b4fc2-8d93-4d68-b07a-ffd16c7378c2 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:10.382696 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 88/171] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:10 2022] GET /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc => generated 298 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:10.384225 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b4fc2-8d93-4d68-b07a-ffd16c7378c2 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:10.443839 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1d31b-d705-42c2-9c68-bd3acda1b3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:10.444455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1d31b-d705-42c2-9c68-bd3acda1b3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:10.444569 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:10.444726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1d31b-d705-42c2-9c68-bd3acda1b3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:10.444996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1d31b-d705-42c2-9c68-bd3acda1b3d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:10.561799 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b4fc2-8d93-4d68-b07a-ffd16c7378c2 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:10.594094 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1d31b-d705-42c2-9c68-bd3acda1b3d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:10.595683 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1d31b-d705-42c2-9c68-bd3acda1b3d4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:10.604045 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed93e1-20c1-47e2-a1ad-23c3f69d9fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:10.605525 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed93e1-20c1-47e2-a1ad-23c3f69d9fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:10.606288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed93e1-20c1-47e2-a1ad-23c3f69d9fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:10.606792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed93e1-20c1-47e2-a1ad-23c3f69d9fd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:10.607698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed93e1-20c1-47e2-a1ad-23c3f69d9fd0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:10.608183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed93e1-20c1-47e2-a1ad-23c3f69d9fd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:10.610267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed93e1-20c1-47e2-a1ad-23c3f69d9fd0 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:10.620289 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 89/172] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:14:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:10.622323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27e7e3-4779-4a3f-9002-faa4ccf935e5 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:10.622802 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27e7e3-4779-4a3f-9002-faa4ccf935e5 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:10.623252 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27e7e3-4779-4a3f-9002-faa4ccf935e5 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:10.633100 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 90/173] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:10 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:10.634346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27e7e3-4779-4a3f-9002-faa4ccf935e5 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:10.691694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:10.772570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:10.784257 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27e7e3-4779-4a3f-9002-faa4ccf935e5 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:10.786776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 84/174] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:14:10.788262 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92fbd6-8fde-4310-9dd3-e384aaa4c1de None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:10.788753 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92fbd6-8fde-4310-9dd3-e384aaa4c1de None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:10.789337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92fbd6-8fde-4310-9dd3-e384aaa4c1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:10.811835 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3a92fbd6-8fde-4310-9dd3-e384aaa4c1de None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:10.814013 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3a92fbd6-8fde-4310-9dd3-e384aaa4c1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:10.830004 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0716084-dc78-4da0-accc-bbc570670e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:10.830850 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0716084-dc78-4da0-accc-bbc570670e5f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:10.831145 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0716084-dc78-4da0-accc-bbc570670e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:10.831420 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0716084-dc78-4da0-accc-bbc570670e5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:10.832215 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0716084-dc78-4da0-accc-bbc570670e5f None admin] RBAC: Adding query filter params (role.id=f22e6e660eab44c5be25e3dee1e3042c, scope.project.id=3d25847b7b534c73bfb985bc2a1852cc, user.id=7609e1a1df8f4af7ad4a5bc5e3426829) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:10.832947 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0716084-dc78-4da0-accc-bbc570670e5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:10.834721 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0716084-dc78-4da0-accc-bbc570670e5f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:10.843735 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 91/175] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:14:10 2022] GET /identity/v3/role_assignments?user.id=7609e1a1df8f4af7ad4a5bc5e3426829&scope.project.id=3d25847b7b534c73bfb985bc2a1852cc&role.id=f22e6e660eab44c5be25e3dee1e3042c => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:10.845417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0716084-dc78-4da0-accc-bbc570670e5f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:10.896729 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 85/176] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:10.898156 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f6813-e397-4bf0-8199-f95fd58edfb0 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:10.898503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f6813-e397-4bf0-8199-f95fd58edfb0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:10.898841 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f6813-e397-4bf0-8199-f95fd58edfb0 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:10.900268 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 86/177] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:10.901119 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f6813-e397-4bf0-8199-f95fd58edfb0 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:10.980439 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:10.981857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0716084-dc78-4da0-accc-bbc570670e5f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:11.024141 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a2339-f793-433d-b122-fa97d1e7615d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:11.024786 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a2339-f793-433d-b122-fa97d1e7615d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:11.025091 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a2339-f793-433d-b122-fa97d1e7615d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:11.025351 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a2339-f793-433d-b122-fa97d1e7615d None admin] PATH_INFO: `/v3/users/93259f28708c46c3b1101160a1a44db1` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:11.027188 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a2339-f793-433d-b122-fa97d1e7615d None admin] RBAC: Authorizing `identity:get_user(user_id=93259f28708c46c3b1101160a1a44db1)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:11.028647 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a2339-f793-433d-b122-fa97d1e7615d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:11.030670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 92/178] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:10 2022] GET /identity/v3/users/93259f28708c46c3b1101160a1a44db1 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:11.031924 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b2665-c735-48bf-bd4f-e5df1b9ab84a None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:11.032256 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b2665-c735-48bf-bd4f-e5df1b9ab84a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:11.032535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b2665-c735-48bf-bd4f-e5df1b9ab84a None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:11.034013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 93/179] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:11.038997 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c692e2-b17c-4d34-886f-9f75af6b69bb None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:11.039298 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c692e2-b17c-4d34-886f-9f75af6b69bb None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:11.039490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f6813-e397-4bf0-8199-f95fd58edfb0 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:11.039604 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c692e2-b17c-4d34-886f-9f75af6b69bb None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:11.040826 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 94/180] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:11.041920 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7580cb8-f6ce-4f39-835b-61caa6a349a1 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:11.042227 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7580cb8-f6ce-4f39-835b-61caa6a349a1 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:11.042499 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7580cb8-f6ce-4f39-835b-61caa6a349a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:11.063969 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c7580cb8-f6ce-4f39-835b-61caa6a349a1 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:11.065212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c7580cb8-f6ce-4f39-835b-61caa6a349a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:11.080111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27fd8c-63b5-4b62-a497-c03e4ef20a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:11.080967 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27fd8c-63b5-4b62-a497-c03e4ef20a28 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:11.081413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27fd8c-63b5-4b62-a497-c03e4ef20a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:11.081954 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27fd8c-63b5-4b62-a497-c03e4ef20a28 None admin] PATH_INFO: `/v3/projects/3b3e5b21b51d46b7b919b2692877fcf0` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:11.083333 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27fd8c-63b5-4b62-a497-c03e4ef20a28 None admin] RBAC: Authorizing `identity:get_project(project_id=3b3e5b21b51d46b7b919b2692877fcf0)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:11.084986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27fd8c-63b5-4b62-a497-c03e4ef20a28 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:11.085566 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:11.087561 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 87/181] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:10 2022] GET /identity/v3/projects/3b3e5b21b51d46b7b919b2692877fcf0 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:11.090693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27fd8c-63b5-4b62-a497-c03e4ef20a28 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:11.138975 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 95/182] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:11.140297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d400ab-1490-452e-827b-5fab0933c531 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:11.140580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d400ab-1490-452e-827b-5fab0933c531 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:11.140846 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d400ab-1490-452e-827b-5fab0933c531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:11.161364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c9d400ab-1490-452e-827b-5fab0933c531 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:11.162469 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c9d400ab-1490-452e-827b-5fab0933c531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:11.241248 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 96/183] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:11.241416 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27fd8c-63b5-4b62-a497-c03e4ef20a28 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:11.241798 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d793a2-ad5a-4ae8-a3df-e255aed846b7 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:11.241798 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d793a2-ad5a-4ae8-a3df-e255aed846b7 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:11.241798 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d793a2-ad5a-4ae8-a3df-e255aed846b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:11.262070 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-47d793a2-ad5a-4ae8-a3df-e255aed846b7 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:11.263350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-47d793a2-ad5a-4ae8-a3df-e255aed846b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:11.273181 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:11.280694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0315c4-ed05-400d-998a-bc75f49b19bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:11.291189 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0315c4-ed05-400d-998a-bc75f49b19bc None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:11.291189 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0315c4-ed05-400d-998a-bc75f49b19bc None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:11.291189 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0315c4-ed05-400d-998a-bc75f49b19bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:11.335388 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 97/184] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:11.336496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d793a2-ad5a-4ae8-a3df-e255aed846b7 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:11.354438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:11.363483 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0315c4-ed05-400d-998a-bc75f49b19bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:11.365247 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0315c4-ed05-400d-998a-bc75f49b19bc None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:11.462080 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d793a2-ad5a-4ae8-a3df-e255aed846b7 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:11.475129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 88/185] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:14:11.476425 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0315c4-ed05-400d-998a-bc75f49b19bc None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:11.504881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6119289-61ef-483d-8ba2-c3d6cafa4f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:11.505523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6119289-61ef-483d-8ba2-c3d6cafa4f0c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:11.505943 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6119289-61ef-483d-8ba2-c3d6cafa4f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:11.506161 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6119289-61ef-483d-8ba2-c3d6cafa4f0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:11.506898 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6119289-61ef-483d-8ba2-c3d6cafa4f0c None admin] RBAC: Adding query filter params (role.id=d818d9cd93494e0b8e7b6d6539bc808d, scope.project.id=3b3e5b21b51d46b7b919b2692877fcf0, user.id=93259f28708c46c3b1101160a1a44db1) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:11.507492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6119289-61ef-483d-8ba2-c3d6cafa4f0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:11.508740 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6119289-61ef-483d-8ba2-c3d6cafa4f0c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:11.511446 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:11.516440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 98/186] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:14:11 2022] GET /identity/v3/role_assignments?user.id=93259f28708c46c3b1101160a1a44db1&scope.project.id=3b3e5b21b51d46b7b919b2692877fcf0&role.id=d818d9cd93494e0b8e7b6d6539bc808d => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:11.517166 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6119289-61ef-483d-8ba2-c3d6cafa4f0c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:11.605312 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0315c4-ed05-400d-998a-bc75f49b19bc None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:11.631089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:11.644870 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debcc16-16af-49c0-9690-1644c0d87ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:11.645896 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debcc16-16af-49c0-9690-1644c0d87ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:11.646344 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debcc16-16af-49c0-9690-1644c0d87ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:11.646762 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debcc16-16af-49c0-9690-1644c0d87ee5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:11.658058 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6119289-61ef-483d-8ba2-c3d6cafa4f0c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:11.660138 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0debcc16-16af-49c0-9690-1644c0d87ee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:11.665629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-0debcc16-16af-49c0-9690-1644c0d87ee5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:14:11.665629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:11.665629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:11.665629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:11.665629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:11.665629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:11.665629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:11.665629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:11.665629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:11.665629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:11.665629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:11.665629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:11.665629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:11.665629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:11.665629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:11.665629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:11.666590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:11.666590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:11.666590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:11.666590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:11.666590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:11.666590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:11.666590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:11.666590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:11.666590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:11.666590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:11.666590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:11.666590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:11.666590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:11.666590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:11.666590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:11.666590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:11.672195 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:11.672195 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:11.672195 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:11.672195 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:11.672195 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:11.672195 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:11.672195 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:11.672195 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:11.672195 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:11.672195 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:11.672195 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:14:11.672195 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:11.672195 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 89/187] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:14:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:11.672195 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debcc16-16af-49c0-9690-1644c0d87ee5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:11.704829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22dc01-5666-49cc-9fe3-e2edf97771f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:11.706828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22dc01-5666-49cc-9fe3-e2edf97771f9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:11.706828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22dc01-5666-49cc-9fe3-e2edf97771f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:11.706828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22dc01-5666-49cc-9fe3-e2edf97771f9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:11.717106 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22dc01-5666-49cc-9fe3-e2edf97771f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:11.721888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-3d22dc01-5666-49cc-9fe3-e2edf97771f9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 14:14:11.721888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:11.721888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:11.721888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:11.721888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:11.721888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:11.721888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:11.721888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:11.721888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:11.721888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:11.721888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:11.721888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:11.721888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:11.721888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:11.721888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:11.721888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:11.723651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:11.723651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:11.723651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:11.723651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:11.723651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:11.723651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:11.723651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:11.723651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:11.723651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:11.723651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:11.723651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:11.723651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:11.723651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:11.723651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:11.723651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:11.723651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:11.725344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:11.725344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:11.725344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:11.725344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:11.725344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:11.725344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:11.725344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:11.725344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:11.725344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:11.725344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:11.725344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 14:14:11.725344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:11.725344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 99/188] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:11.725344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22dc01-5666-49cc-9fe3-e2edf97771f9 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:11.788897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:11.797612 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debcc16-16af-49c0-9690-1644c0d87ee5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:11.832859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431a5ff-11c7-4bc6-a28f-b44aa711a8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:11.833512 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431a5ff-11c7-4bc6-a28f-b44aa711a8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:11.833790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431a5ff-11c7-4bc6-a28f-b44aa711a8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:11.834060 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431a5ff-11c7-4bc6-a28f-b44aa711a8c7 None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:11.835182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431a5ff-11c7-4bc6-a28f-b44aa711a8c7 None admin] RBAC: Authorizing `identity:get_project(project_id=3d25847b7b534c73bfb985bc2a1852cc)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:11.835540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22dc01-5666-49cc-9fe3-e2edf97771f9 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:11.836640 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431a5ff-11c7-4bc6-a28f-b44aa711a8c7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:11.838287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 90/189] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:11 2022] GET /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:11.841922 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431a5ff-11c7-4bc6-a28f-b44aa711a8c7 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:11.869417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d20756-1d20-405e-895c-55630f9da236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:11.870039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d20756-1d20-405e-895c-55630f9da236 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:11.870383 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d20756-1d20-405e-895c-55630f9da236 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:11.870658 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d20756-1d20-405e-895c-55630f9da236 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:11.877932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:11.880750 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d20756-1d20-405e-895c-55630f9da236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:11.885521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-d9d20756-1d20-405e-895c-55630f9da236 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:11.885521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:11.885521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:11.885521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:11.885521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:11.885521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:11.885521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:11.885521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:11.885521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:11.885521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:11.885521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:11.885521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:11.885521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:11.885521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:11.885521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:11.885521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:11.887271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:11.887271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:11.887271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:11.887271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:11.887271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:11.887271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:11.887271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:11.887271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:11.887271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:11.887271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:11.887271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:11.887271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:11.887271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:11.887271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:11.887271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:11.887271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:11.888035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:11.888035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:11.888035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:11.888035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:11.888035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:11.888035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:11.888035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:11.888035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:11.888035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:11.888035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:11.888035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:11.888035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:11.888035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 100/190] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 5 14:14:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:11.889802 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d20756-1d20-405e-895c-55630f9da236 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:11.941148 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431a5ff-11c7-4bc6-a28f-b44aa711a8c7 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:11.976309 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cc26e-3357-4468-948d-db7b69e22545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:11.976867 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cc26e-3357-4468-948d-db7b69e22545 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:11.977183 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cc26e-3357-4468-948d-db7b69e22545 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:11.977458 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cc26e-3357-4468-948d-db7b69e22545 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:11.980530 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cc26e-3357-4468-948d-db7b69e22545 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:11.982035 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cc26e-3357-4468-948d-db7b69e22545 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:11.983617 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 91/191] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:14:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:11.988092 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cc26e-3357-4468-948d-db7b69e22545 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:11.990717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d20756-1d20-405e-895c-55630f9da236 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:12.015500 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:12.026266 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3de7a-df53-4750-b600-d038c968a973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:12.028050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3de7a-df53-4750-b600-d038c968a973 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:12.031334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3de7a-df53-4750-b600-d038c968a973 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:12.031334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3de7a-df53-4750-b600-d038c968a973 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:12.031334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3de7a-df53-4750-b600-d038c968a973 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:12.031334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3de7a-df53-4750-b600-d038c968a973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:12.031334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3de7a-df53-4750-b600-d038c968a973 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:12.039005 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 101/192] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:12.039783 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3de7a-df53-4750-b600-d038c968a973 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:12.090231 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cc26e-3357-4468-948d-db7b69e22545 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:12.100722 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:12.124295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15b076-3186-44f6-8807-2c2940c09923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:12.124899 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15b076-3186-44f6-8807-2c2940c09923 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:12.125238 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15b076-3186-44f6-8807-2c2940c09923 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:12.125511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15b076-3186-44f6-8807-2c2940c09923 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:12.126166 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15b076-3186-44f6-8807-2c2940c09923 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:12.126465 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15b076-3186-44f6-8807-2c2940c09923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:12.127830 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15b076-3186-44f6-8807-2c2940c09923 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:12.136308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 92/193] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:12.138011 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15b076-3186-44f6-8807-2c2940c09923 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:12.140189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3de7a-df53-4750-b600-d038c968a973 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:12.173032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9b508-57b5-4206-94a9-233ad78cb2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:12.173656 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9b508-57b5-4206-94a9-233ad78cb2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:12.173928 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9b508-57b5-4206-94a9-233ad78cb2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:12.174193 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9b508-57b5-4206-94a9-233ad78cb2d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:12.174907 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9b508-57b5-4206-94a9-233ad78cb2d3 None admin] RBAC: Adding query filter params (role.id=a1ffbcf6f60f4aea99c7eb1dbcb34582, scope.project.id=3d25847b7b534c73bfb985bc2a1852cc, user.id=93259f28708c46c3b1101160a1a44db1) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:12.175217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9b508-57b5-4206-94a9-233ad78cb2d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:12.176918 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9b508-57b5-4206-94a9-233ad78cb2d3 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:12.182631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 102/194] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:14:12 2022] GET /identity/v3/role_assignments?user.id=93259f28708c46c3b1101160a1a44db1&scope.project.id=3d25847b7b534c73bfb985bc2a1852cc&role.id=a1ffbcf6f60f4aea99c7eb1dbcb34582 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:12.183713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9b508-57b5-4206-94a9-233ad78cb2d3 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:12.245094 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:12.256303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15b076-3186-44f6-8807-2c2940c09923 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:12.303931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c6e99-75e9-43d9-a5d8-42f475c4cd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:12.304561 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c6e99-75e9-43d9-a5d8-42f475c4cd0c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:12.304846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c6e99-75e9-43d9-a5d8-42f475c4cd0c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:12.305146 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c6e99-75e9-43d9-a5d8-42f475c4cd0c None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:12.305829 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c6e99-75e9-43d9-a5d8-42f475c4cd0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:12.306136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c6e99-75e9-43d9-a5d8-42f475c4cd0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:12.308205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c6e99-75e9-43d9-a5d8-42f475c4cd0c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:12.320802 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 93/195] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:14:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:12.325256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c6e99-75e9-43d9-a5d8-42f475c4cd0c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:12.327400 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9b508-57b5-4206-94a9-233ad78cb2d3 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:12.356724 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:12.365960 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2091a-1517-4542-b358-3c35def65f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:12.366585 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2091a-1517-4542-b358-3c35def65f3a None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:12.366863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2091a-1517-4542-b358-3c35def65f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:12.367136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2091a-1517-4542-b358-3c35def65f3a None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:12.367793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2091a-1517-4542-b358-3c35def65f3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:12.369300 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2091a-1517-4542-b358-3c35def65f3a None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:12.436531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c6e99-75e9-43d9-a5d8-42f475c4cd0c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:12.455268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 103/196] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 5 14:14:12 2022] POST /identity/v3/users => generated 297 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:14:12.466159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2091a-1517-4542-b358-3c35def65f3a None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:12.471591 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5b076-93b9-4c15-839d-33379ac59f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:12.472244 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5b076-93b9-4c15-839d-33379ac59f9e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:12.472521 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5b076-93b9-4c15-839d-33379ac59f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:12.472787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5b076-93b9-4c15-839d-33379ac59f9e None admin] PATH_INFO: `/v3/users/f8c1608a657544b7ac772ecf9fc92dff` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:12.492787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5b076-93b9-4c15-839d-33379ac59f9e None admin] RBAC: Authorizing `identity:get_user(user_id=f8c1608a657544b7ac772ecf9fc92dff)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:12.494240 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5b076-93b9-4c15-839d-33379ac59f9e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:12.496671 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 94/197] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:12 2022] GET /identity/v3/users/f8c1608a657544b7ac772ecf9fc92dff => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:12.497272 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5b076-93b9-4c15-839d-33379ac59f9e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:12.509842 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:12.585426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2091a-1517-4542-b358-3c35def65f3a None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:12.617047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5b076-93b9-4c15-839d-33379ac59f9e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:12.627860 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af2bf6-a3ee-45f6-821d-982a64064651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:12.628502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af2bf6-a3ee-45f6-821d-982a64064651 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:12.628792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af2bf6-a3ee-45f6-821d-982a64064651 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:12.629041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af2bf6-a3ee-45f6-821d-982a64064651 None admin] PATH_INFO: `/v3/users/5ab2c3ccd994410b9b324438a050f121` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:12.630944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af2bf6-a3ee-45f6-821d-982a64064651 None admin] RBAC: Authorizing `identity:get_user(user_id=5ab2c3ccd994410b9b324438a050f121)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:12.632404 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af2bf6-a3ee-45f6-821d-982a64064651 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:12.634034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 104/198] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:12 2022] GET /identity/v3/users/5ab2c3ccd994410b9b324438a050f121 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:12.634792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af2bf6-a3ee-45f6-821d-982a64064651 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:12.664287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21a5fa-737a-4dd4-8204-cfd901439bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:12.664921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21a5fa-737a-4dd4-8204-cfd901439bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:12.665229 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21a5fa-737a-4dd4-8204-cfd901439bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:12.665499 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21a5fa-737a-4dd4-8204-cfd901439bd7 None admin] PATH_INFO: `/v3/users/f8c1608a657544b7ac772ecf9fc92dff` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:12.666617 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21a5fa-737a-4dd4-8204-cfd901439bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=f8c1608a657544b7ac772ecf9fc92dff)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:12.668625 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21a5fa-737a-4dd4-8204-cfd901439bd7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:12.670418 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 95/199] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:12 2022] GET /identity/v3/users/f8c1608a657544b7ac772ecf9fc92dff => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:12.673993 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21a5fa-737a-4dd4-8204-cfd901439bd7 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:12.703046 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:12.776319 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af2bf6-a3ee-45f6-821d-982a64064651 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:12.790188 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:12.817293 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21a5fa-737a-4dd4-8204-cfd901439bd7 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:12.820914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afae0ab-4827-41ad-b30c-05ff2c607de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:12.821572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afae0ab-4827-41ad-b30c-05ff2c607de4 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:12.821856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afae0ab-4827-41ad-b30c-05ff2c607de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:12.822131 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afae0ab-4827-41ad-b30c-05ff2c607de4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:12.856965 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9ff3f-78ab-4cea-a7cb-c9ad7fa358f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:12.857699 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9ff3f-78ab-4cea-a7cb-c9ad7fa358f3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:12.857982 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9ff3f-78ab-4cea-a7cb-c9ad7fa358f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:12.858316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9ff3f-78ab-4cea-a7cb-c9ad7fa358f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:12.897598 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afae0ab-4827-41ad-b30c-05ff2c607de4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:12.899075 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afae0ab-4827-41ad-b30c-05ff2c607de4 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:12.933989 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9ff3f-78ab-4cea-a7cb-c9ad7fa358f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:12.935651 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9ff3f-78ab-4cea-a7cb-c9ad7fa358f3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:12.951807 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:13.004127 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 105/200] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:14:13.005087 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afae0ab-4827-41ad-b30c-05ff2c607de4 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:13.021459 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:13.047151 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 96/201] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:14:13.048405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9ff3f-78ab-4cea-a7cb-c9ad7fa358f3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:13.109519 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afae0ab-4827-41ad-b30c-05ff2c607de4 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:13.146527 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7b4af-ea41-4668-9cb6-774e222288c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:13.147199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7b4af-ea41-4668-9cb6-774e222288c8 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:13.147495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7b4af-ea41-4668-9cb6-774e222288c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:13.148068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7b4af-ea41-4668-9cb6-774e222288c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:13.161438 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9ff3f-78ab-4cea-a7cb-c9ad7fa358f3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:13.169197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:13.209535 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78430096-9dc9-44cd-91b3-a11a19d8e1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:13.210557 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78430096-9dc9-44cd-91b3-a11a19d8e1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:13.211049 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78430096-9dc9-44cd-91b3-a11a19d8e1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:13.211618 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78430096-9dc9-44cd-91b3-a11a19d8e1e7 None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:13.213050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78430096-9dc9-44cd-91b3-a11a19d8e1e7 None admin] RBAC: Authorizing `identity:get_project(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:13.215807 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78430096-9dc9-44cd-91b3-a11a19d8e1e7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:13.217701 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 97/202] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:13 2022] GET /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:13.218668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78430096-9dc9-44cd-91b3-a11a19d8e1e7 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:13.222292 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7b4af-ea41-4668-9cb6-774e222288c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:13.224069 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7b4af-ea41-4668-9cb6-774e222288c8 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:13.271361 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:13.332862 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78430096-9dc9-44cd-91b3-a11a19d8e1e7 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:13.334866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 106/203] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:14:13.335954 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7b4af-ea41-4668-9cb6-774e222288c8 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:13.371521 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483339b-1435-464d-9803-71fd12a05909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:13.372765 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483339b-1435-464d-9803-71fd12a05909 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:13.372914 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483339b-1435-464d-9803-71fd12a05909 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:13.373291 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483339b-1435-464d-9803-71fd12a05909 None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:13.374528 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483339b-1435-464d-9803-71fd12a05909 None admin] RBAC: Authorizing `identity:get_project(project_id=3d25847b7b534c73bfb985bc2a1852cc)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:13.376097 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483339b-1435-464d-9803-71fd12a05909 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:13.378127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 98/204] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:13 2022] GET /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:13.378951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483339b-1435-464d-9803-71fd12a05909 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:13.390125 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:13.442555 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7b4af-ea41-4668-9cb6-774e222288c8 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:13.480513 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1960e6-1c39-4db4-93bb-6a3b065c904a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:13.481447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1960e6-1c39-4db4-93bb-6a3b065c904a None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:13.481959 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1960e6-1c39-4db4-93bb-6a3b065c904a None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:13.482416 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1960e6-1c39-4db4-93bb-6a3b065c904a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:13.483456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1960e6-1c39-4db4-93bb-6a3b065c904a None admin] RBAC: Adding query filter params (role.id=f22e6e660eab44c5be25e3dee1e3042c, scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c, user.id=f8c1608a657544b7ac772ecf9fc92dff) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:13.484001 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1960e6-1c39-4db4-93bb-6a3b065c904a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:13.485820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1960e6-1c39-4db4-93bb-6a3b065c904a None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:13.489725 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483339b-1435-464d-9803-71fd12a05909 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:13.492362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 107/205] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:14:13 2022] GET /identity/v3/role_assignments?user.id=f8c1608a657544b7ac772ecf9fc92dff&scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c&role.id=f22e6e660eab44c5be25e3dee1e3042c => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:13.493434 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1960e6-1c39-4db4-93bb-6a3b065c904a None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:13.506060 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:13.530964 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c960f8f-0021-44da-a2be-2bb2787ce197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:13.531625 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c960f8f-0021-44da-a2be-2bb2787ce197 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:13.532017 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c960f8f-0021-44da-a2be-2bb2787ce197 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:13.532295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c960f8f-0021-44da-a2be-2bb2787ce197 None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:13.533750 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c960f8f-0021-44da-a2be-2bb2787ce197 None admin] RBAC: Authorizing `identity:get_project(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:13.535436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c960f8f-0021-44da-a2be-2bb2787ce197 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:13.537029 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 99/206] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:13 2022] GET /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:13.543967 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c960f8f-0021-44da-a2be-2bb2787ce197 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:13.609738 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1960e6-1c39-4db4-93bb-6a3b065c904a None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:13.626693 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:13.660452 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b183d7-71ae-4941-9754-3273ed4c9ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:13.661544 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b183d7-71ae-4941-9754-3273ed4c9ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:13.662045 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b183d7-71ae-4941-9754-3273ed4c9ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:13.662556 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b183d7-71ae-4941-9754-3273ed4c9ab2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:13.663507 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b183d7-71ae-4941-9754-3273ed4c9ab2 None admin] RBAC: Adding query filter params (role.id=35ba371f3216414e950ba78ba9587bed, scope.project.id=3d25847b7b534c73bfb985bc2a1852cc, user.id=5ab2c3ccd994410b9b324438a050f121) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:13.664014 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b183d7-71ae-4941-9754-3273ed4c9ab2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:13.665863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b183d7-71ae-4941-9754-3273ed4c9ab2 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:13.673363 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 108/207] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:14:13 2022] GET /identity/v3/role_assignments?user.id=5ab2c3ccd994410b9b324438a050f121&scope.project.id=3d25847b7b534c73bfb985bc2a1852cc&role.id=35ba371f3216414e950ba78ba9587bed => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:13.676423 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c960f8f-0021-44da-a2be-2bb2787ce197 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:13.723406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b06ec9c-fe54-484d-beac-7722a229332f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:13.724026 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06ec9c-fe54-484d-beac-7722a229332f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:13.724303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06ec9c-fe54-484d-beac-7722a229332f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:13.724624 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06ec9c-fe54-484d-beac-7722a229332f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:13.725392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06ec9c-fe54-484d-beac-7722a229332f None admin] RBAC: Adding query filter params (role.id=a1ffbcf6f60f4aea99c7eb1dbcb34582, scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c, user.id=f8c1608a657544b7ac772ecf9fc92dff) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:13.725752 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06ec9c-fe54-484d-beac-7722a229332f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:13.727278 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b06ec9c-fe54-484d-beac-7722a229332f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:13.733788 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 100/208] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:14:13 2022] GET /identity/v3/role_assignments?user.id=f8c1608a657544b7ac772ecf9fc92dff&scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c&role.id=a1ffbcf6f60f4aea99c7eb1dbcb34582 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:14.725586 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d936a4-6f36-436e-b9d6-fb20c93a8e54 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:14.726124 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d936a4-6f36-436e-b9d6-fb20c93a8e54 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:14.726124 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d936a4-6f36-436e-b9d6-fb20c93a8e54 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:14.727583 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 109/209] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:14.733142 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579db15-a7b5-431c-b010-72f45ad3abad None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:14.733944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579db15-a7b5-431c-b010-72f45ad3abad None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:14.734420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579db15-a7b5-431c-b010-72f45ad3abad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:14.742690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a90f0-4768-4ed3-b941-9f4009906661 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:14.743058 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a90f0-4768-4ed3-b941-9f4009906661 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:14.743407 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a90f0-4768-4ed3-b941-9f4009906661 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:14.745644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 110/210] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:14.754614 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e24db4-2898-4f43-a4f8-b026ec06e0b7 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:14.755031 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e24db4-2898-4f43-a4f8-b026ec06e0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:14.755405 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e24db4-2898-4f43-a4f8-b026ec06e0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:14.758293 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7579db15-a7b5-431c-b010-72f45ad3abad None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:14.759965 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7579db15-a7b5-431c-b010-72f45ad3abad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:14.775637 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-71e24db4-2898-4f43-a4f8-b026ec06e0b7 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:14.777718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-71e24db4-2898-4f43-a4f8-b026ec06e0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:14.827140 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:14.857271 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 101/212] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:14.857637 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 111/212] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:15.117775 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579db15-a7b5-431c-b010-72f45ad3abad None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:15.130189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e24db4-2898-4f43-a4f8-b026ec06e0b7 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:15.238216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e24db4-2898-4f43-a4f8-b026ec06e0b7 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:15.249100 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:15.251319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579db15-a7b5-431c-b010-72f45ad3abad None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:15.275721 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e9e84-ccbb-484e-a0b1-a0fd21bdb7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:15.277467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e9e84-ccbb-484e-a0b1-a0fd21bdb7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:15.278007 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e9e84-ccbb-484e-a0b1-a0fd21bdb7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:15.278535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e9e84-ccbb-484e-a0b1-a0fd21bdb7e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:15.290805 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e9e84-ccbb-484e-a0b1-a0fd21bdb7e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:15.292968 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105278fd-624c-4bb9-9455-1c54d7a2b8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:15.293629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105278fd-624c-4bb9-9455-1c54d7a2b8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:15.293905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105278fd-624c-4bb9-9455-1c54d7a2b8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:15.294173 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105278fd-624c-4bb9-9455-1c54d7a2b8a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:15.295294 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105278fd-624c-4bb9-9455-1c54d7a2b8a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:15.296729 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105278fd-624c-4bb9-9455-1c54d7a2b8a9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:15.297589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-a79e9e84-ccbb-484e-a0b1-a0fd21bdb7e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:15.297589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:15.297589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:15.297589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:15.297589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:15.297589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:15.297589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:15.297589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:15.297589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:15.297589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:15.297589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:15.297589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:15.297589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:15.297589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:15.297589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:15.297589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:15.298444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:15.298444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:15.298444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:15.298444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:15.298444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:15.298444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:15.298444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:15.298444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:15.298444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:15.298444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:15.298444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:15.298444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:15.298444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:15.298444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:15.298444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:15.298444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:15.299228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:15.299228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:15.299228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:15.299228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:15.299228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:15.299228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:15.299228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:15.299228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:15.299228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:15.299228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:15.299228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:15.299228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:15.299851 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 102/213] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:14:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:15.302166 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 112/214] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:14:15.306939 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105278fd-624c-4bb9-9455-1c54d7a2b8a9 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:15.310296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e9e84-ccbb-484e-a0b1-a0fd21bdb7e5 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:15.366427 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:15.430049 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e9e84-ccbb-484e-a0b1-a0fd21bdb7e5 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:15.431168 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105278fd-624c-4bb9-9455-1c54d7a2b8a9 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:15.467694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec016ff-9af5-4294-bcbd-f6ba3d165e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:15.468301 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec016ff-9af5-4294-bcbd-f6ba3d165e40 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:15.468582 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec016ff-9af5-4294-bcbd-f6ba3d165e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:15.468850 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec016ff-9af5-4294-bcbd-f6ba3d165e40 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:15.469533 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec016ff-9af5-4294-bcbd-f6ba3d165e40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:15.470077 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a51ce-084e-4d73-ae83-0faaf14f9878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:15.470912 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a51ce-084e-4d73-ae83-0faaf14f9878 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:15.471015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec016ff-9af5-4294-bcbd-f6ba3d165e40 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:15.471562 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a51ce-084e-4d73-ae83-0faaf14f9878 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:15.472040 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a51ce-084e-4d73-ae83-0faaf14f9878 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:15.472921 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a51ce-084e-4d73-ae83-0faaf14f9878 None admin] RBAC: Adding query filter params (name=member) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:15.473568 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a51ce-084e-4d73-ae83-0faaf14f9878 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:15.475155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a51ce-084e-4d73-ae83-0faaf14f9878 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:15.484950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 113/215] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:15.490879 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a51ce-084e-4d73-ae83-0faaf14f9878 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:15.523659 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:15.545585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 103/216] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 5 14:14:15 2022] POST /identity/v3/users => generated 297 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:14:15.620239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a51ce-084e-4d73-ae83-0faaf14f9878 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:15.652018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f52931-ac4a-4f55-8412-efc5b1b170a9 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:15.652634 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f52931-ac4a-4f55-8412-efc5b1b170a9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:15.653274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f52931-ac4a-4f55-8412-efc5b1b170a9 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:15.657209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 104/217] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:14:15.660801 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f244dcc-c5dd-41f4-a39d-a40b2b89f68d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:15.661463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f244dcc-c5dd-41f4-a39d-a40b2b89f68d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:15.661463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f244dcc-c5dd-41f4-a39d-a40b2b89f68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:15.667766 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c7d23-fe90-4c19-aa78-09e7ca96cf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:15.668911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c7d23-fe90-4c19-aa78-09e7ca96cf35 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:15.669760 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c7d23-fe90-4c19-aa78-09e7ca96cf35 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:15.670235 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c7d23-fe90-4c19-aa78-09e7ca96cf35 None admin] PATH_INFO: `/v3/users/ec9ceb9a7609446793d4f37af4db8024` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:15.683836 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-0f244dcc-c5dd-41f4-a39d-a40b2b89f68d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:15.685366 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0f244dcc-c5dd-41f4-a39d-a40b2b89f68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:15.694320 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c7d23-fe90-4c19-aa78-09e7ca96cf35 None admin] RBAC: Authorizing `identity:get_user(user_id=ec9ceb9a7609446793d4f37af4db8024)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:15.695813 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c7d23-fe90-4c19-aa78-09e7ca96cf35 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:15.702623 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 114/218] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:15 2022] GET /identity/v3/users/ec9ceb9a7609446793d4f37af4db8024 => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:15.704345 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c7d23-fe90-4c19-aa78-09e7ca96cf35 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:15.780152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 105/219] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:14:15.782061 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263223aa-2f74-4ded-8a35-b242928d0a5c None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:15.782346 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263223aa-2f74-4ded-8a35-b242928d0a5c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:15.782624 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263223aa-2f74-4ded-8a35-b242928d0a5c None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:15.783987 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 106/220] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:15.793536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24531f7-6d55-4cda-bb3b-39a97f826a0b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:15.794645 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24531f7-6d55-4cda-bb3b-39a97f826a0b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:15.795135 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24531f7-6d55-4cda-bb3b-39a97f826a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:15.808610 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:15.819831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a24531f7-6d55-4cda-bb3b-39a97f826a0b None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:15.825995 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a24531f7-6d55-4cda-bb3b-39a97f826a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:15.826101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c7d23-fe90-4c19-aa78-09e7ca96cf35 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:15.851676 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:15.873811 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edff8a6-72f6-4119-8b2c-f018229494cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:15.874566 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edff8a6-72f6-4119-8b2c-f018229494cd None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:15.874928 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edff8a6-72f6-4119-8b2c-f018229494cd None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:15.875322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edff8a6-72f6-4119-8b2c-f018229494cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:15.916841 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 107/221] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:14:15.967464 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edff8a6-72f6-4119-8b2c-f018229494cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:15.969281 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edff8a6-72f6-4119-8b2c-f018229494cd None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:16.069417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:16.076183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 115/222] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:14:16.082015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24531f7-6d55-4cda-bb3b-39a97f826a0b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:16.086946 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edff8a6-72f6-4119-8b2c-f018229494cd None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:16.212972 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edff8a6-72f6-4119-8b2c-f018229494cd None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:16.242189 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24531f7-6d55-4cda-bb3b-39a97f826a0b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:16.250493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9c0ac-30c5-4a97-af39-27b2fd69c3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:16.251319 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9c0ac-30c5-4a97-af39-27b2fd69c3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:16.251759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9c0ac-30c5-4a97-af39-27b2fd69c3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:16.252163 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9c0ac-30c5-4a97-af39-27b2fd69c3f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:16.263188 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9c0ac-30c5-4a97-af39-27b2fd69c3f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:16.268172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-ddf9c0ac-30c5-4a97-af39-27b2fd69c3f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:14:16.268172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:16.268172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:16.268172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:16.268172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:16.268172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:16.268172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:16.268172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:16.268172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:16.268172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:16.268172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:16.268172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:16.268172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:16.268172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:16.268172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:16.268172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:16.269237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:16.269237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:16.269237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:16.269237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:16.269237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:16.269237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:16.269237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:16.269237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:16.269237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:16.269237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:16.269237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:16.269237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:16.269237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:16.269237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:16.269237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:16.269237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:16.270172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:16.270172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:16.270172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:16.270172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:16.270172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:16.270172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:16.270172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:16.270172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:16.270172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:16.270172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:16.270172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:14:16.270172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:16.272243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 116/223] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:14:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:16.278186 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9c0ac-30c5-4a97-af39-27b2fd69c3f9 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:16.280780 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87808c0b-474b-42de-80bb-2d17ccbe3b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:16.281440 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87808c0b-474b-42de-80bb-2d17ccbe3b62 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:16.281718 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87808c0b-474b-42de-80bb-2d17ccbe3b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:16.281988 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87808c0b-474b-42de-80bb-2d17ccbe3b62 None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:16.283107 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87808c0b-474b-42de-80bb-2d17ccbe3b62 None admin] RBAC: Authorizing `identity:get_project(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:16.284872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87808c0b-474b-42de-80bb-2d17ccbe3b62 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:16.286205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 108/224] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:16 2022] GET /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:16.286952 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87808c0b-474b-42de-80bb-2d17ccbe3b62 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:16.317259 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:16.333887 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:16.391668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9c0ac-30c5-4a97-af39-27b2fd69c3f9 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:16.393009 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87808c0b-474b-42de-80bb-2d17ccbe3b62 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:16.429082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2da0c-45a3-475a-acbb-de304c73d3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:16.429703 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2da0c-45a3-475a-acbb-de304c73d3fb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:16.429995 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2da0c-45a3-475a-acbb-de304c73d3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:16.430331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2da0c-45a3-475a-acbb-de304c73d3fb None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:16.430971 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5c63e-d00c-476b-811a-0b85fe2081e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:16.431086 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2da0c-45a3-475a-acbb-de304c73d3fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:16.431291 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2da0c-45a3-475a-acbb-de304c73d3fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:16.432034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5c63e-d00c-476b-811a-0b85fe2081e8 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:16.432492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5c63e-d00c-476b-811a-0b85fe2081e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:16.432739 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2da0c-45a3-475a-acbb-de304c73d3fb None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:16.433184 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5c63e-d00c-476b-811a-0b85fe2081e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:16.446272 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 109/225] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:16.446272 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2da0c-45a3-475a-acbb-de304c73d3fb None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:16.450288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5c63e-d00c-476b-811a-0b85fe2081e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:16.455557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-2fa5c63e-d00c-476b-811a-0b85fe2081e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:16.455557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:16.455557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:16.455557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:16.455557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:16.455557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:16.455557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:16.455557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:16.455557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:16.455557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:16.455557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:16.455557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:16.455557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:16.455557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:16.455557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:16.455557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:16.456422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:16.456422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:16.456422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:16.456422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:16.456422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:16.456422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:16.456422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:16.456422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:16.456422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:16.456422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:16.456422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:16.456422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:16.456422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:16.456422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:16.456422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:16.456422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:16.457238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:16.457238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:16.457238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:16.457238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:16.457238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:16.457238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:16.457238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:16.457238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:16.457238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:16.457238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:16.457238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:16.457238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:16.459747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 117/226] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 5 14:14:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:16.460717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5c63e-d00c-476b-811a-0b85fe2081e8 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:16.536449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:16.545914 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2da0c-45a3-475a-acbb-de304c73d3fb None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:16.567295 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5c63e-d00c-476b-811a-0b85fe2081e8 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:16.578505 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:16.582860 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cda4d-f719-49f9-a4b8-0d3ab7683ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:16.583805 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cda4d-f719-49f9-a4b8-0d3ab7683ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:16.583914 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cda4d-f719-49f9-a4b8-0d3ab7683ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:16.589991 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cda4d-f719-49f9-a4b8-0d3ab7683ac4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:16.589991 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037cda4d-f719-49f9-a4b8-0d3ab7683ac4 None admin] RBAC: Adding query filter params (role.id=d818d9cd93494e0b8e7b6d6539bc808d, scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c, user.id=ec9ceb9a7609446793d4f37af4db8024) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:16.589991 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037cda4d-f719-49f9-a4b8-0d3ab7683ac4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:16.589991 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037cda4d-f719-49f9-a4b8-0d3ab7683ac4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:16.592929 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 110/227] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:14:16 2022] GET /identity/v3/role_assignments?user.id=ec9ceb9a7609446793d4f37af4db8024&scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c&role.id=d818d9cd93494e0b8e7b6d6539bc808d => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:16.593778 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cda4d-f719-49f9-a4b8-0d3ab7683ac4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:16.607493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdab329-a6ee-42c5-b5c0-e397fed54b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:16.608554 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdab329-a6ee-42c5-b5c0-e397fed54b81 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:16.609003 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdab329-a6ee-42c5-b5c0-e397fed54b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:16.609490 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdab329-a6ee-42c5-b5c0-e397fed54b81 None admin] PATH_INFO: `/v3/users/f8c1608a657544b7ac772ecf9fc92dff` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:16.610893 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdab329-a6ee-42c5-b5c0-e397fed54b81 None admin] RBAC: Authorizing `identity:get_user(user_id=f8c1608a657544b7ac772ecf9fc92dff)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:16.612691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdab329-a6ee-42c5-b5c0-e397fed54b81 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:16.614784 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 118/228] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:16 2022] GET /identity/v3/users/f8c1608a657544b7ac772ecf9fc92dff => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:16.620855 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdab329-a6ee-42c5-b5c0-e397fed54b81 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:16.705860 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cda4d-f719-49f9-a4b8-0d3ab7683ac4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:16.733461 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdab329-a6ee-42c5-b5c0-e397fed54b81 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:16.743950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0952f8-d72a-414b-a370-dbdc20e6af29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:16.744576 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0952f8-d72a-414b-a370-dbdc20e6af29 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:16.744853 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0952f8-d72a-414b-a370-dbdc20e6af29 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:16.745228 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0952f8-d72a-414b-a370-dbdc20e6af29 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:16.746640 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0952f8-d72a-414b-a370-dbdc20e6af29 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:16.746944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0952f8-d72a-414b-a370-dbdc20e6af29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:16.748649 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0952f8-d72a-414b-a370-dbdc20e6af29 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:16.758464 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 111/229] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:14:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:16.764504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0952f8-d72a-414b-a370-dbdc20e6af29 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:16.776182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd17de1-a82a-4f10-9e58-30be003ab730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:16.777804 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd17de1-a82a-4f10-9e58-30be003ab730 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:16.778340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd17de1-a82a-4f10-9e58-30be003ab730 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:16.778808 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd17de1-a82a-4f10-9e58-30be003ab730 None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:16.780590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd17de1-a82a-4f10-9e58-30be003ab730 None admin] RBAC: Authorizing `identity:get_project(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:16.782433 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd17de1-a82a-4f10-9e58-30be003ab730 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:16.784746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 119/230] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:16 2022] GET /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:16.790276 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:16.793050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd17de1-a82a-4f10-9e58-30be003ab730 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:16.847904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:16.879552 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0952f8-d72a-414b-a370-dbdc20e6af29 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:16.905391 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd17de1-a82a-4f10-9e58-30be003ab730 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:16.916199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83945e-6884-415a-882d-cf0faa486fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:16.916836 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83945e-6884-415a-882d-cf0faa486fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:16.917199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83945e-6884-415a-882d-cf0faa486fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:16.917473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83945e-6884-415a-882d-cf0faa486fc2 None admin] PATH_INFO: `/v3/users/f8c1608a657544b7ac772ecf9fc92dff` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:16.918598 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83945e-6884-415a-882d-cf0faa486fc2 None admin] RBAC: Authorizing `identity:get_user(user_id=f8c1608a657544b7ac772ecf9fc92dff)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:16.920038 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83945e-6884-415a-882d-cf0faa486fc2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:16.921795 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 112/231] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:16 2022] GET /identity/v3/users/f8c1608a657544b7ac772ecf9fc92dff => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:16.927262 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83945e-6884-415a-882d-cf0faa486fc2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:16.944184 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7846d-f34c-457f-a8d7-080f9b9eccc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:16.945337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7846d-f34c-457f-a8d7-080f9b9eccc8 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:16.945811 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7846d-f34c-457f-a8d7-080f9b9eccc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:16.946273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7846d-f34c-457f-a8d7-080f9b9eccc8 None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c/users/f8c1608a657544b7ac772ecf9fc92dff/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:16.949000 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7846d-f34c-457f-a8d7-080f9b9eccc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c, user_id=f8c1608a657544b7ac772ecf9fc92dff, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:16.950859 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7846d-f34c-457f-a8d7-080f9b9eccc8 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:17.007351 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 120/232] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:14:16 2022] PUT /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c/users/f8c1608a657544b7ac772ecf9fc92dff/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:14:17.025871 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:17.043999 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83945e-6884-415a-882d-cf0faa486fc2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:17.085911 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bda15-8abf-47ff-8077-66b8669b39b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:17.086552 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bda15-8abf-47ff-8077-66b8669b39b0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:17.086840 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bda15-8abf-47ff-8077-66b8669b39b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:17.087091 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bda15-8abf-47ff-8077-66b8669b39b0 None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:17.088221 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0bda15-8abf-47ff-8077-66b8669b39b0 None admin] RBAC: Authorizing `identity:get_project(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:17.089832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0bda15-8abf-47ff-8077-66b8669b39b0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:17.091791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 113/233] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:16 2022] GET /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:17.097842 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7846d-f34c-457f-a8d7-080f9b9eccc8 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:17.255294 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7846d-f34c-457f-a8d7-080f9b9eccc8 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:17.258594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:17.292813 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c6693-a1d6-4454-8356-a471abac9e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:17.293928 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c6693-a1d6-4454-8356-a471abac9e86 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:17.294254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c6693-a1d6-4454-8356-a471abac9e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:17.294467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c6693-a1d6-4454-8356-a471abac9e86 None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c/users/f8c1608a657544b7ac772ecf9fc92dff/roles/a1ffbcf6f60f4aea99c7eb1dbcb34582` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:17.296640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c6693-a1d6-4454-8356-a471abac9e86 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c, user_id=f8c1608a657544b7ac772ecf9fc92dff, role_id=a1ffbcf6f60f4aea99c7eb1dbcb34582)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:17.298133 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c6693-a1d6-4454-8356-a471abac9e86 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:17.392879 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 121/234] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:14:17 2022] PUT /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c/users/f8c1608a657544b7ac772ecf9fc92dff/roles/a1ffbcf6f60f4aea99c7eb1dbcb34582 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:14:17.891179 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e5739-9af6-4759-99f3-9795c8711327 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:17.891690 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e5739-9af6-4759-99f3-9795c8711327 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:17.891690 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e5739-9af6-4759-99f3-9795c8711327 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:17.893322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 114/235] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:17.913303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3246bc-8564-4393-96ce-2e43c545765e None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:17.913768 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3246bc-8564-4393-96ce-2e43c545765e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:17.913960 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3246bc-8564-4393-96ce-2e43c545765e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:17.934618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-3d3246bc-8564-4393-96ce-2e43c545765e None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:17.935958 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3d3246bc-8564-4393-96ce-2e43c545765e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:18.020484 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 122/236] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:18.177479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545a4f8-61dc-4455-aae7-905f4512f40b None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:18.177769 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545a4f8-61dc-4455-aae7-905f4512f40b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:18.177951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545a4f8-61dc-4455-aae7-905f4512f40b None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:18.179586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 115/237] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:18.185003 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a8b6c-38d0-4c0c-bfae-94afeb81b1ae None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:18.185326 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a8b6c-38d0-4c0c-bfae-94afeb81b1ae None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:18.185599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a8b6c-38d0-4c0c-bfae-94afeb81b1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:18.213363 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-879a8b6c-38d0-4c0c-bfae-94afeb81b1ae None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:18.214621 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-879a8b6c-38d0-4c0c-bfae-94afeb81b1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:18.308693 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 123/238] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:18.398739 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545a4f8-61dc-4455-aae7-905f4512f40b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:18.527178 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545a4f8-61dc-4455-aae7-905f4512f40b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:18.570809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c3291-3336-4b29-9a34-9a8e45cea84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:18.571436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c3291-3336-4b29-9a34-9a8e45cea84e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:18.571711 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c3291-3336-4b29-9a34-9a8e45cea84e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:18.571978 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c3291-3336-4b29-9a34-9a8e45cea84e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:18.582477 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c3291-3336-4b29-9a34-9a8e45cea84e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:18.587201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-381c3291-3336-4b29-9a34-9a8e45cea84e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 14:14:18.587201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:18.587201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:18.587201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:18.587201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:18.587201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:18.587201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:18.587201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:18.587201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:18.587201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:18.587201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:18.587201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:18.587201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:18.587201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:18.587201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:18.587201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:18.588078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:18.588078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:18.588078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:18.588078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:18.588078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:18.588078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:18.588078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:18.588078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:18.588078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:18.588078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:18.588078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:18.588078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:18.588078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:18.588078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:18.588078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:18.588078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:18.589774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:18.589774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:18.589774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:18.589774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:18.589774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:18.589774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:18.589774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:18.589774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:18.589774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:18.589774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:18.589774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 14:14:18.589774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:18.589774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 116/239] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:18.596614 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a8b6c-38d0-4c0c-bfae-94afeb81b1ae None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:18.634126 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c3291-3336-4b29-9a34-9a8e45cea84e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:18.648639 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:18.652727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:18.785932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a8b6c-38d0-4c0c-bfae-94afeb81b1ae None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:18.820083 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c3291-3336-4b29-9a34-9a8e45cea84e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:18.851917 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54551b60-f4da-4848-9a24-ffe958374e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:18.852532 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54551b60-f4da-4848-9a24-ffe958374e6b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:18.852808 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54551b60-f4da-4848-9a24-ffe958374e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:18.853161 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54551b60-f4da-4848-9a24-ffe958374e6b None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:18.853840 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54551b60-f4da-4848-9a24-ffe958374e6b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:18.854140 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54551b60-f4da-4848-9a24-ffe958374e6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:18.856275 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54551b60-f4da-4848-9a24-ffe958374e6b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:18.869728 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 124/240] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:18.875015 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54551b60-f4da-4848-9a24-ffe958374e6b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:18.882670 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615841cd-09f9-4600-b330-dba098356fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:18.883495 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615841cd-09f9-4600-b330-dba098356fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:18.883899 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615841cd-09f9-4600-b330-dba098356fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:18.884294 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615841cd-09f9-4600-b330-dba098356fd9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:18.886139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615841cd-09f9-4600-b330-dba098356fd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:18.887882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615841cd-09f9-4600-b330-dba098356fd9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:18.890050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 117/241] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:14:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:18.895543 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615841cd-09f9-4600-b330-dba098356fd9 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:19.012671 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:19.029964 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54551b60-f4da-4848-9a24-ffe958374e6b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:19.079491 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:19.090686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28f23a-094d-4798-9f96-17ef03e567b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:19.091327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28f23a-094d-4798-9f96-17ef03e567b9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:19.091633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28f23a-094d-4798-9f96-17ef03e567b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:19.091905 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28f23a-094d-4798-9f96-17ef03e567b9 None admin] PATH_INFO: `/v3/users/26e83fb2bfa340a983ac3b6fd7bdc04a` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:19.108789 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28f23a-094d-4798-9f96-17ef03e567b9 None admin] RBAC: Authorizing `identity:get_user(user_id=26e83fb2bfa340a983ac3b6fd7bdc04a)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:19.110308 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28f23a-094d-4798-9f96-17ef03e567b9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:19.111978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 125/242] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:18 2022] GET /identity/v3/users/26e83fb2bfa340a983ac3b6fd7bdc04a => generated 297 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:19.118519 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28f23a-094d-4798-9f96-17ef03e567b9 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:19.129799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615841cd-09f9-4600-b330-dba098356fd9 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:19.178419 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e3341-8081-46bb-b419-78b4a35ab78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:19.179452 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e3341-8081-46bb-b419-78b4a35ab78e None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:19.179933 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e3341-8081-46bb-b419-78b4a35ab78e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:19.180400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e3341-8081-46bb-b419-78b4a35ab78e None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:19.181296 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e3341-8081-46bb-b419-78b4a35ab78e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:19.183482 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e3341-8081-46bb-b419-78b4a35ab78e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:19.259913 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28f23a-094d-4798-9f96-17ef03e567b9 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:19.271476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 118/243] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 5 14:14:18 2022] POST /identity/v3/users => generated 293 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:14:19.298398 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a5da1-6dbc-4a2a-a89b-ccc004b33621 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:19.299187 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a5da1-6dbc-4a2a-a89b-ccc004b33621 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:19.299752 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a5da1-6dbc-4a2a-a89b-ccc004b33621 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:19.301776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 119/244] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:14:19.308680 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b7135-ae4a-45a8-8c17-9f2b18beae90 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:19.309388 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b7135-ae4a-45a8-8c17-9f2b18beae90 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:19.309961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b7135-ae4a-45a8-8c17-9f2b18beae90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:19.316194 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f859e8-1250-4b6e-9e05-2645938e299d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:19.316194 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f859e8-1250-4b6e-9e05-2645938e299d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:19.316194 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f859e8-1250-4b6e-9e05-2645938e299d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:19.316516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f859e8-1250-4b6e-9e05-2645938e299d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:19.347500 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c09b7135-ae4a-45a8-8c17-9f2b18beae90 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:19.351093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c09b7135-ae4a-45a8-8c17-9f2b18beae90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:19.357621 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:19.443863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f859e8-1250-4b6e-9e05-2645938e299d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:19.445328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 120/245] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:14:19.445690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f859e8-1250-4b6e-9e05-2645938e299d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:19.447153 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d71037-4174-4509-9b88-25cb3ae73ec0 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:19.447756 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d71037-4174-4509-9b88-25cb3ae73ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:19.448788 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d71037-4174-4509-9b88-25cb3ae73ec0 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:19.450340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 121/246] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:19.458647 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a2e7-9185-440b-b557-9d3d1c1b64da None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:19.459314 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a2e7-9185-440b-b557-9d3d1c1b64da None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:19.459695 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8a2e7-9185-440b-b557-9d3d1c1b64da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:19.480545 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e1c8a2e7-9185-440b-b557-9d3d1c1b64da None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:19.482590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e1c8a2e7-9185-440b-b557-9d3d1c1b64da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:19.566246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 126/247] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:14:19.575855 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f859e8-1250-4b6e-9e05-2645938e299d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:19.576332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:19.585317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 122/248] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:14:19.637343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:19.699178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f859e8-1250-4b6e-9e05-2645938e299d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:19.736764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b6064-cf1d-4892-bd65-d7a3654a2645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:19.737437 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b6064-cf1d-4892-bd65-d7a3654a2645 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:19.737712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b6064-cf1d-4892-bd65-d7a3654a2645 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:19.737982 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b6064-cf1d-4892-bd65-d7a3654a2645 None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:19.739109 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b6064-cf1d-4892-bd65-d7a3654a2645 None admin] RBAC: Authorizing `identity:get_project(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:19.740566 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b6064-cf1d-4892-bd65-d7a3654a2645 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:19.742229 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 127/249] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:19 2022] GET /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:19.748781 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8a2e7-9185-440b-b557-9d3d1c1b64da None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:19.766695 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b6064-cf1d-4892-bd65-d7a3654a2645 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:19.875544 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8a2e7-9185-440b-b557-9d3d1c1b64da None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:19.880522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b6064-cf1d-4892-bd65-d7a3654a2645 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:19.896318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:19.914205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2abf1e-be9e-4250-8471-5ce18d9a592a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:19.914841 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2abf1e-be9e-4250-8471-5ce18d9a592a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:19.915270 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2abf1e-be9e-4250-8471-5ce18d9a592a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:19.915603 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2abf1e-be9e-4250-8471-5ce18d9a592a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:19.916399 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2abf1e-be9e-4250-8471-5ce18d9a592a None admin] RBAC: Adding query filter params (role.id=35ba371f3216414e950ba78ba9587bed, scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c, user.id=26e83fb2bfa340a983ac3b6fd7bdc04a) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:19.916771 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2abf1e-be9e-4250-8471-5ce18d9a592a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:19.918610 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2abf1e-be9e-4250-8471-5ce18d9a592a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:19.923140 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5fdee-4505-4761-828c-dcea5b4aafba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:19.924119 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5fdee-4505-4761-828c-dcea5b4aafba None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:19.924571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5fdee-4505-4761-828c-dcea5b4aafba None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:19.925022 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5fdee-4505-4761-828c-dcea5b4aafba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:19.929259 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 123/250] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:14:19 2022] GET /identity/v3/role_assignments?user.id=26e83fb2bfa340a983ac3b6fd7bdc04a&scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c&role.id=35ba371f3216414e950ba78ba9587bed => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:19.938898 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2abf1e-be9e-4250-8471-5ce18d9a592a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:19.942412 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5fdee-4505-4761-828c-dcea5b4aafba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:19.948481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-69e5fdee-4505-4761-828c-dcea5b4aafba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:19.948481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:19.948481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:19.948481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:19.948481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:19.948481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:19.948481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:19.948481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:19.948481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:19.948481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:19.948481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:19.948481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:19.948481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:19.948481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:19.948481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:19.948481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:19.949670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:19.949670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:19.949670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:19.949670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:19.949670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:19.949670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:19.949670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:19.949670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:19.949670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:19.949670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:19.949670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:19.949670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:19.949670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:19.949670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:19.949670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:19.949670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:19.951019 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:19.951019 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:19.951019 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:19.951019 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:19.951019 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:19.951019 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:19.951019 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:19.951019 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:19.951019 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:19.951019 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:19.951019 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:19.951019 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:19.951019 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 128/251] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:14:19.955403 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5fdee-4505-4761-828c-dcea5b4aafba None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:20.019732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:20.080778 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2abf1e-be9e-4250-8471-5ce18d9a592a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:20.093460 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5fdee-4505-4761-828c-dcea5b4aafba None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:20.130596 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485973d-c692-4886-87cf-1a2911e2c0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:20.131526 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485973d-c692-4886-87cf-1a2911e2c0ef None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:20.131905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485973d-c692-4886-87cf-1a2911e2c0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:20.132641 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485973d-c692-4886-87cf-1a2911e2c0ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:20.141179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f8100-8092-442a-a665-5ab9af4e8d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:20.141796 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f8100-8092-442a-a665-5ab9af4e8d18 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:20.142073 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f8100-8092-442a-a665-5ab9af4e8d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:20.142339 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f8100-8092-442a-a665-5ab9af4e8d18 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:20.143014 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f8100-8092-442a-a665-5ab9af4e8d18 None admin] RBAC: Adding query filter params (name=member) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:20.143313 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f8100-8092-442a-a665-5ab9af4e8d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:20.144710 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f8100-8092-442a-a665-5ab9af4e8d18 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:20.145199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485973d-c692-4886-87cf-1a2911e2c0ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:20.151668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-a485973d-c692-4886-87cf-1a2911e2c0ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:14:20.151668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:20.151668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:20.151668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:20.151668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:20.151668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:20.151668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:20.151668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:20.151668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:20.151668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:20.151668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:20.151668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:20.151668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:20.151668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:20.151668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:20.151668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:20.152959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:20.152959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:20.152959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:20.152959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:20.152959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:20.152959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:20.152959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:20.152959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:20.152959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:20.152959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:20.152959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:20.152959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:20.152959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:20.152959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:20.152959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:20.152959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:20.154586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:20.154586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:20.154586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:20.154586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:20.154586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:20.154586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:20.154586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:20.154586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:20.154586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:20.154586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:20.154586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:14:20.154586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:20.154586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 124/252] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:14:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:14:20.156225 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c44a0-c544-411d-90b9-5e4e372c9268 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:20.156225 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c44a0-c544-411d-90b9-5e4e372c9268 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:20.156487 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 129/253] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:20.156640 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c44a0-c544-411d-90b9-5e4e372c9268 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:20.157794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 125/254] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:20.162355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c44a0-c544-411d-90b9-5e4e372c9268 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:20.162566 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f8100-8092-442a-a665-5ab9af4e8d18 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:20.210388 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:20.292371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c44a0-c544-411d-90b9-5e4e372c9268 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:20.317855 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:20.335033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31b7d1-3adc-405e-a3d4-fdddb8e28ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:20.335671 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31b7d1-3adc-405e-a3d4-fdddb8e28ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:20.335950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31b7d1-3adc-405e-a3d4-fdddb8e28ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:20.336222 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31b7d1-3adc-405e-a3d4-fdddb8e28ec2 None admin] PATH_INFO: `/v3/users/ec9ceb9a7609446793d4f37af4db8024` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:20.337394 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31b7d1-3adc-405e-a3d4-fdddb8e28ec2 None admin] RBAC: Authorizing `identity:get_user(user_id=ec9ceb9a7609446793d4f37af4db8024)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:20.339106 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31b7d1-3adc-405e-a3d4-fdddb8e28ec2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:20.341262 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 126/255] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:20 2022] GET /identity/v3/users/ec9ceb9a7609446793d4f37af4db8024 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:20.342779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a878bbd-eb53-4f7c-8407-ed12afdf631d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:20.343200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a878bbd-eb53-4f7c-8407-ed12afdf631d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:20.349383 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a878bbd-eb53-4f7c-8407-ed12afdf631d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:20.369663 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7a878bbd-eb53-4f7c-8407-ed12afdf631d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:20.371636 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7a878bbd-eb53-4f7c-8407-ed12afdf631d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:20.371997 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f8100-8092-442a-a665-5ab9af4e8d18 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:20.445327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 127/256] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:20.446107 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a878bbd-eb53-4f7c-8407-ed12afdf631d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:20.475783 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40279fdb-b5f1-44be-bbff-0d3e6898bcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:20.476251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40279fdb-b5f1-44be-bbff-0d3e6898bcf7 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:20.476610 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40279fdb-b5f1-44be-bbff-0d3e6898bcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:20.476836 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40279fdb-b5f1-44be-bbff-0d3e6898bcf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:20.477461 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40279fdb-b5f1-44be-bbff-0d3e6898bcf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:20.477759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40279fdb-b5f1-44be-bbff-0d3e6898bcf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:20.479402 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40279fdb-b5f1-44be-bbff-0d3e6898bcf7 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:20.500345 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 130/257] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:20.505709 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40279fdb-b5f1-44be-bbff-0d3e6898bcf7 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:20.631725 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a878bbd-eb53-4f7c-8407-ed12afdf631d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:20.670362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:20.699083 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e65e26-90c8-4423-90a3-276408d63e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:20.699713 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e65e26-90c8-4423-90a3-276408d63e74 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:20.699992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e65e26-90c8-4423-90a3-276408d63e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:20.700260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e65e26-90c8-4423-90a3-276408d63e74 None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:20.701435 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e65e26-90c8-4423-90a3-276408d63e74 None admin] RBAC: Authorizing `identity:get_project(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:20.703055 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e65e26-90c8-4423-90a3-276408d63e74 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:20.704698 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 128/258] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:20 2022] GET /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:20.708725 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:20.715923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40279fdb-b5f1-44be-bbff-0d3e6898bcf7 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:20.719045 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e65e26-90c8-4423-90a3-276408d63e74 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:20.790964 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c8617-6dc7-4b62-aba2-7df7f6a35353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:20.791604 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c8617-6dc7-4b62-aba2-7df7f6a35353 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:20.791959 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c8617-6dc7-4b62-aba2-7df7f6a35353 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:20.792243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c8617-6dc7-4b62-aba2-7df7f6a35353 None admin] PATH_INFO: `/v3/users/f8c1608a657544b7ac772ecf9fc92dff` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:20.793449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c8617-6dc7-4b62-aba2-7df7f6a35353 None admin] RBAC: Authorizing `identity:get_user(user_id=f8c1608a657544b7ac772ecf9fc92dff)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:20.794957 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c8617-6dc7-4b62-aba2-7df7f6a35353 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:20.796821 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 131/259] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:20 2022] GET /identity/v3/users/f8c1608a657544b7ac772ecf9fc92dff => generated 283 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:20.802130 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c8617-6dc7-4b62-aba2-7df7f6a35353 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:20.864185 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e65e26-90c8-4423-90a3-276408d63e74 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:20.923820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa403a-b092-44fb-bbb4-0c920e90aa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:20.924579 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa403a-b092-44fb-bbb4-0c920e90aa06 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:20.924762 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa403a-b092-44fb-bbb4-0c920e90aa06 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:20.925010 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa403a-b092-44fb-bbb4-0c920e90aa06 None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c/users/ec9ceb9a7609446793d4f37af4db8024/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:20.927184 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa403a-b092-44fb-bbb4-0c920e90aa06 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c, user_id=ec9ceb9a7609446793d4f37af4db8024, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:20.928622 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa403a-b092-44fb-bbb4-0c920e90aa06 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:20.966244 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c8617-6dc7-4b62-aba2-7df7f6a35353 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:21.010494 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34ac33-cb4f-443f-bc88-4b9cc1ca5533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:21.011960 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34ac33-cb4f-443f-bc88-4b9cc1ca5533 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:21.012453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34ac33-cb4f-443f-bc88-4b9cc1ca5533 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:21.012977 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34ac33-cb4f-443f-bc88-4b9cc1ca5533 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:21.041264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 129/260] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:14:20 2022] PUT /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c/users/ec9ceb9a7609446793d4f37af4db8024/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:14:21.047388 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa403a-b092-44fb-bbb4-0c920e90aa06 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:21.047536 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:21.090140 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34ac33-cb4f-443f-bc88-4b9cc1ca5533 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:21.092035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34ac33-cb4f-443f-bc88-4b9cc1ca5533 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:21.170300 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:21.217387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 132/261] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:14:21.226631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34ac33-cb4f-443f-bc88-4b9cc1ca5533 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:21.314775 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa403a-b092-44fb-bbb4-0c920e90aa06 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:21.329440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:21.369847 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350165c-abac-4da1-a46a-c1d55994a8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:21.372019 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350165c-abac-4da1-a46a-c1d55994a8fb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:21.372593 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350165c-abac-4da1-a46a-c1d55994a8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:21.373226 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350165c-abac-4da1-a46a-c1d55994a8fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:21.374850 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34ac33-cb4f-443f-bc88-4b9cc1ca5533 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:21.387006 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350165c-abac-4da1-a46a-c1d55994a8fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:21.394317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-6350165c-abac-4da1-a46a-c1d55994a8fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:21.394317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:21.394317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:21.394317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:21.394317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:21.394317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:21.394317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:21.394317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:21.394317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:21.394317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:21.394317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:21.394317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:21.394317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:21.394317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:21.394317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:21.394317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:21.395380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:21.395380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:21.395380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:21.395380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:21.395380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:21.395380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:21.395380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:21.395380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:21.395380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:21.395380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:21.395380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:21.395380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:21.395380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:21.395380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:21.395380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:21.395380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:21.396193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:21.396193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:21.396193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:21.396193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:21.396193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:21.396193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:21.396193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:21.396193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:21.396193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:21.396193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:21.396193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:21.396193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:21.398505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 130/262] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 5 14:14:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:21.404973 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350165c-abac-4da1-a46a-c1d55994a8fb None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:21.419565 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a7a9b-eb28-4c4a-9d55-935334bae746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:21.420206 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a7a9b-eb28-4c4a-9d55-935334bae746 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:21.420482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a7a9b-eb28-4c4a-9d55-935334bae746 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:21.420751 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a7a9b-eb28-4c4a-9d55-935334bae746 None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:21.421917 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a7a9b-eb28-4c4a-9d55-935334bae746 None admin] RBAC: Authorizing `identity:get_project(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:21.423381 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a7a9b-eb28-4c4a-9d55-935334bae746 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:21.425410 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 133/263] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:21 2022] GET /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:21.431224 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a7a9b-eb28-4c4a-9d55-935334bae746 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:21.580868 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350165c-abac-4da1-a46a-c1d55994a8fb None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:21.588339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:21.617107 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a7a9b-eb28-4c4a-9d55-935334bae746 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:21.625690 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70c026-d021-40ee-868a-24ff679b3813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:21.626631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70c026-d021-40ee-868a-24ff679b3813 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:21.627135 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70c026-d021-40ee-868a-24ff679b3813 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:21.627594 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70c026-d021-40ee-868a-24ff679b3813 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:21.628463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70c026-d021-40ee-868a-24ff679b3813 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:21.629005 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70c026-d021-40ee-868a-24ff679b3813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:21.630613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70c026-d021-40ee-868a-24ff679b3813 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:21.640844 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 131/264] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:14:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:21.646337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70c026-d021-40ee-868a-24ff679b3813 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:21.652238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:21.660462 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2e514-e3d1-418d-9839-60da5114c4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:21.660462 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2e514-e3d1-418d-9839-60da5114c4cc None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:21.660462 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2e514-e3d1-418d-9839-60da5114c4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:21.660462 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2e514-e3d1-418d-9839-60da5114c4cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:21.662261 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2e514-e3d1-418d-9839-60da5114c4cc None admin] RBAC: Adding query filter params (role.id=f22e6e660eab44c5be25e3dee1e3042c, scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c, user.id=f8c1608a657544b7ac772ecf9fc92dff) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:21.662261 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2e514-e3d1-418d-9839-60da5114c4cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:21.662261 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2e514-e3d1-418d-9839-60da5114c4cc None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:21.668824 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 134/265] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:14:21 2022] GET /identity/v3/role_assignments?user.id=f8c1608a657544b7ac772ecf9fc92dff&scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c&role.id=f22e6e660eab44c5be25e3dee1e3042c => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:21.798015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70c026-d021-40ee-868a-24ff679b3813 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:21.840840 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf4e1f-d112-4e80-9c52-b29791325c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:21.841776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf4e1f-d112-4e80-9c52-b29791325c16 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:21.842193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf4e1f-d112-4e80-9c52-b29791325c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:21.842624 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf4e1f-d112-4e80-9c52-b29791325c16 None admin] PATH_INFO: `/v3/users/f8c1608a657544b7ac772ecf9fc92dff` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:21.843950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf4e1f-d112-4e80-9c52-b29791325c16 None admin] RBAC: Authorizing `identity:get_user(user_id=f8c1608a657544b7ac772ecf9fc92dff)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:21.845636 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf4e1f-d112-4e80-9c52-b29791325c16 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:21.847683 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 132/266] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:21 2022] GET /identity/v3/users/f8c1608a657544b7ac772ecf9fc92dff => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:21.854249 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2e514-e3d1-418d-9839-60da5114c4cc None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:22.001273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2e514-e3d1-418d-9839-60da5114c4cc None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:22.044999 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf2acfe-d04f-475f-880b-a9d8f3995626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:22.045657 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2acfe-d04f-475f-880b-a9d8f3995626 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:22.045935 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2acfe-d04f-475f-880b-a9d8f3995626 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:22.046205 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2acfe-d04f-475f-880b-a9d8f3995626 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:22.129721 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:22.141284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf2acfe-d04f-475f-880b-a9d8f3995626 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:22.142766 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf2acfe-d04f-475f-880b-a9d8f3995626 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:22.254228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 135/267] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:14:22.259564 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf4e1f-d112-4e80-9c52-b29791325c16 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:22.302179 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:22.393140 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf4e1f-d112-4e80-9c52-b29791325c16 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:22.420554 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0351ea-fefd-4706-aca8-12552895d179 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:22.421346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0351ea-fefd-4706-aca8-12552895d179 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:22.421818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0351ea-fefd-4706-aca8-12552895d179 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:22.423418 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 136/268] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:14:22.429711 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db267a9-eab5-4887-b81a-d52c25e282a2 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:22.430432 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db267a9-eab5-4887-b81a-d52c25e282a2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:22.430901 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db267a9-eab5-4887-b81a-d52c25e282a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:22.455026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-6db267a9-eab5-4887-b81a-d52c25e282a2 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:22.456611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6db267a9-eab5-4887-b81a-d52c25e282a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:22.457499 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade73ffc-9311-45c4-b2ba-4b9aa4bdfe0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:22.458007 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade73ffc-9311-45c4-b2ba-4b9aa4bdfe0c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:22.458287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade73ffc-9311-45c4-b2ba-4b9aa4bdfe0c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:22.458561 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade73ffc-9311-45c4-b2ba-4b9aa4bdfe0c None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:22.459697 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade73ffc-9311-45c4-b2ba-4b9aa4bdfe0c None admin] RBAC: Authorizing `identity:get_project(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:22.461175 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade73ffc-9311-45c4-b2ba-4b9aa4bdfe0c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:22.462802 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 133/269] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:22 2022] GET /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:22.469409 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade73ffc-9311-45c4-b2ba-4b9aa4bdfe0c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:22.538884 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 137/270] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:22.639400 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368e1eb-c2cc-4fdc-ae00-707fd2a797ac None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:22.639846 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368e1eb-c2cc-4fdc-ae00-707fd2a797ac None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:22.640034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368e1eb-c2cc-4fdc-ae00-707fd2a797ac None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:22.641404 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 138/271] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:14:22.643785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade73ffc-9311-45c4-b2ba-4b9aa4bdfe0c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:22.646594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0086c11-4b30-4bce-84b1-e0ca760afba4 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:22.646876 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0086c11-4b30-4bce-84b1-e0ca760afba4 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:22.647145 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0086c11-4b30-4bce-84b1-e0ca760afba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:22.647320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:22.680535 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0710e-4ee9-4aa9-9801-44a97526ff5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:22.681514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0710e-4ee9-4aa9-9801-44a97526ff5b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:22.682065 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0710e-4ee9-4aa9-9801-44a97526ff5b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:22.682622 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0710e-4ee9-4aa9-9801-44a97526ff5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:22.682807 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b0086c11-4b30-4bce-84b1-e0ca760afba4 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:22.683869 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0710e-4ee9-4aa9-9801-44a97526ff5b None admin] RBAC: Adding query filter params (role.id=a1ffbcf6f60f4aea99c7eb1dbcb34582, scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c, user.id=f8c1608a657544b7ac772ecf9fc92dff) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:22.684160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b0086c11-4b30-4bce-84b1-e0ca760afba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:22.684595 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0710e-4ee9-4aa9-9801-44a97526ff5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:22.686252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0710e-4ee9-4aa9-9801-44a97526ff5b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:22.697687 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 134/272] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:14:22 2022] GET /identity/v3/role_assignments?user.id=f8c1608a657544b7ac772ecf9fc92dff&scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c&role.id=a1ffbcf6f60f4aea99c7eb1dbcb34582 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:22.718299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:22.785113 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 139/273] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:22.813391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e87bce-bdb8-4fbd-837a-a03d52dd39ea None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:22.814063 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e87bce-bdb8-4fbd-837a-a03d52dd39ea None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:22.814610 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e87bce-bdb8-4fbd-837a-a03d52dd39ea None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:22.816240 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 135/274] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:22.822160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ddfaa-f939-4e74-8261-d25bb402755a None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:22.822734 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ddfaa-f939-4e74-8261-d25bb402755a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:22.823357 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ddfaa-f939-4e74-8261-d25bb402755a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:22.849137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-162ddfaa-f939-4e74-8261-d25bb402755a None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:22.850799 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-162ddfaa-f939-4e74-8261-d25bb402755a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:22.898267 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e87bce-bdb8-4fbd-837a-a03d52dd39ea None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:22.944446 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 140/275] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:23.015152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e87bce-bdb8-4fbd-837a-a03d52dd39ea None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:23.049846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f99f6-203d-40da-a91f-a1a8f33993ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:23.050515 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f99f6-203d-40da-a91f-a1a8f33993ea None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:23.051052 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f99f6-203d-40da-a91f-a1a8f33993ea None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:23.051317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f99f6-203d-40da-a91f-a1a8f33993ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:23.062406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f99f6-203d-40da-a91f-a1a8f33993ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:23.067256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-bf9f99f6-203d-40da-a91f-a1a8f33993ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:23.067256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:23.067256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:23.067256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:23.067256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:23.067256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:23.067256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:23.067256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:23.067256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:23.067256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:23.067256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:23.067256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:23.067256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:23.067256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:23.067256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:23.067256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:23.068110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:23.068110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:23.068110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:23.068110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:23.068110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:23.068110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:23.068110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:23.068110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:23.068110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:23.068110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:23.068110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:23.068110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:23.068110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:23.068110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:23.068110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:23.068110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:23.069391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:23.069391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:23.069391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:23.069391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:23.069391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:23.069391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:23.069391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:23.069391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:23.069391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:23.069391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:23.069391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:23.069391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:23.069391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 136/276] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:14:23.074641 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ddfaa-f939-4e74-8261-d25bb402755a None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:23.112337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f99f6-203d-40da-a91f-a1a8f33993ea None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:23.144628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:23.185243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:23.204195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ddfaa-f939-4e74-8261-d25bb402755a None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:23.228618 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f99f6-203d-40da-a91f-a1a8f33993ea None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:23.245697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2c772-e9da-4537-8a02-5d684805fa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:23.247014 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2c772-e9da-4537-8a02-5d684805fa84 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:23.247593 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2c772-e9da-4537-8a02-5d684805fa84 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:23.248062 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2c772-e9da-4537-8a02-5d684805fa84 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:23.248935 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2c772-e9da-4537-8a02-5d684805fa84 None admin] RBAC: Adding query filter params (name=member) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:23.249476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2c772-e9da-4537-8a02-5d684805fa84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:23.251161 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2c772-e9da-4537-8a02-5d684805fa84 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:23.260719 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 141/277] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:23.265262 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2c23d-61ca-47d9-8442-3629e34606fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:23.265892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2c23d-61ca-47d9-8442-3629e34606fd None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:23.266169 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2c23d-61ca-47d9-8442-3629e34606fd None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:23.266438 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2c23d-61ca-47d9-8442-3629e34606fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:23.267438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2c772-e9da-4537-8a02-5d684805fa84 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:23.267542 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2c23d-61ca-47d9-8442-3629e34606fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:23.269003 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2c23d-61ca-47d9-8442-3629e34606fd None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:23.270839 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 137/278] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:14:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:23.276206 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2c23d-61ca-47d9-8442-3629e34606fd None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:23.381408 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2c772-e9da-4537-8a02-5d684805fa84 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:23.381936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:23.388940 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2c23d-61ca-47d9-8442-3629e34606fd None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:23.458823 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2305c-b106-4e7f-853b-790df0e58b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:23.459320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2305c-b106-4e7f-853b-790df0e58b7d None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:23.459660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2305c-b106-4e7f-853b-790df0e58b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:23.459874 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2305c-b106-4e7f-853b-790df0e58b7d None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:23.460616 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2305c-b106-4e7f-853b-790df0e58b7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:23.462054 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac732d90-4456-4bce-8355-b1142ac3ce02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:23.462170 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2305c-b106-4e7f-853b-790df0e58b7d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:23.462682 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac732d90-4456-4bce-8355-b1142ac3ce02 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:23.462961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac732d90-4456-4bce-8355-b1142ac3ce02 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:23.463235 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac732d90-4456-4bce-8355-b1142ac3ce02 None admin] PATH_INFO: `/v3/users/316ce9fae48442249d246599d026a555` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:23.479131 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac732d90-4456-4bce-8355-b1142ac3ce02 None admin] RBAC: Authorizing `identity:get_user(user_id=316ce9fae48442249d246599d026a555)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:23.487329 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac732d90-4456-4bce-8355-b1142ac3ce02 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:23.487329 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 142/279] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:23 2022] GET /identity/v3/users/316ce9fae48442249d246599d026a555 => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:23.488553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac732d90-4456-4bce-8355-b1142ac3ce02 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:23.498586 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:23.565081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 138/280] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 5 14:14:23 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:14:23.565081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2305c-b106-4e7f-853b-790df0e58b7d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:23.605766 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac732d90-4456-4bce-8355-b1142ac3ce02 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:23.648889 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ec43c-5696-4368-8e6b-42c16b3eb80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:23.649569 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ec43c-5696-4368-8e6b-42c16b3eb80f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:23.649857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ec43c-5696-4368-8e6b-42c16b3eb80f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:23.650128 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ec43c-5696-4368-8e6b-42c16b3eb80f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:23.663052 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ec43c-5696-4368-8e6b-42c16b3eb80f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:23.668758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-716ec43c-5696-4368-8e6b-42c16b3eb80f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 14:14:23.668758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:23.668758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:23.668758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:23.668758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:23.668758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:23.668758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:23.668758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:23.668758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:23.668758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:23.668758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:23.668758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:23.668758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:23.668758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:23.668758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:23.668758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:23.669747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:23.669747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:23.669747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:23.669747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:23.669747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:23.669747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:23.669747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:23.669747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:23.669747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:23.669747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:23.669747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:23.669747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:23.669747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:23.669747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:23.669747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:23.669747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:23.670570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:23.670570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:23.670570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:23.670570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:23.670570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:23.670570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:23.670570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:23.670570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:23.670570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:23.670570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:23.670570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 14:14:23.670570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:23.675009 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 143/281] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:23.676209 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ec43c-5696-4368-8e6b-42c16b3eb80f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:23.712306 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2305c-b106-4e7f-853b-790df0e58b7d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:23.756041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:23.761505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367901d-955c-4aa4-87d0-c8f55b0a65c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:23.762408 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367901d-955c-4aa4-87d0-c8f55b0a65c7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:23.762860 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367901d-955c-4aa4-87d0-c8f55b0a65c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:23.763280 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367901d-955c-4aa4-87d0-c8f55b0a65c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:23.764151 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367901d-955c-4aa4-87d0-c8f55b0a65c7 None admin] RBAC: Adding query filter params (role.id=d818d9cd93494e0b8e7b6d6539bc808d, user.id=316ce9fae48442249d246599d026a555, scope.system=all) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:23.764470 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367901d-955c-4aa4-87d0-c8f55b0a65c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:23.766073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367901d-955c-4aa4-87d0-c8f55b0a65c7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:23.772593 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 139/282] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Sep 5 14:14:23 2022] GET /identity/v3/role_assignments?user.id=316ce9fae48442249d246599d026a555&scope.system=all&role.id=d818d9cd93494e0b8e7b6d6539bc808d => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:23.802396 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ec43c-5696-4368-8e6b-42c16b3eb80f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:23.808206 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cef2ad-c9b1-49fd-b640-facf060c3b4c None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:23.808688 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cef2ad-c9b1-49fd-b640-facf060c3b4c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:23.808970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cef2ad-c9b1-49fd-b640-facf060c3b4c None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:23.810620 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 140/283] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:23.816396 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e34282-9d8b-460e-8008-eae164e1ca9d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:23.816681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e34282-9d8b-460e-8008-eae164e1ca9d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:23.816950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e34282-9d8b-460e-8008-eae164e1ca9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:23.842782 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-37e34282-9d8b-460e-8008-eae164e1ca9d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:23.844042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-37e34282-9d8b-460e-8008-eae164e1ca9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:23.846267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f78aa5-079f-49d5-8a36-186bf7ba2770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:23.846901 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f78aa5-079f-49d5-8a36-186bf7ba2770 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:23.847187 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f78aa5-079f-49d5-8a36-186bf7ba2770 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:23.847469 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f78aa5-079f-49d5-8a36-186bf7ba2770 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:23.848156 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f78aa5-079f-49d5-8a36-186bf7ba2770 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:23.848518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f78aa5-079f-49d5-8a36-186bf7ba2770 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:23.850000 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f78aa5-079f-49d5-8a36-186bf7ba2770 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:23.860100 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 144/284] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:23.861660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:23.866435 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f78aa5-079f-49d5-8a36-186bf7ba2770 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:23.934295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 141/285] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:14:23.999953 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f78aa5-079f-49d5-8a36-186bf7ba2770 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:24.028065 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:24.036419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02c355-7bbb-4802-8a12-64c01c0c27a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:24.037277 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02c355-7bbb-4802-8a12-64c01c0c27a2 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:24.038663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02c355-7bbb-4802-8a12-64c01c0c27a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:24.038663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02c355-7bbb-4802-8a12-64c01c0c27a2 None admin] PATH_INFO: `/v3/users/26e83fb2bfa340a983ac3b6fd7bdc04a` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:24.039262 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02c355-7bbb-4802-8a12-64c01c0c27a2 None admin] RBAC: Authorizing `identity:get_user(user_id=26e83fb2bfa340a983ac3b6fd7bdc04a)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:24.040784 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a02c355-7bbb-4802-8a12-64c01c0c27a2 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:24.043305 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 145/286] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:23 2022] GET /identity/v3/users/26e83fb2bfa340a983ac3b6fd7bdc04a => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:24.048835 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e34282-9d8b-460e-8008-eae164e1ca9d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:24.163615 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e34282-9d8b-460e-8008-eae164e1ca9d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:24.203554 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd11714-354c-4f11-b1d8-f693226a3fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:24.204195 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd11714-354c-4f11-b1d8-f693226a3fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:24.204473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd11714-354c-4f11-b1d8-f693226a3fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:24.204740 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd11714-354c-4f11-b1d8-f693226a3fc1 None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:24.205905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd11714-354c-4f11-b1d8-f693226a3fc1 None admin] RBAC: Authorizing `identity:get_project(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:24.207465 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd11714-354c-4f11-b1d8-f693226a3fc1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:24.209281 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 142/287] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:24 2022] GET /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:24.215400 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02c355-7bbb-4802-8a12-64c01c0c27a2 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:24.259410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd11714-354c-4f11-b1d8-f693226a3fc1 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:24.277405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:24.364618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a02c355-7bbb-4802-8a12-64c01c0c27a2 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:24.408043 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ed5b9-984d-4179-81ff-0025225dfb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:24.408726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ed5b9-984d-4179-81ff-0025225dfb6f None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:24.409080 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ed5b9-984d-4179-81ff-0025225dfb6f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:24.409369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ed5b9-984d-4179-81ff-0025225dfb6f None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c/users/26e83fb2bfa340a983ac3b6fd7bdc04a/roles/35ba371f3216414e950ba78ba9587bed` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:24.414301 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ed5b9-984d-4179-81ff-0025225dfb6f None admin] RBAC: Authorizing `identity:create_grant(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c, user_id=26e83fb2bfa340a983ac3b6fd7bdc04a, role_id=35ba371f3216414e950ba78ba9587bed)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:24.415918 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ed5b9-984d-4179-81ff-0025225dfb6f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:24.439918 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd11714-354c-4f11-b1d8-f693226a3fc1 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:24.478197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93f351-890c-4709-a1ce-5f6573a79525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:24.478979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93f351-890c-4709-a1ce-5f6573a79525 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:24.479302 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93f351-890c-4709-a1ce-5f6573a79525 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:24.480295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93f351-890c-4709-a1ce-5f6573a79525 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:24.493000 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 146/288] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:14:24 2022] PUT /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c/users/26e83fb2bfa340a983ac3b6fd7bdc04a/roles/35ba371f3216414e950ba78ba9587bed => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:14:24.499817 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93f351-890c-4709-a1ce-5f6573a79525 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:24.505412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-9b93f351-890c-4709-a1ce-5f6573a79525 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:24.505412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:24.505412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:24.505412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:24.505412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:24.505412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:24.505412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:24.505412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:24.505412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:24.505412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:24.505412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:24.505412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:24.505412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:24.505412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:24.505412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:24.505412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:24.506385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:24.506385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:24.506385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:24.506385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:24.506385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:24.506385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:24.506385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:24.506385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:24.506385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:24.506385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:24.506385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:24.506385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:24.506385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:24.506385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:24.506385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:24.506385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:24.507252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:24.507252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:24.507252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:24.507252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:24.507252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:24.507252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:24.507252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:24.507252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:24.507252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:24.507252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:24.507252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:24.507252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:24.507252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 143/289] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:14:24.519238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ed5b9-984d-4179-81ff-0025225dfb6f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:24.585664 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:24.640632 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ed5b9-984d-4179-81ff-0025225dfb6f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:24.678910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f3fcb-2944-48f9-b05e-a1226551808d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:24.679539 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f3fcb-2944-48f9-b05e-a1226551808d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:24.679816 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f3fcb-2944-48f9-b05e-a1226551808d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:24.680087 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f3fcb-2944-48f9-b05e-a1226551808d None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:24.680770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f3fcb-2944-48f9-b05e-a1226551808d None admin] RBAC: Adding query filter params (name=member) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:24.681096 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f3fcb-2944-48f9-b05e-a1226551808d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:24.682643 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f3fcb-2944-48f9-b05e-a1226551808d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:24.696790 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 147/290] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:24.698808 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93f351-890c-4709-a1ce-5f6573a79525 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:24.806669 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:24.851109 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93f351-890c-4709-a1ce-5f6573a79525 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:24.897528 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea156a-d375-4135-9798-5c0ca9318874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:24.898523 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea156a-d375-4135-9798-5c0ca9318874 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:24.899015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea156a-d375-4135-9798-5c0ca9318874 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:24.899481 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea156a-d375-4135-9798-5c0ca9318874 None admin] PATH_INFO: `/v3/users/ec9ceb9a7609446793d4f37af4db8024` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:24.902633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea156a-d375-4135-9798-5c0ca9318874 None admin] RBAC: Authorizing `identity:get_user(user_id=ec9ceb9a7609446793d4f37af4db8024)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:24.904299 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea156a-d375-4135-9798-5c0ca9318874 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:24.906998 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 144/291] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:24 2022] GET /identity/v3/users/ec9ceb9a7609446793d4f37af4db8024 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:24.912659 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f3fcb-2944-48f9-b05e-a1226551808d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:25.050488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f3fcb-2944-48f9-b05e-a1226551808d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:25.077995 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:25.098850 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7edcf-6627-4878-87c7-6560652e576c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:25.099492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7edcf-6627-4878-87c7-6560652e576c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:25.099771 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7edcf-6627-4878-87c7-6560652e576c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:25.100046 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7edcf-6627-4878-87c7-6560652e576c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:25.187629 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb7edcf-6627-4878-87c7-6560652e576c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:25.189134 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb7edcf-6627-4878-87c7-6560652e576c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:25.321530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 148/292] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:14:25.327574 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea156a-d375-4135-9798-5c0ca9318874 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:25.461685 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea156a-d375-4135-9798-5c0ca9318874 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:25.509496 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691ab19-420c-4f8f-912f-e746f9d637a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:25.510136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691ab19-420c-4f8f-912f-e746f9d637a5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:25.510417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691ab19-420c-4f8f-912f-e746f9d637a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:25.511368 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691ab19-420c-4f8f-912f-e746f9d637a5 None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:25.512649 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691ab19-420c-4f8f-912f-e746f9d637a5 None admin] RBAC: Authorizing `identity:get_project(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:25.514137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691ab19-420c-4f8f-912f-e746f9d637a5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:25.516086 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 145/293] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:25 2022] GET /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:25.521883 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7edcf-6627-4878-87c7-6560652e576c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:25.560821 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:25.684100 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7edcf-6627-4878-87c7-6560652e576c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:25.729853 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bea53-82b1-4747-ba63-6d34ad7748c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:25.730840 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bea53-82b1-4747-ba63-6d34ad7748c0 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:25.731328 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bea53-82b1-4747-ba63-6d34ad7748c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:25.731786 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bea53-82b1-4747-ba63-6d34ad7748c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:25.732698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bea53-82b1-4747-ba63-6d34ad7748c0 None admin] RBAC: Adding query filter params (role.id=d818d9cd93494e0b8e7b6d6539bc808d, scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c, user.id=ec9ceb9a7609446793d4f37af4db8024) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:25.733222 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bea53-82b1-4747-ba63-6d34ad7748c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:25.734988 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bea53-82b1-4747-ba63-6d34ad7748c0 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:25.746112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 149/294] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:14:25 2022] GET /identity/v3/role_assignments?user.id=ec9ceb9a7609446793d4f37af4db8024&scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c&role.id=d818d9cd93494e0b8e7b6d6539bc808d => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:25.994288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba62ad-48a5-4cda-b5e9-bb9991356faa None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:25.994622 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba62ad-48a5-4cda-b5e9-bb9991356faa None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:25.994834 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba62ad-48a5-4cda-b5e9-bb9991356faa None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:25.996269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 146/295] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:26.001358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb31ac-ec84-4378-91f3-5a000fe6ddbc None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:26.001864 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb31ac-ec84-4378-91f3-5a000fe6ddbc None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:26.002325 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb31ac-ec84-4378-91f3-5a000fe6ddbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:26.023939 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-2ebb31ac-ec84-4378-91f3-5a000fe6ddbc None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:26.025440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2ebb31ac-ec84-4378-91f3-5a000fe6ddbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:26.108706 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 150/296] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:26.222441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190c30a-2365-400f-8ad0-7cf5541b08d3 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:26.223112 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190c30a-2365-400f-8ad0-7cf5541b08d3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:26.223585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190c30a-2365-400f-8ad0-7cf5541b08d3 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:26.225490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 147/297] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:26.237487 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1feb943-48d3-461f-849f-45360ba747fa None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:26.238089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1feb943-48d3-461f-849f-45360ba747fa None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:26.238552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1feb943-48d3-461f-849f-45360ba747fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:26.264013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c1feb943-48d3-461f-849f-45360ba747fa None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:26.265575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c1feb943-48d3-461f-849f-45360ba747fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:26.276341 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:26.339970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 151/298] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:14:26.406341 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190c30a-2365-400f-8ad0-7cf5541b08d3 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:26.420559 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:26.435628 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1d8b4-039b-4ae8-8f54-145d2203d397 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:26.435916 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1d8b4-039b-4ae8-8f54-145d2203d397 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:26.436223 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1d8b4-039b-4ae8-8f54-145d2203d397 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:26.438336 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 152/299] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:14:26.445259 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3271a-1864-47af-b563-32f76fac3fbd None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:26.445801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3271a-1864-47af-b563-32f76fac3fbd None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:26.446272 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3271a-1864-47af-b563-32f76fac3fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:26.466849 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-28a3271a-1864-47af-b563-32f76fac3fbd None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:26.468363 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-28a3271a-1864-47af-b563-32f76fac3fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:26.520535 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190c30a-2365-400f-8ad0-7cf5541b08d3 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:26.559262 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eefab8-e0fb-48d0-b969-4d86b46e4bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:26.559986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eefab8-e0fb-48d0-b969-4d86b46e4bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:26.560272 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eefab8-e0fb-48d0-b969-4d86b46e4bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:26.560549 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eefab8-e0fb-48d0-b969-4d86b46e4bc3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:26.561855 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 153/300] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:14:26.575623 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eefab8-e0fb-48d0-b969-4d86b46e4bc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:26.580790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-75eefab8-e0fb-48d0-b969-4d86b46e4bc3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:26.580790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:26.580790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:26.580790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:26.580790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:26.580790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:26.580790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:26.580790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:26.580790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:26.580790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:26.580790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:26.580790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:26.580790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:26.580790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:26.580790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:26.580790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:26.581686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:26.581686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:26.581686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:26.581686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:26.581686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:26.581686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:26.581686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:26.581686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:26.581686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:26.581686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:26.581686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:26.581686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:26.581686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:26.581686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:26.581686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:26.581686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:26.582506 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:26.582506 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:26.582506 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:26.582506 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:26.582506 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:26.582506 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:26.582506 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:26.582506 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:26.582506 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:26.582506 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:26.582506 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:26.582506 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:26.584749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 148/301] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:26.591879 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3271a-1864-47af-b563-32f76fac3fbd None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:26.616230 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eefab8-e0fb-48d0-b969-4d86b46e4bc3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:26.691485 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:26.693408 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:26.712488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3271a-1864-47af-b563-32f76fac3fbd None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:26.725474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eefab8-e0fb-48d0-b969-4d86b46e4bc3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:26.757624 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1615d-da57-47af-8de3-aea7331bad74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:26.758845 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1615d-da57-47af-8de3-aea7331bad74 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:26.759390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1615d-da57-47af-8de3-aea7331bad74 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:26.760064 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1615d-da57-47af-8de3-aea7331bad74 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:26.761645 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1615d-da57-47af-8de3-aea7331bad74 None admin] RBAC: Adding query filter params (name=member) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:26.762245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1615d-da57-47af-8de3-aea7331bad74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:26.763873 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1615d-da57-47af-8de3-aea7331bad74 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:26.770998 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4875033-e815-4da4-9386-348c921e8925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:26.771624 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4875033-e815-4da4-9386-348c921e8925 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:26.771921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4875033-e815-4da4-9386-348c921e8925 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:26.772438 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4875033-e815-4da4-9386-348c921e8925 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:26.773573 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4875033-e815-4da4-9386-348c921e8925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:26.780762 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4875033-e815-4da4-9386-348c921e8925 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:26.781093 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 154/303] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:26.781567 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 149/303] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:14:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:26.782407 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4875033-e815-4da4-9386-348c921e8925 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:26.782797 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1615d-da57-47af-8de3-aea7331bad74 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:26.898416 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1615d-da57-47af-8de3-aea7331bad74 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:26.904960 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4875033-e815-4da4-9386-348c921e8925 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:26.933550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e5472-b33c-4724-90c2-642cd98fc16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:26.934174 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e5472-b33c-4724-90c2-642cd98fc16c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:26.934453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e5472-b33c-4724-90c2-642cd98fc16c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:26.934723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e5472-b33c-4724-90c2-642cd98fc16c None admin] PATH_INFO: `/v3/users/316ce9fae48442249d246599d026a555` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:26.935834 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e5472-b33c-4724-90c2-642cd98fc16c None admin] RBAC: Authorizing `identity:get_user(user_id=316ce9fae48442249d246599d026a555)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:26.937301 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e5472-b33c-4724-90c2-642cd98fc16c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:26.938878 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 155/304] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:26 2022] GET /identity/v3/users/316ce9fae48442249d246599d026a555 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:26.939626 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e5472-b33c-4724-90c2-642cd98fc16c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:26.942217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:26.947366 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a9f3c-c9cc-460f-9cbd-7b475e3fcfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:26.948562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a9f3c-c9cc-460f-9cbd-7b475e3fcfbe None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:26.949404 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a9f3c-c9cc-460f-9cbd-7b475e3fcfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:26.956884 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a9f3c-c9cc-460f-9cbd-7b475e3fcfbe None admin] PATH_INFO: `/v3/groups` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:26.956884 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a9f3c-c9cc-460f-9cbd-7b475e3fcfbe None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:26.956884 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a9f3c-c9cc-460f-9cbd-7b475e3fcfbe None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:27.007990 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:27.014216 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 150/305] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Sep 5 14:14:26 2022] POST /identity/v3/groups => generated 229 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:14:27.014216 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a9f3c-c9cc-460f-9cbd-7b475e3fcfbe None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:27.055377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e5472-b33c-4724-90c2-642cd98fc16c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:27.102170 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9365e92-69c8-48de-865f-d61f9fd844e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:27.102818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9365e92-69c8-48de-865f-d61f9fd844e4 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:27.103201 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9365e92-69c8-48de-865f-d61f9fd844e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:27.103493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9365e92-69c8-48de-865f-d61f9fd844e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:27.116871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9365e92-69c8-48de-865f-d61f9fd844e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:27.122762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-c9365e92-69c8-48de-865f-d61f9fd844e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 14:14:27.122762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:27.122762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:27.122762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:27.122762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:27.122762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:27.122762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:27.122762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:27.122762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:27.122762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:27.122762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:27.122762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:27.122762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:27.122762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:27.122762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:27.122762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:27.123716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:27.123716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:27.123716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:27.123716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:27.123716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:27.123716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:27.123716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:27.123716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:27.123716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:27.123716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:27.123716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:27.123716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:27.123716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:27.123716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:27.123716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:27.123716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:27.124493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:27.124493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:27.124493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:27.124493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:27.124493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:27.124493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:27.124493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:27.124493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:27.124493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:27.124493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:27.124493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 14:14:27.124493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:27.124493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 156/306] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:27.130109 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9365e92-69c8-48de-865f-d61f9fd844e4 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:27.164802 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a9f3c-c9cc-460f-9cbd-7b475e3fcfbe None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:27.204939 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014416d-1f2a-45aa-8fa6-c4eb20b67042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:27.205404 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014416d-1f2a-45aa-8fa6-c4eb20b67042 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:27.205843 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014416d-1f2a-45aa-8fa6-c4eb20b67042 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:27.206117 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014416d-1f2a-45aa-8fa6-c4eb20b67042 None admin] PATH_INFO: `/v3/system/users/316ce9fae48442249d246599d026a555/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:27.207256 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:27.208079 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014416d-1f2a-45aa-8fa6-c4eb20b67042 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=316ce9fae48442249d246599d026a555, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:27.210229 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014416d-1f2a-45aa-8fa6-c4eb20b67042 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:27.247886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9365e92-69c8-48de-865f-d61f9fd844e4 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:27.320816 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467041a1-161e-4b2f-8215-82bfb96dffe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:27.320816 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467041a1-161e-4b2f-8215-82bfb96dffe8 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:27.320816 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467041a1-161e-4b2f-8215-82bfb96dffe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:27.320816 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467041a1-161e-4b2f-8215-82bfb96dffe8 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:27.321251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467041a1-161e-4b2f-8215-82bfb96dffe8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:27.321251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467041a1-161e-4b2f-8215-82bfb96dffe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:27.321251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467041a1-161e-4b2f-8215-82bfb96dffe8 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:27.321251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 157/307] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:27.321251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12534dcb-e35b-4deb-8a63-421c9ec8fcfb None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:27.321251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12534dcb-e35b-4deb-8a63-421c9ec8fcfb None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:27.321693 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12534dcb-e35b-4deb-8a63-421c9ec8fcfb None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:27.321693 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 158/308] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:27.321693 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12534dcb-e35b-4deb-8a63-421c9ec8fcfb None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:27.340192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 151/309] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Sep 5 14:14:27 2022] PUT /identity/v3/system/users/316ce9fae48442249d246599d026a555/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:14:27.341645 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6252605-742a-4ef9-9f3f-61833d9b9650 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:27.342043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6252605-742a-4ef9-9f3f-61833d9b9650 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:27.342411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6252605-742a-4ef9-9f3f-61833d9b9650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:27.374305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b6252605-742a-4ef9-9f3f-61833d9b9650 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:27.376246 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b6252605-742a-4ef9-9f3f-61833d9b9650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:27.421972 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12534dcb-e35b-4deb-8a63-421c9ec8fcfb None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:27.450544 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:27.462615 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94463c-ff5c-4675-9e9d-7cc588d31d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:27.463365 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94463c-ff5c-4675-9e9d-7cc588d31d0c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:27.464214 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94463c-ff5c-4675-9e9d-7cc588d31d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:27.464552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94463c-ff5c-4675-9e9d-7cc588d31d0c None admin] PATH_INFO: `/v3/users/5ee7fcf270ac4daf82dd8e81ce290793` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:27.474945 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 152/310] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:27.475486 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:27.485499 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94463c-ff5c-4675-9e9d-7cc588d31d0c None admin] RBAC: Authorizing `identity:get_user(user_id=5ee7fcf270ac4daf82dd8e81ce290793)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:27.487239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94463c-ff5c-4675-9e9d-7cc588d31d0c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:27.489140 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 159/311] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:27 2022] GET /identity/v3/users/5ee7fcf270ac4daf82dd8e81ce290793 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:27.495043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6252605-742a-4ef9-9f3f-61833d9b9650 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:27.607723 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6252605-742a-4ef9-9f3f-61833d9b9650 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:27.643512 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c517373-0925-4454-836f-9ccd0e9168ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:27.644122 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c517373-0925-4454-836f-9ccd0e9168ee None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:27.644400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c517373-0925-4454-836f-9ccd0e9168ee None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:27.644671 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c517373-0925-4454-836f-9ccd0e9168ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:27.645426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c517373-0925-4454-836f-9ccd0e9168ee None admin] RBAC: Adding query filter params (role.id=35ba371f3216414e950ba78ba9587bed, user.id=5ee7fcf270ac4daf82dd8e81ce290793, scope.system=all) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:27.645730 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c517373-0925-4454-836f-9ccd0e9168ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:27.647167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c517373-0925-4454-836f-9ccd0e9168ee None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:27.653124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 153/312] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Sep 5 14:14:27 2022] GET /identity/v3/role_assignments?user.id=5ee7fcf270ac4daf82dd8e81ce290793&scope.system=all&role.id=35ba371f3216414e950ba78ba9587bed => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:27.754358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94463c-ff5c-4675-9e9d-7cc588d31d0c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:27.869854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94463c-ff5c-4675-9e9d-7cc588d31d0c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:27.906321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5f9c4-ee7c-4011-930b-efb897a2727c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:27.906946 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5f9c4-ee7c-4011-930b-efb897a2727c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:27.907222 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5f9c4-ee7c-4011-930b-efb897a2727c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:27.907488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5f9c4-ee7c-4011-930b-efb897a2727c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:27.918845 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5f9c4-ee7c-4011-930b-efb897a2727c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:27.923687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-1af5f9c4-ee7c-4011-930b-efb897a2727c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 14:14:27.923687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:27.923687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:27.923687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:27.923687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:27.923687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:27.923687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:27.923687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:27.923687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:27.923687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:27.923687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:27.923687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:27.923687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:27.923687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:27.923687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:27.923687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:27.924741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:27.924741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:27.924741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:27.924741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:27.924741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:27.924741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:27.924741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:27.924741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:27.924741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:27.924741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:27.924741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:27.924741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:27.924741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:27.924741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:27.924741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:27.924741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:27.925594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:27.925594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:27.925594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:27.925594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:27.925594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:27.925594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:27.925594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:27.925594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:27.925594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:27.925594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:27.925594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 14:14:27.925594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:27.925594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 160/313] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:27.933238 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c517373-0925-4454-836f-9ccd0e9168ee None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:27.991449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:28.035189 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c517373-0925-4454-836f-9ccd0e9168ee None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:28.070362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efed614-ed23-457b-934c-a83d9d188cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:28.070967 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efed614-ed23-457b-934c-a83d9d188cad None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:28.071243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efed614-ed23-457b-934c-a83d9d188cad None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:28.071515 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efed614-ed23-457b-934c-a83d9d188cad None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:28.072172 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efed614-ed23-457b-934c-a83d9d188cad None admin] RBAC: Adding query filter params (name=reader) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:28.072473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efed614-ed23-457b-934c-a83d9d188cad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:28.074001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efed614-ed23-457b-934c-a83d9d188cad None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:28.082861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 154/314] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:28.088315 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5f9c4-ee7c-4011-930b-efb897a2727c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:28.133880 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:28.197861 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5f9c4-ee7c-4011-930b-efb897a2727c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:28.236200 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d87f64-99ce-49b4-b71b-53fbd2d55711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:28.236848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d87f64-99ce-49b4-b71b-53fbd2d55711 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:28.237428 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d87f64-99ce-49b4-b71b-53fbd2d55711 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:28.237701 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d87f64-99ce-49b4-b71b-53fbd2d55711 None admin] PATH_INFO: `/v3/users/26e83fb2bfa340a983ac3b6fd7bdc04a` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:28.238836 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d87f64-99ce-49b4-b71b-53fbd2d55711 None admin] RBAC: Authorizing `identity:get_user(user_id=26e83fb2bfa340a983ac3b6fd7bdc04a)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:28.240352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d87f64-99ce-49b4-b71b-53fbd2d55711 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:28.242149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 161/315] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:28 2022] GET /identity/v3/users/26e83fb2bfa340a983ac3b6fd7bdc04a => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:28.250201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efed614-ed23-457b-934c-a83d9d188cad None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:28.363176 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efed614-ed23-457b-934c-a83d9d188cad None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:28.380731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:28.397940 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3fedc2-0314-4a0f-bc0a-7bc20dd9c6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:28.398533 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fedc2-0314-4a0f-bc0a-7bc20dd9c6d5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:28.398811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fedc2-0314-4a0f-bc0a-7bc20dd9c6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:28.399081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fedc2-0314-4a0f-bc0a-7bc20dd9c6d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:28.508096 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3fedc2-0314-4a0f-bc0a-7bc20dd9c6d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:28.509609 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3fedc2-0314-4a0f-bc0a-7bc20dd9c6d5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:28.616758 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 155/316] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:14:28.622488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d87f64-99ce-49b4-b71b-53fbd2d55711 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:28.732175 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d87f64-99ce-49b4-b71b-53fbd2d55711 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:28.743524 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:28.768750 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7b3eb-c3f4-44e1-93ae-08b0262f672c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:28.769414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7b3eb-c3f4-44e1-93ae-08b0262f672c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:28.769672 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7b3eb-c3f4-44e1-93ae-08b0262f672c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:28.769942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7b3eb-c3f4-44e1-93ae-08b0262f672c None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:28.771058 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7b3eb-c3f4-44e1-93ae-08b0262f672c None admin] RBAC: Authorizing `identity:get_project(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:28.772515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7b3eb-c3f4-44e1-93ae-08b0262f672c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:28.774214 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 162/317] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:28 2022] GET /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:28.780626 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3fedc2-0314-4a0f-bc0a-7bc20dd9c6d5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:28.801868 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:28.886658 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3fedc2-0314-4a0f-bc0a-7bc20dd9c6d5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:28.921268 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a58d6b-7786-47d4-b884-d88616148d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:28.921869 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a58d6b-7786-47d4-b884-d88616148d73 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:28.922143 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a58d6b-7786-47d4-b884-d88616148d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:28.922412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a58d6b-7786-47d4-b884-d88616148d73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:28.923130 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a58d6b-7786-47d4-b884-d88616148d73 None admin] RBAC: Adding query filter params (role.id=35ba371f3216414e950ba78ba9587bed, scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c, user.id=26e83fb2bfa340a983ac3b6fd7bdc04a) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:28.923434 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a58d6b-7786-47d4-b884-d88616148d73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:28.924957 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a58d6b-7786-47d4-b884-d88616148d73 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:28.931429 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 156/318] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:14:28 2022] GET /identity/v3/role_assignments?user.id=26e83fb2bfa340a983ac3b6fd7bdc04a&scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c&role.id=35ba371f3216414e950ba78ba9587bed => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:29.092148 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b974f-351c-4f2e-902f-f764ef41317b None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:29.092499 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b974f-351c-4f2e-902f-f764ef41317b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:29.092706 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b974f-351c-4f2e-902f-f764ef41317b None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:29.094241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 163/319] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:29.099789 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca5fc0-0386-438e-aac7-29014c4f5ad2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:29.100079 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca5fc0-0386-438e-aac7-29014c4f5ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:29.100352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca5fc0-0386-438e-aac7-29014c4f5ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:29.119772 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-38ca5fc0-0386-438e-aac7-29014c4f5ad2 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:29.121138 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-38ca5fc0-0386-438e-aac7-29014c4f5ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:29.194230 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 157/320] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:29.451653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd310c49-6b04-45a6-ac71-9ba784541089 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:29.451835 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd310c49-6b04-45a6-ac71-9ba784541089 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:29.452102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd310c49-6b04-45a6-ac71-9ba784541089 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:29.453590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 164/321] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:29.458518 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60a18f-0729-44e6-96da-012adf62222e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:29.458805 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60a18f-0729-44e6-96da-012adf62222e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:29.459078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60a18f-0729-44e6-96da-012adf62222e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:29.475507 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd310c49-6b04-45a6-ac71-9ba784541089 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:29.480290 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ff60a18f-0729-44e6-96da-012adf62222e None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:29.481567 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ff60a18f-0729-44e6-96da-012adf62222e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:29.492070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:29.556972 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 158/322] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:29.585189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd310c49-6b04-45a6-ac71-9ba784541089 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:29.619326 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72213d89-5a9c-4060-b658-f8fdbc3756f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:29.620171 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72213d89-5a9c-4060-b658-f8fdbc3756f7 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:29.620445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72213d89-5a9c-4060-b658-f8fdbc3756f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:29.620707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72213d89-5a9c-4060-b658-f8fdbc3756f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:29.621815 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72213d89-5a9c-4060-b658-f8fdbc3756f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:29.623243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72213d89-5a9c-4060-b658-f8fdbc3756f7 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:29.624958 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 165/323] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:14:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:29.630454 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60a18f-0729-44e6-96da-012adf62222e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:29.642735 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fadc9-abc7-4a86-bddf-f29c60e02ad0 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:29.643018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fadc9-abc7-4a86-bddf-f29c60e02ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:29.643285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fadc9-abc7-4a86-bddf-f29c60e02ad0 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:29.644578 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 166/324] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:14:29.649494 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec56684-d7cd-4ff1-b294-a1a0a92afd2c None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:29.649774 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec56684-d7cd-4ff1-b294-a1a0a92afd2c None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:29.650045 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec56684-d7cd-4ff1-b294-a1a0a92afd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:29.669118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-aec56684-d7cd-4ff1-b294-a1a0a92afd2c None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:29.670296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-aec56684-d7cd-4ff1-b294-a1a0a92afd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:29.713337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:29.737795 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60a18f-0729-44e6-96da-012adf62222e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:29.738867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 167/325] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:14:29.774485 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392b1e7-16c7-4204-b2a8-37db82e68b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:29.775420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392b1e7-16c7-4204-b2a8-37db82e68b02 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:29.775883 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392b1e7-16c7-4204-b2a8-37db82e68b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:29.776540 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392b1e7-16c7-4204-b2a8-37db82e68b02 None admin] PATH_INFO: `/v3/groups` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:29.777839 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392b1e7-16c7-4204-b2a8-37db82e68b02 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:29.779816 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392b1e7-16c7-4204-b2a8-37db82e68b02 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:29.832659 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec56684-d7cd-4ff1-b294-a1a0a92afd2c None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:29.904999 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 159/326] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Sep 5 14:14:29 2022] POST /identity/v3/groups => generated 226 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:14:29.941948 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec56684-d7cd-4ff1-b294-a1a0a92afd2c None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:29.981929 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f0b04-b4be-4022-84ae-1277d69be81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:29.982598 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f0b04-b4be-4022-84ae-1277d69be81a None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:29.982882 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f0b04-b4be-4022-84ae-1277d69be81a None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:29.983199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f0b04-b4be-4022-84ae-1277d69be81a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:29.994786 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f0b04-b4be-4022-84ae-1277d69be81a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:30.000246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-988f0b04-b4be-4022-84ae-1277d69be81a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:30.000246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:30.000246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:30.000246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:30.000246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:30.000246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:30.000246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:30.000246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:30.000246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:30.000246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:30.000246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:30.000246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:30.000246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:30.000246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:30.000246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:30.000246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:30.001447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:30.001447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:30.001447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:30.001447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:30.001447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:30.001447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:30.001447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:30.001447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:30.001447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:30.001447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:30.001447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:30.001447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:30.001447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:30.001447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:30.001447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:30.001447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:30.002250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:30.002250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:30.002250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:30.002250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:30.002250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:30.002250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:30.002250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:30.002250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:30.002250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:30.002250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:30.002250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:30.002250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:30.005385 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 168/327] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:30.007250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392b1e7-16c7-4204-b2a8-37db82e68b02 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:30.010198 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:30.016018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f0b04-b4be-4022-84ae-1277d69be81a None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:30.065911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:30.160289 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f0b04-b4be-4022-84ae-1277d69be81a None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:30.160840 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392b1e7-16c7-4204-b2a8-37db82e68b02 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:30.227423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541925c4-c755-437c-b5d9-c7ad8a2994cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:30.228067 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541925c4-c755-437c-b5d9-c7ad8a2994cc None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:30.228339 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541925c4-c755-437c-b5d9-c7ad8a2994cc None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:30.228602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541925c4-c755-437c-b5d9-c7ad8a2994cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:30.243280 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e7a80-3c7e-4a9b-afc3-3ef15cd4c5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:30.243910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e7a80-3c7e-4a9b-afc3-3ef15cd4c5ef None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:30.244189 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e7a80-3c7e-4a9b-afc3-3ef15cd4c5ef None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:30.244460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e7a80-3c7e-4a9b-afc3-3ef15cd4c5ef None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:30.245837 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e7a80-3c7e-4a9b-afc3-3ef15cd4c5ef None admin] RBAC: Adding query filter params (name=member) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:30.246143 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e7a80-3c7e-4a9b-afc3-3ef15cd4c5ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:30.247536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e7a80-3c7e-4a9b-afc3-3ef15cd4c5ef None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:30.250585 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541925c4-c755-437c-b5d9-c7ad8a2994cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:30.256515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-541925c4-c755-437c-b5d9-c7ad8a2994cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 14:14:30.256515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:30.256515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:30.256515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:30.256515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:30.256515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:30.256515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:30.256515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:30.256515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:30.256515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:30.256515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:30.256515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:30.256515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:30.256515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:30.256515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:30.256515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:30.257549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:30.257549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:30.257549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:30.257549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:30.257549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:30.257549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:30.257549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:30.257549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:30.257549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:30.257549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:30.257549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:30.257549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:30.257549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:30.257549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:30.257549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:30.257549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:30.258528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:30.258528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:30.258528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:30.258528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:30.258528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:30.258528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:30.258528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:30.258528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:30.258528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:30.258528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:30.258528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 14:14:30.258528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:30.260876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 160/328] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:30.261601 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 169/329] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:14:30.266453 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e7a80-3c7e-4a9b-afc3-3ef15cd4c5ef None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:30.269108 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541925c4-c755-437c-b5d9-c7ad8a2994cc None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:30.365462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:30.418178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:30.424246 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e7a80-3c7e-4a9b-afc3-3ef15cd4c5ef None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:30.430944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541925c4-c755-437c-b5d9-c7ad8a2994cc None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:30.471012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c94e6-6676-49ed-9010-b24fc2069622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:30.472214 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c94e6-6676-49ed-9010-b24fc2069622 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:30.472214 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c94e6-6676-49ed-9010-b24fc2069622 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:30.472214 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c94e6-6676-49ed-9010-b24fc2069622 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:30.473579 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c94e6-6676-49ed-9010-b24fc2069622 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:30.473579 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c94e6-6676-49ed-9010-b24fc2069622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:30.474470 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c94e6-6676-49ed-9010-b24fc2069622 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:30.486331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 161/330] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:30.494019 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c94e6-6676-49ed-9010-b24fc2069622 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:30.513922 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddad5ef-206d-4dc8-8b3e-fd775978819d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:30.514919 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddad5ef-206d-4dc8-8b3e-fd775978819d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:30.515389 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddad5ef-206d-4dc8-8b3e-fd775978819d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:30.515859 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddad5ef-206d-4dc8-8b3e-fd775978819d None admin] PATH_INFO: `/v3/users/316ce9fae48442249d246599d026a555` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:30.517276 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddad5ef-206d-4dc8-8b3e-fd775978819d None admin] RBAC: Authorizing `identity:get_user(user_id=316ce9fae48442249d246599d026a555)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:30.519049 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddad5ef-206d-4dc8-8b3e-fd775978819d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:30.523549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 170/331] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:30 2022] GET /identity/v3/users/316ce9fae48442249d246599d026a555 => generated 293 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:30.534320 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddad5ef-206d-4dc8-8b3e-fd775978819d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:30.637243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c94e6-6676-49ed-9010-b24fc2069622 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:30.667484 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:30.674703 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddad5ef-206d-4dc8-8b3e-fd775978819d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:30.680959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02bb6b-ba49-47e4-960d-6b64eefc1197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:30.680959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02bb6b-ba49-47e4-960d-6b64eefc1197 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:30.680959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02bb6b-ba49-47e4-960d-6b64eefc1197 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:30.680959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02bb6b-ba49-47e4-960d-6b64eefc1197 None admin] PATH_INFO: `/v3/users/5ee7fcf270ac4daf82dd8e81ce290793` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:30.681304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02bb6b-ba49-47e4-960d-6b64eefc1197 None admin] RBAC: Authorizing `identity:get_user(user_id=5ee7fcf270ac4daf82dd8e81ce290793)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:30.682509 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02bb6b-ba49-47e4-960d-6b64eefc1197 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:30.684647 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 162/332] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:30 2022] GET /identity/v3/users/5ee7fcf270ac4daf82dd8e81ce290793 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:30.692580 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02bb6b-ba49-47e4-960d-6b64eefc1197 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:30.731362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339ebec-ac30-4885-a6ae-12efc8e8a803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:30.732070 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339ebec-ac30-4885-a6ae-12efc8e8a803 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:30.732597 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339ebec-ac30-4885-a6ae-12efc8e8a803 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:30.732771 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339ebec-ac30-4885-a6ae-12efc8e8a803 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:30.733530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339ebec-ac30-4885-a6ae-12efc8e8a803 None admin] RBAC: Adding query filter params (role.id=d818d9cd93494e0b8e7b6d6539bc808d, user.id=316ce9fae48442249d246599d026a555, scope.system=all) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:30.733874 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339ebec-ac30-4885-a6ae-12efc8e8a803 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:30.735412 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339ebec-ac30-4885-a6ae-12efc8e8a803 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:30.749571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 171/333] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Sep 5 14:14:30 2022] GET /identity/v3/role_assignments?user.id=316ce9fae48442249d246599d026a555&scope.system=all&role.id=d818d9cd93494e0b8e7b6d6539bc808d => generated 510 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:30.818706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02bb6b-ba49-47e4-960d-6b64eefc1197 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:30.858626 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2adbe0e-30cc-4687-9195-ece0537f911d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:30.859645 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adbe0e-30cc-4687-9195-ece0537f911d None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:30.860151 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adbe0e-30cc-4687-9195-ece0537f911d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:30.860728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adbe0e-30cc-4687-9195-ece0537f911d None admin] PATH_INFO: `/v3/system/users/5ee7fcf270ac4daf82dd8e81ce290793/roles/35ba371f3216414e950ba78ba9587bed` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:30.862480 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2adbe0e-30cc-4687-9195-ece0537f911d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5ee7fcf270ac4daf82dd8e81ce290793, role_id=35ba371f3216414e950ba78ba9587bed)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:30.864117 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2adbe0e-30cc-4687-9195-ece0537f911d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:30.934017 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 163/334] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Sep 5 14:14:30 2022] PUT /identity/v3/system/users/5ee7fcf270ac4daf82dd8e81ce290793/roles/35ba371f3216414e950ba78ba9587bed => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:14:32.143037 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a286d7-ca0f-4f14-8914-7517e8984ce5 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:32.143572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a286d7-ca0f-4f14-8914-7517e8984ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:32.143572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a286d7-ca0f-4f14-8914-7517e8984ce5 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:32.145169 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 172/335] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:32.152180 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6405019-20d0-40b2-b3c2-b717f4c72f92 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:32.152611 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6405019-20d0-40b2-b3c2-b717f4c72f92 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:32.152712 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6405019-20d0-40b2-b3c2-b717f4c72f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:32.173070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c6405019-20d0-40b2-b3c2-b717f4c72f92 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:32.174278 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c6405019-20d0-40b2-b3c2-b717f4c72f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:32.236741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:32.253892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 164/336] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:14:32.408971 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a97d0-dcfc-457b-a366-0623a44963b4 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:32.409302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a97d0-dcfc-457b-a366-0623a44963b4 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:32.409535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a97d0-dcfc-457b-a366-0623a44963b4 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:32.411171 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 173/337] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:32.417210 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0302b-4ed1-47b6-907f-a3c3bf8840db None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:32.417502 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0302b-4ed1-47b6-907f-a3c3bf8840db None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:32.417787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0302b-4ed1-47b6-907f-a3c3bf8840db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:32.439937 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-adb0302b-4ed1-47b6-907f-a3c3bf8840db None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:32.441158 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-adb0302b-4ed1-47b6-907f-a3c3bf8840db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:32.527752 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 165/338] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:32.761400 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a97d0-dcfc-457b-a366-0623a44963b4 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:32.796051 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:32.869986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353f60e-7f32-4b7b-bd9e-05a0da815cbd None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:32.870306 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353f60e-7f32-4b7b-bd9e-05a0da815cbd None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:32.870731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353f60e-7f32-4b7b-bd9e-05a0da815cbd None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:32.872078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 166/339] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:32.887382 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88bc0b-a6fd-4c0a-a452-9eae8e067ced None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:32.887686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88bc0b-a6fd-4c0a-a452-9eae8e067ced None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:32.887932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88bc0b-a6fd-4c0a-a452-9eae8e067ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:32.889933 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a97d0-dcfc-457b-a366-0623a44963b4 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:32.922081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-0d88bc0b-a6fd-4c0a-a452-9eae8e067ced None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:32.923286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0d88bc0b-a6fd-4c0a-a452-9eae8e067ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:32.945255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ae02e-644b-4265-a35d-039c14e7dd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:32.945897 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ae02e-644b-4265-a35d-039c14e7dd75 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:32.946177 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ae02e-644b-4265-a35d-039c14e7dd75 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:32.946449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ae02e-644b-4265-a35d-039c14e7dd75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:32.961611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ae02e-644b-4265-a35d-039c14e7dd75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:32.968660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-1f5ae02e-644b-4265-a35d-039c14e7dd75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:32.968660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:32.968660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:32.968660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:32.968660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:32.968660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:32.968660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:32.968660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:32.968660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:32.968660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:32.968660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:32.968660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:32.968660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:32.968660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:32.968660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:32.968660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:32.969572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:32.969572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:32.969572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:32.969572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:32.969572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:32.969572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:32.969572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:32.969572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:32.969572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:32.969572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:32.969572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:32.969572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:32.969572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:32.969572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:32.969572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:32.969572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:32.970352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:32.970352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:32.970352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:32.970352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:32.970352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:32.970352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:32.970352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:32.970352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:32.970352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:32.970352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:32.970352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:32.970352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:32.970352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 174/340] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:32.978122 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ae02e-644b-4265-a35d-039c14e7dd75 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:33.085485 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:33.100732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 167/341] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:33.102087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88bc0b-a6fd-4c0a-a452-9eae8e067ced None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:33.124434 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ae02e-644b-4265-a35d-039c14e7dd75 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:33.192820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659e788-cb14-48e1-8cee-3f7efc9ae35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:33.194733 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659e788-cb14-48e1-8cee-3f7efc9ae35f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:33.195345 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659e788-cb14-48e1-8cee-3f7efc9ae35f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:33.195819 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659e788-cb14-48e1-8cee-3f7efc9ae35f None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:33.196734 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659e788-cb14-48e1-8cee-3f7efc9ae35f None admin] RBAC: Adding query filter params (name=member) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:33.197290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659e788-cb14-48e1-8cee-3f7efc9ae35f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:33.203363 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:33.206465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659e788-cb14-48e1-8cee-3f7efc9ae35f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:33.221727 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 175/342] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:33.231188 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659e788-cb14-48e1-8cee-3f7efc9ae35f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:33.287275 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88bc0b-a6fd-4c0a-a452-9eae8e067ced None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:33.332275 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b65ef6-5c1b-48f6-8207-a5a24b137f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:33.333286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b65ef6-5c1b-48f6-8207-a5a24b137f41 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:33.333782 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b65ef6-5c1b-48f6-8207-a5a24b137f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:33.334361 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b65ef6-5c1b-48f6-8207-a5a24b137f41 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:33.353222 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b65ef6-5c1b-48f6-8207-a5a24b137f41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:33.359046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-79b65ef6-5c1b-48f6-8207-a5a24b137f41 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:33.359046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:33.359046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:33.359046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:33.359046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:33.359046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:33.359046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:33.359046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:33.359046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:33.359046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:33.359046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:33.359046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:33.359046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:33.359046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:33.359046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:33.359046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:33.359932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:33.359932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:33.359932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:33.359932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:33.359932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:33.359932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:33.359932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:33.359932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:33.359932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:33.359932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:33.359932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:33.359932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:33.359932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:33.359932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:33.359932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:33.359932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:33.360731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:33.360731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:33.360731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:33.360731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:33.360731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:33.360731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:33.360731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:33.360731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:33.360731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:33.360731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:33.360731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:33.360731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:33.363276 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 168/343] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 5 14:14:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:33.370154 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b65ef6-5c1b-48f6-8207-a5a24b137f41 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:33.411615 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659e788-cb14-48e1-8cee-3f7efc9ae35f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:33.509595 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b65ef6-5c1b-48f6-8207-a5a24b137f41 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:33.529391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:33.533774 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c66af2-dd9b-498e-a696-912bc7e1da6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:33.534403 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c66af2-dd9b-498e-a696-912bc7e1da6f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:33.534687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c66af2-dd9b-498e-a696-912bc7e1da6f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:33.534955 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c66af2-dd9b-498e-a696-912bc7e1da6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:33.558097 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:33.608033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f38da-cc2c-4cf7-8126-f67e9953faeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:33.608566 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f38da-cc2c-4cf7-8126-f67e9953faeb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:33.608846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f38da-cc2c-4cf7-8126-f67e9953faeb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:33.609148 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f38da-cc2c-4cf7-8126-f67e9953faeb None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:33.609826 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f38da-cc2c-4cf7-8126-f67e9953faeb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:33.610129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f38da-cc2c-4cf7-8126-f67e9953faeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:33.611513 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f38da-cc2c-4cf7-8126-f67e9953faeb None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:33.616222 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c66af2-dd9b-498e-a696-912bc7e1da6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:33.617876 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c66af2-dd9b-498e-a696-912bc7e1da6f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:33.627843 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 169/344] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:14:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:33.628713 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f38da-cc2c-4cf7-8126-f67e9953faeb None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:33.723483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 176/345] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:14:33.724416 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c66af2-dd9b-498e-a696-912bc7e1da6f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:33.773965 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:33.814348 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f38da-cc2c-4cf7-8126-f67e9953faeb None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:33.834857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c66af2-dd9b-498e-a696-912bc7e1da6f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:33.874084 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a733c0f-2255-418d-a364-8c2c095c05c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:33.874707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a733c0f-2255-418d-a364-8c2c095c05c8 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:33.874989 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a733c0f-2255-418d-a364-8c2c095c05c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:33.875258 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a733c0f-2255-418d-a364-8c2c095c05c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:33.877788 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49524b-4fe8-4c4f-b903-5016fc04dd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:33.878560 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49524b-4fe8-4c4f-b903-5016fc04dd54 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:33.878952 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49524b-4fe8-4c4f-b903-5016fc04dd54 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:33.879235 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49524b-4fe8-4c4f-b903-5016fc04dd54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:33.901801 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49524b-4fe8-4c4f-b903-5016fc04dd54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:33.907304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-fe49524b-4fe8-4c4f-b903-5016fc04dd54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:33.907304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:33.907304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:33.907304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:33.907304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:33.907304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:33.907304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:33.907304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:33.907304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:33.907304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:33.907304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:33.907304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:33.907304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:33.907304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:33.907304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:33.907304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:33.908266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:33.908266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:33.908266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:33.908266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:33.908266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:33.908266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:33.908266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:33.908266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:33.908266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:33.908266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:33.908266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:33.908266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:33.908266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:33.908266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:33.908266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:33.908266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:33.909124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:33.909124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:33.909124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:33.909124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:33.909124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:33.909124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:33.909124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:33.909124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:33.909124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:33.909124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:33.909124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:33.909124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:33.919249 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 170/346] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:33.920161 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49524b-4fe8-4c4f-b903-5016fc04dd54 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:33.956814 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a733c0f-2255-418d-a364-8c2c095c05c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:33.958320 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a733c0f-2255-418d-a364-8c2c095c05c8 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:33.997507 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:34.009442 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:34.074995 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 177/347] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:14:34.076117 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a733c0f-2255-418d-a364-8c2c095c05c8 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:34.087526 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49524b-4fe8-4c4f-b903-5016fc04dd54 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:34.130374 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95344c-f9ae-4905-a1cf-e8fd43466363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:34.130931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95344c-f9ae-4905-a1cf-e8fd43466363 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:34.131208 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95344c-f9ae-4905-a1cf-e8fd43466363 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:34.131478 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95344c-f9ae-4905-a1cf-e8fd43466363 None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:34.132611 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95344c-f9ae-4905-a1cf-e8fd43466363 None admin] RBAC: Authorizing `identity:get_project(project_id=3d25847b7b534c73bfb985bc2a1852cc)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:34.134820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95344c-f9ae-4905-a1cf-e8fd43466363 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:34.138205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 171/348] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:33 2022] GET /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:34.139469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90948896-d8c3-4794-aa99-fccff5278a31 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:34.139753 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90948896-d8c3-4794-aa99-fccff5278a31 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:34.140025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90948896-d8c3-4794-aa99-fccff5278a31 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:34.141657 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 172/349] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:34.142988 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90948896-d8c3-4794-aa99-fccff5278a31 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:34.189676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a733c0f-2255-418d-a364-8c2c095c05c8 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:34.247788 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3771c-f7fe-450b-a147-efa25c96e1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:34.248500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3771c-f7fe-450b-a147-efa25c96e1de None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:34.248759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3771c-f7fe-450b-a147-efa25c96e1de None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:34.249590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3771c-f7fe-450b-a147-efa25c96e1de None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:34.250277 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3771c-f7fe-450b-a147-efa25c96e1de None admin] RBAC: Adding query filter params (name=member) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:34.250580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3771c-f7fe-450b-a147-efa25c96e1de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:34.252038 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3771c-f7fe-450b-a147-efa25c96e1de None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:34.261970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 178/350] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:34.263119 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3771c-f7fe-450b-a147-efa25c96e1de None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:34.281979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:34.296278 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90948896-d8c3-4794-aa99-fccff5278a31 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:34.297890 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:34.351010 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36205d-6021-4a1a-a900-4f5395c55e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:34.351785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36205d-6021-4a1a-a900-4f5395c55e18 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:34.352070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36205d-6021-4a1a-a900-4f5395c55e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:34.352339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36205d-6021-4a1a-a900-4f5395c55e18 None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:34.355449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36205d-6021-4a1a-a900-4f5395c55e18 None admin] RBAC: Authorizing `identity:get_project(project_id=3d25847b7b534c73bfb985bc2a1852cc)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:34.357084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36205d-6021-4a1a-a900-4f5395c55e18 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:34.362667 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 173/351] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:34 2022] GET /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:34.362667 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66498677-4e2a-452d-b544-d7a59f8be890 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:34.362667 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66498677-4e2a-452d-b544-d7a59f8be890 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:34.362667 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66498677-4e2a-452d-b544-d7a59f8be890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:34.386174 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-66498677-4e2a-452d-b544-d7a59f8be890 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:34.387931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-66498677-4e2a-452d-b544-d7a59f8be890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:34.402897 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3771c-f7fe-450b-a147-efa25c96e1de None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:34.454693 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb28303-05d6-4c69-83eb-ebe54bf601eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:34.455676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb28303-05d6-4c69-83eb-ebe54bf601eb None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:34.456156 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb28303-05d6-4c69-83eb-ebe54bf601eb None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:34.456726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb28303-05d6-4c69-83eb-ebe54bf601eb None admin] PATH_INFO: `/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:34.465193 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb28303-05d6-4c69-83eb-ebe54bf601eb None admin] RBAC: Authorizing `identity:get_group(group_id=55eeb457cfb14c22a6fa715702f3d3cf)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:34.466904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb28303-05d6-4c69-83eb-ebe54bf601eb None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:34.470012 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 179/352] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 5 14:14:34 2022] GET /identity/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:34.475997 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb28303-05d6-4c69-83eb-ebe54bf601eb None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:34.487385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 174/353] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:34.489740 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66498677-4e2a-452d-b544-d7a59f8be890 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:34.605427 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:34.632807 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:34.641758 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66498677-4e2a-452d-b544-d7a59f8be890 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:34.641939 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb28303-05d6-4c69-83eb-ebe54bf601eb None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:34.690140 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05506a8-a4a4-43c3-9121-2c851c63009b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:34.690140 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05506a8-a4a4-43c3-9121-2c851c63009b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:34.690140 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05506a8-a4a4-43c3-9121-2c851c63009b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:34.690140 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05506a8-a4a4-43c3-9121-2c851c63009b None admin] PATH_INFO: `/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:34.690607 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05506a8-a4a4-43c3-9121-2c851c63009b None admin] RBAC: Authorizing `identity:get_group(group_id=55eeb457cfb14c22a6fa715702f3d3cf)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:34.690607 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05506a8-a4a4-43c3-9121-2c851c63009b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:34.693667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f04a73-8458-48ef-9a51-9a2dc0689c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:34.694367 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f04a73-8458-48ef-9a51-9a2dc0689c64 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:34.694737 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f04a73-8458-48ef-9a51-9a2dc0689c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:34.695096 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f04a73-8458-48ef-9a51-9a2dc0689c64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:34.696524 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 175/354] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 5 14:14:34 2022] GET /identity/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:34.700142 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05506a8-a4a4-43c3-9121-2c851c63009b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:34.779178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f04a73-8458-48ef-9a51-9a2dc0689c64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:34.781009 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f04a73-8458-48ef-9a51-9a2dc0689c64 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:34.832682 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05506a8-a4a4-43c3-9121-2c851c63009b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:34.871583 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:34.878735 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb2deb-b0ec-4f67-97e0-2eb42a318005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:34.879359 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb2deb-b0ec-4f67-97e0-2eb42a318005 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:34.879632 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb2deb-b0ec-4f67-97e0-2eb42a318005 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:34.890885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb2deb-b0ec-4f67-97e0-2eb42a318005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:34.890885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb2deb-b0ec-4f67-97e0-2eb42a318005 None admin] RBAC: Adding query filter params (group.id=55eeb457cfb14c22a6fa715702f3d3cf, role.id=d818d9cd93494e0b8e7b6d6539bc808d, scope.project.id=3d25847b7b534c73bfb985bc2a1852cc) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:34.890885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb2deb-b0ec-4f67-97e0-2eb42a318005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:34.890885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb2deb-b0ec-4f67-97e0-2eb42a318005 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:34.893206 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 176/355] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 5 14:14:34 2022] GET /identity/v3/role_assignments?group.id=55eeb457cfb14c22a6fa715702f3d3cf&scope.project.id=3d25847b7b534c73bfb985bc2a1852cc&role.id=d818d9cd93494e0b8e7b6d6539bc808d => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:34.895229 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c1d42-dc45-4136-ba51-b30cc721c7de None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:34.895709 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c1d42-dc45-4136-ba51-b30cc721c7de None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:34.896130 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c1d42-dc45-4136-ba51-b30cc721c7de None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:34.898853 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 177/356] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:34.899942 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c1d42-dc45-4136-ba51-b30cc721c7de None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:34.912200 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 180/357] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:14:34.918140 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f04a73-8458-48ef-9a51-9a2dc0689c64 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:34.943056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:35.046676 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c1d42-dc45-4136-ba51-b30cc721c7de None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:35.064520 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f04a73-8458-48ef-9a51-9a2dc0689c64 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:35.092757 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213028f9-4b48-43ea-a103-71ce7fba28f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:35.092757 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213028f9-4b48-43ea-a103-71ce7fba28f6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:35.092757 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213028f9-4b48-43ea-a103-71ce7fba28f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:35.092757 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213028f9-4b48-43ea-a103-71ce7fba28f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:35.093263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213028f9-4b48-43ea-a103-71ce7fba28f6 None admin] RBAC: Adding query filter params (group.id=55eeb457cfb14c22a6fa715702f3d3cf, role.id=a1ffbcf6f60f4aea99c7eb1dbcb34582, scope.project.id=3d25847b7b534c73bfb985bc2a1852cc) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:35.093263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213028f9-4b48-43ea-a103-71ce7fba28f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:35.095039 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213028f9-4b48-43ea-a103-71ce7fba28f6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:35.100453 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 178/358] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 5 14:14:34 2022] GET /identity/v3/role_assignments?group.id=55eeb457cfb14c22a6fa715702f3d3cf&scope.project.id=3d25847b7b534c73bfb985bc2a1852cc&role.id=a1ffbcf6f60f4aea99c7eb1dbcb34582 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:35.101793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee416e-ba2c-4945-bb7e-ac6dde0c19f4 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:35.102135 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee416e-ba2c-4945-bb7e-ac6dde0c19f4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:35.102481 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee416e-ba2c-4945-bb7e-ac6dde0c19f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:35.111994 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57743473-3fe3-4700-80ab-97febe9b9a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:35.112955 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57743473-3fe3-4700-80ab-97febe9b9a3c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:35.113407 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57743473-3fe3-4700-80ab-97febe9b9a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:35.113861 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57743473-3fe3-4700-80ab-97febe9b9a3c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:35.124240 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-56ee416e-ba2c-4945-bb7e-ac6dde0c19f4 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:35.125655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-56ee416e-ba2c-4945-bb7e-ac6dde0c19f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:35.127742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57743473-3fe3-4700-80ab-97febe9b9a3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:35.134318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-57743473-3fe3-4700-80ab-97febe9b9a3c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 14:14:35.134318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:35.134318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:35.134318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:35.134318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:35.134318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:35.134318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:35.134318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:35.134318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:35.134318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:35.134318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:35.134318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:35.134318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:35.134318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:35.134318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:35.134318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:35.136239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:35.136239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:35.136239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:35.136239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:35.136239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:35.136239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:35.136239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:35.136239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:35.136239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:35.136239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:35.136239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:35.136239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:35.136239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:35.136239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:35.136239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:35.136239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:35.137297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:35.137297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:35.137297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:35.137297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:35.137297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:35.137297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:35.137297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:35.137297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:35.137297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:35.137297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:35.137297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 14:14:35.137297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:35.139490 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 181/359] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:35.140946 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c54e78-3c0c-4198-a3e0-e1dbc1cf5acf None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:35.141427 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c54e78-3c0c-4198-a3e0-e1dbc1cf5acf None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:35.141864 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c54e78-3c0c-4198-a3e0-e1dbc1cf5acf None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:35.144042 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 182/360] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:35.148945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c54e78-3c0c-4198-a3e0-e1dbc1cf5acf None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:35.197512 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:35.216503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 179/361] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:35.217729 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee416e-ba2c-4945-bb7e-ac6dde0c19f4 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:35.247734 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:35.310524 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c54e78-3c0c-4198-a3e0-e1dbc1cf5acf None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:35.360443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4162d2-8040-411d-9f88-8121198307b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:35.361465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4162d2-8040-411d-9f88-8121198307b5 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:35.361947 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4162d2-8040-411d-9f88-8121198307b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:35.362436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4162d2-8040-411d-9f88-8121198307b5 None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:35.363785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4162d2-8040-411d-9f88-8121198307b5 None admin] RBAC: Authorizing `identity:get_project(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:35.365712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4162d2-8040-411d-9f88-8121198307b5 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:35.368846 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 183/362] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:35 2022] GET /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:35.371036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee076b-55d3-4d3b-bef5-c16c1a576707 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:35.371545 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee076b-55d3-4d3b-bef5-c16c1a576707 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:35.372035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee076b-55d3-4d3b-bef5-c16c1a576707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:35.381951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee416e-ba2c-4945-bb7e-ac6dde0c19f4 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:35.391821 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-22ee076b-55d3-4d3b-bef5-c16c1a576707 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:35.393369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-22ee076b-55d3-4d3b-bef5-c16c1a576707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:35.437801 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e17a0-2f16-4ebb-ad5b-df30168739e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:35.438339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e17a0-2f16-4ebb-ad5b-df30168739e3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:35.438614 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e17a0-2f16-4ebb-ad5b-df30168739e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:35.438882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e17a0-2f16-4ebb-ad5b-df30168739e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:35.439549 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e17a0-2f16-4ebb-ad5b-df30168739e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:35.439847 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e17a0-2f16-4ebb-ad5b-df30168739e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:35.441510 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e17a0-2f16-4ebb-ad5b-df30168739e3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:35.451853 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 180/363] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:35.452751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e17a0-2f16-4ebb-ad5b-df30168739e3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:35.469709 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 184/364] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:35.470868 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee076b-55d3-4d3b-bef5-c16c1a576707 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:35.511484 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:35.552550 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:35.571322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e17a0-2f16-4ebb-ad5b-df30168739e3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:35.609236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c18a23-06ac-4986-87c0-cc8c99a86948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:35.610104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c18a23-06ac-4986-87c0-cc8c99a86948 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:35.610615 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c18a23-06ac-4986-87c0-cc8c99a86948 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:35.611097 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c18a23-06ac-4986-87c0-cc8c99a86948 None admin] PATH_INFO: `/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:35.612486 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c18a23-06ac-4986-87c0-cc8c99a86948 None admin] RBAC: Authorizing `identity:get_group(group_id=55eeb457cfb14c22a6fa715702f3d3cf)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:35.614081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c18a23-06ac-4986-87c0-cc8c99a86948 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:35.614667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee076b-55d3-4d3b-bef5-c16c1a576707 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:35.615960 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 181/365] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 5 14:14:35 2022] GET /identity/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:35.624430 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c18a23-06ac-4986-87c0-cc8c99a86948 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:35.653489 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab41b3f-0031-4f6f-9168-044223054370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:35.654382 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab41b3f-0031-4f6f-9168-044223054370 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:35.654760 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab41b3f-0031-4f6f-9168-044223054370 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:35.655177 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab41b3f-0031-4f6f-9168-044223054370 None admin] PATH_INFO: `/v3/users/5ee7fcf270ac4daf82dd8e81ce290793` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:35.656493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab41b3f-0031-4f6f-9168-044223054370 None admin] RBAC: Authorizing `identity:get_user(user_id=5ee7fcf270ac4daf82dd8e81ce290793)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:35.658115 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab41b3f-0031-4f6f-9168-044223054370 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:35.660363 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 185/366] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:14:35 2022] GET /identity/v3/users/5ee7fcf270ac4daf82dd8e81ce290793 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:35.665676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab41b3f-0031-4f6f-9168-044223054370 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:35.747502 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c18a23-06ac-4986-87c0-cc8c99a86948 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:35.772456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:35.779537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab41b3f-0031-4f6f-9168-044223054370 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:35.793820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e77699-0580-4ebc-83ec-e5cd3c8601d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:35.795030 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e77699-0580-4ebc-83ec-e5cd3c8601d4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:35.795471 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e77699-0580-4ebc-83ec-e5cd3c8601d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:35.795849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e77699-0580-4ebc-83ec-e5cd3c8601d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:35.797016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e77699-0580-4ebc-83ec-e5cd3c8601d4 None admin] RBAC: Adding query filter params (group.id=55eeb457cfb14c22a6fa715702f3d3cf, role.id=d818d9cd93494e0b8e7b6d6539bc808d, scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:35.797609 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e77699-0580-4ebc-83ec-e5cd3c8601d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:35.799466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e77699-0580-4ebc-83ec-e5cd3c8601d4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:35.807064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 182/367] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 5 14:14:35 2022] GET /identity/v3/role_assignments?group.id=55eeb457cfb14c22a6fa715702f3d3cf&scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c&role.id=d818d9cd93494e0b8e7b6d6539bc808d => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:35.808010 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e77699-0580-4ebc-83ec-e5cd3c8601d4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:35.827584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f32fc0-1184-4c7f-b6d6-c44f9c070c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:35.828633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f32fc0-1184-4c7f-b6d6-c44f9c070c23 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:35.829050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f32fc0-1184-4c7f-b6d6-c44f9c070c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:35.829883 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f32fc0-1184-4c7f-b6d6-c44f9c070c23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:35.832152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:35.847346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f32fc0-1184-4c7f-b6d6-c44f9c070c23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:35.860871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-79f32fc0-1184-4c7f-b6d6-c44f9c070c23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:35.860871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:35.860871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:35.860871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:35.860871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:35.860871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:35.860871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:35.860871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:35.860871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:35.860871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:35.860871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:35.860871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:35.860871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:35.860871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:35.860871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:35.860871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:35.871516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:35.871516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:35.871516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:35.871516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:35.871516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:35.871516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:35.871516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:35.871516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:35.871516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:35.871516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:35.871516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:35.871516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:35.871516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:35.871516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:35.871516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:35.871516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:35.874630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:35.874630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:35.874630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:35.874630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:35.874630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:35.874630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:35.874630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:35.874630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:35.874630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:35.874630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:35.874630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:35.874630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:35.874630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 186/368] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 5 14:14:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:14:35.874630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f32fc0-1184-4c7f-b6d6-c44f9c070c23 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:36.027968 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e77699-0580-4ebc-83ec-e5cd3c8601d4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:36.067833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c596434-a3e3-460a-a0cb-222d0ae0131a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:36.068802 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c596434-a3e3-460a-a0cb-222d0ae0131a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:36.069338 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c596434-a3e3-460a-a0cb-222d0ae0131a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:36.069958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c596434-a3e3-460a-a0cb-222d0ae0131a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:36.070893 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c596434-a3e3-460a-a0cb-222d0ae0131a None admin] RBAC: Adding query filter params (role.id=35ba371f3216414e950ba78ba9587bed, user.id=5ee7fcf270ac4daf82dd8e81ce290793, scope.system=all) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:36.071392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c596434-a3e3-460a-a0cb-222d0ae0131a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:36.073473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c596434-a3e3-460a-a0cb-222d0ae0131a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:36.087513 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 183/369] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Sep 5 14:14:35 2022] GET /identity/v3/role_assignments?user.id=5ee7fcf270ac4daf82dd8e81ce290793&scope.system=all&role.id=35ba371f3216414e950ba78ba9587bed => generated 510 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:36.088858 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c596434-a3e3-460a-a0cb-222d0ae0131a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:36.095080 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f32fc0-1184-4c7f-b6d6-c44f9c070c23 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:36.163395 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba4e56-9827-4466-8005-878236d69a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:36.164205 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba4e56-9827-4466-8005-878236d69a1f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:36.164415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba4e56-9827-4466-8005-878236d69a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:36.164656 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba4e56-9827-4466-8005-878236d69a1f None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:36.166437 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba4e56-9827-4466-8005-878236d69a1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:36.166437 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba4e56-9827-4466-8005-878236d69a1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:36.167106 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba4e56-9827-4466-8005-878236d69a1f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:36.184634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 187/370] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:14:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:36.186005 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:36.191192 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba4e56-9827-4466-8005-878236d69a1f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:36.215984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c596434-a3e3-460a-a0cb-222d0ae0131a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:36.244404 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:36.259994 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b633eec-0a25-4623-9059-99a0aa0f3382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:36.261415 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b633eec-0a25-4623-9059-99a0aa0f3382 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:36.261895 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b633eec-0a25-4623-9059-99a0aa0f3382 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:36.262423 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b633eec-0a25-4623-9059-99a0aa0f3382 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:36.277454 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b633eec-0a25-4623-9059-99a0aa0f3382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:36.283813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-9b633eec-0a25-4623-9059-99a0aa0f3382 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:14:36.283813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:36.283813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:36.283813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:36.283813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:36.283813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:36.283813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:36.283813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:36.283813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:36.283813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:36.283813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:36.283813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:36.283813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:36.283813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:36.283813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:36.283813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:36.284779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:36.284779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:36.284779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:36.284779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:36.284779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:36.284779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:36.284779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:36.284779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:36.284779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:36.284779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:36.284779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:36.284779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:36.284779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:36.284779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:36.284779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:36.284779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:36.285628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:36.285628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:36.285628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:36.285628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:36.285628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:36.285628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:36.285628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:36.285628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:36.285628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:36.285628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:36.285628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:14:36.285628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:36.288173 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 184/371] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:14:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:36.294045 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b633eec-0a25-4623-9059-99a0aa0f3382 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:36.410596 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b633eec-0a25-4623-9059-99a0aa0f3382 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:36.422606 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba4e56-9827-4466-8005-878236d69a1f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:36.462556 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c1e7c-4ec8-4b35-9b53-7b42684b473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:36.464040 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c1e7c-4ec8-4b35-9b53-7b42684b473e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:36.464463 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c1e7c-4ec8-4b35-9b53-7b42684b473e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:36.464903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c1e7c-4ec8-4b35-9b53-7b42684b473e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:36.465023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092cb10-791c-4d5c-8481-f0ee6b73821a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:36.465856 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092cb10-791c-4d5c-8481-f0ee6b73821a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:36.466090 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092cb10-791c-4d5c-8481-f0ee6b73821a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:36.466487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092cb10-791c-4d5c-8481-f0ee6b73821a None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:36.467205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092cb10-791c-4d5c-8481-f0ee6b73821a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:36.467602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092cb10-791c-4d5c-8481-f0ee6b73821a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:36.469250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092cb10-791c-4d5c-8481-f0ee6b73821a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:36.471169 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:36.483983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 185/372] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:36.489735 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092cb10-791c-4d5c-8481-f0ee6b73821a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:36.565269 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c1e7c-4ec8-4b35-9b53-7b42684b473e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:36.566698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c1e7c-4ec8-4b35-9b53-7b42684b473e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:36.597512 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:36.681426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092cb10-791c-4d5c-8481-f0ee6b73821a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:36.734048 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f460aec-dc00-44cb-9cfe-933dc0e546b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:36.735000 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f460aec-dc00-44cb-9cfe-933dc0e546b5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:36.735499 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f460aec-dc00-44cb-9cfe-933dc0e546b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:36.735975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f460aec-dc00-44cb-9cfe-933dc0e546b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:36.736497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 188/373] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 14:14:36.741722 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c1e7c-4ec8-4b35-9b53-7b42684b473e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:36.870511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:36.881682 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f460aec-dc00-44cb-9cfe-933dc0e546b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:36.884792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f460aec-dc00-44cb-9cfe-933dc0e546b5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:36.894503 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c1e7c-4ec8-4b35-9b53-7b42684b473e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:36.939687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:36.970932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66551c81-a350-4136-8bf3-878c458b462b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:36.971668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66551c81-a350-4136-8bf3-878c458b462b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:36.971948 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66551c81-a350-4136-8bf3-878c458b462b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:36.972221 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66551c81-a350-4136-8bf3-878c458b462b None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:36.973573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66551c81-a350-4136-8bf3-878c458b462b None admin] RBAC: Authorizing `identity:get_project(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:36.975052 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66551c81-a350-4136-8bf3-878c458b462b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:36.976676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 189/374] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:36 2022] GET /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:36.983248 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66551c81-a350-4136-8bf3-878c458b462b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:37.047929 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 186/375] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 14:14:37.054087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f460aec-dc00-44cb-9cfe-933dc0e546b5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:37.159055 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:37.165471 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f460aec-dc00-44cb-9cfe-933dc0e546b5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:37.212802 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66551c81-a350-4136-8bf3-878c458b462b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:37.235222 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c43bb-9d7b-42ee-b294-c8bcb3dd3f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:37.235875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c43bb-9d7b-42ee-b294-c8bcb3dd3f93 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:37.236153 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c43bb-9d7b-42ee-b294-c8bcb3dd3f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:37.236426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c43bb-9d7b-42ee-b294-c8bcb3dd3f93 None admin] PATH_INFO: `/v3/projects/c738420b616e421c9aa849509b94fc5a` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:37.239507 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c43bb-9d7b-42ee-b294-c8bcb3dd3f93 None admin] RBAC: Authorizing `identity:get_project(project_id=c738420b616e421c9aa849509b94fc5a)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:37.241257 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c43bb-9d7b-42ee-b294-c8bcb3dd3f93 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:37.242905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 187/376] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:37 2022] GET /identity/v3/projects/c738420b616e421c9aa849509b94fc5a => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:37.252565 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c43bb-9d7b-42ee-b294-c8bcb3dd3f93 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:37.292940 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbd111-7dbf-47df-988b-c7730ea24f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:37.293603 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbd111-7dbf-47df-988b-c7730ea24f14 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:37.293882 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbd111-7dbf-47df-988b-c7730ea24f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:37.294151 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbd111-7dbf-47df-988b-c7730ea24f14 None admin] PATH_INFO: `/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:37.295459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbd111-7dbf-47df-988b-c7730ea24f14 None admin] RBAC: Authorizing `identity:get_group(group_id=55eeb457cfb14c22a6fa715702f3d3cf)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:37.296905 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbd111-7dbf-47df-988b-c7730ea24f14 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:37.302971 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 190/377] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 5 14:14:36 2022] GET /identity/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf => generated 226 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:37.304397 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbd111-7dbf-47df-988b-c7730ea24f14 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:37.395856 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c43bb-9d7b-42ee-b294-c8bcb3dd3f93 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:37.419972 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:37.434790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190290f-1bfd-489b-9262-f75dd55de8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:37.435615 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190290f-1bfd-489b-9262-f75dd55de8ad None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:37.435898 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190290f-1bfd-489b-9262-f75dd55de8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:37.436257 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190290f-1bfd-489b-9262-f75dd55de8ad None admin] PATH_INFO: `/v3/groups/138e584f7f8b4eb49782c8d8e1185f68` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:37.442471 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190290f-1bfd-489b-9262-f75dd55de8ad None admin] RBAC: Authorizing `identity:get_group(group_id=138e584f7f8b4eb49782c8d8e1185f68)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:37.444270 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190290f-1bfd-489b-9262-f75dd55de8ad None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:37.446866 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 188/378] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 5 14:14:37 2022] GET /identity/v3/groups/138e584f7f8b4eb49782c8d8e1185f68 => generated 229 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:37.453318 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190290f-1bfd-489b-9262-f75dd55de8ad None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:37.515049 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:37.536892 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbd111-7dbf-47df-988b-c7730ea24f14 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:37.571732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190290f-1bfd-489b-9262-f75dd55de8ad None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:37.611458 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8f492-121f-4019-9ec7-139c33547733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:37.612069 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8f492-121f-4019-9ec7-139c33547733 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:37.612338 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8f492-121f-4019-9ec7-139c33547733 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:37.612609 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8f492-121f-4019-9ec7-139c33547733 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:37.613358 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8f492-121f-4019-9ec7-139c33547733 None admin] RBAC: Adding query filter params (group.id=138e584f7f8b4eb49782c8d8e1185f68, role.id=f22e6e660eab44c5be25e3dee1e3042c, scope.project.id=c738420b616e421c9aa849509b94fc5a) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:37.613661 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8f492-121f-4019-9ec7-139c33547733 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:37.615732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8f492-121f-4019-9ec7-139c33547733 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:37.622755 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 189/379] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 5 14:14:37 2022] GET /identity/v3/role_assignments?group.id=138e584f7f8b4eb49782c8d8e1185f68&scope.project.id=c738420b616e421c9aa849509b94fc5a&role.id=f22e6e660eab44c5be25e3dee1e3042c => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:37.630940 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611bfb4-70e2-47e9-ab91-67bc4537f32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:37.631574 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611bfb4-70e2-47e9-ab91-67bc4537f32e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:37.631853 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611bfb4-70e2-47e9-ab91-67bc4537f32e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:37.632122 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611bfb4-70e2-47e9-ab91-67bc4537f32e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:37.632863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611bfb4-70e2-47e9-ab91-67bc4537f32e None admin] RBAC: Adding query filter params (group.id=55eeb457cfb14c22a6fa715702f3d3cf, role.id=a1ffbcf6f60f4aea99c7eb1dbcb34582, scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:37.633212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611bfb4-70e2-47e9-ab91-67bc4537f32e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:37.634667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611bfb4-70e2-47e9-ab91-67bc4537f32e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:37.635982 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20182a32-c2f0-47e2-a4f1-2ba97c5ba586 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:37.636359 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20182a32-c2f0-47e2-a4f1-2ba97c5ba586 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:37.637015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20182a32-c2f0-47e2-a4f1-2ba97c5ba586 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:37.638743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 190/380] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:14:37.644028 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4b900-5911-4070-b370-e21b3043928e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:37.644313 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4b900-5911-4070-b370-e21b3043928e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:37.644590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4b900-5911-4070-b370-e21b3043928e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:37.644734 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 191/381] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 5 14:14:37 2022] GET /identity/v3/role_assignments?group.id=55eeb457cfb14c22a6fa715702f3d3cf&scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c&role.id=a1ffbcf6f60f4aea99c7eb1dbcb34582 => generated 260 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:37.665278 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d5d4b900-5911-4070-b370-e21b3043928e None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:37.667013 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d5d4b900-5911-4070-b370-e21b3043928e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:37.763247 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 191/382] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:14:38.079876 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d91bc-b4ec-4ffb-8e1c-eb914b76e611 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:38.080218 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d91bc-b4ec-4ffb-8e1c-eb914b76e611 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:38.080401 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d91bc-b4ec-4ffb-8e1c-eb914b76e611 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:38.081958 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 192/383] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:38.087871 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2f7bf-5b0e-4d38-b6f2-a9113b10be96 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:38.088208 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2f7bf-5b0e-4d38-b6f2-a9113b10be96 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:38.089003 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2f7bf-5b0e-4d38-b6f2-a9113b10be96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:38.101245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d91bc-b4ec-4ffb-8e1c-eb914b76e611 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:38.120739 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-22f2f7bf-5b0e-4d38-b6f2-a9113b10be96 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:38.121965 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-22f2f7bf-5b0e-4d38-b6f2-a9113b10be96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:38.163433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:38.287492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 192/384] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:38.318541 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d91bc-b4ec-4ffb-8e1c-eb914b76e611 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:38.337820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:38.352725 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf24365-c450-4c88-aa76-c75ca6b5b7b2 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:38.353083 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf24365-c450-4c88-aa76-c75ca6b5b7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:38.353563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf24365-c450-4c88-aa76-c75ca6b5b7b2 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:38.356042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 193/385] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:38.361680 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb577a-62a0-4381-93df-25a54e1a5814 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:38.362071 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb577a-62a0-4381-93df-25a54e1a5814 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:38.362346 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb577a-62a0-4381-93df-25a54e1a5814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:38.363086 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb980584-550c-44b1-b4bc-18b374e9093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:38.363731 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb980584-550c-44b1-b4bc-18b374e9093d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:38.364005 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb980584-550c-44b1-b4bc-18b374e9093d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:38.364274 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb980584-550c-44b1-b4bc-18b374e9093d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:38.383881 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6ccb577a-62a0-4381-93df-25a54e1a5814 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:38.385603 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6ccb577a-62a0-4381-93df-25a54e1a5814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:38.388691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb980584-550c-44b1-b4bc-18b374e9093d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:38.393613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-fb980584-550c-44b1-b4bc-18b374e9093d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:38.393613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:38.393613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:38.393613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:38.393613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:38.393613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:38.393613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:38.393613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:38.393613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:38.393613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:38.393613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:38.393613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:38.393613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:38.393613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:38.393613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:38.393613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:38.396010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:38.396010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:38.396010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:38.396010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:38.396010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:38.396010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:38.396010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:38.396010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:38.396010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:38.396010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:38.396010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:38.396010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:38.396010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:38.396010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:38.396010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:38.396010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:38.398150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:38.398150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:38.398150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:38.398150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:38.398150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:38.398150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:38.398150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:38.398150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:38.398150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:38.398150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:38.398150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:38.398150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:38.398150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 193/386] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:38.403170 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb980584-550c-44b1-b4bc-18b374e9093d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:38.472446 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 194/387] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:38.553621 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb980584-550c-44b1-b4bc-18b374e9093d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:38.596195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd475143-a59a-40d9-88e2-3484160fac0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:38.596730 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd475143-a59a-40d9-88e2-3484160fac0f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:38.597007 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd475143-a59a-40d9-88e2-3484160fac0f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:38.597301 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd475143-a59a-40d9-88e2-3484160fac0f None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:38.597967 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd475143-a59a-40d9-88e2-3484160fac0f None admin] RBAC: Adding query filter params (name=member) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:38.598267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd475143-a59a-40d9-88e2-3484160fac0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:38.599645 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd475143-a59a-40d9-88e2-3484160fac0f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:38.608964 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 194/388] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:38.614233 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb577a-62a0-4381-93df-25a54e1a5814 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:38.686303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd475143-a59a-40d9-88e2-3484160fac0f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:38.732084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:38.767101 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb577a-62a0-4381-93df-25a54e1a5814 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:38.771494 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:38.842320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d793fa0-f96e-4bc8-9817-6f2d6d2a8a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:38.843200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d793fa0-f96e-4bc8-9817-6f2d6d2a8a82 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:38.843720 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d793fa0-f96e-4bc8-9817-6f2d6d2a8a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:38.844136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d793fa0-f96e-4bc8-9817-6f2d6d2a8a82 None admin] PATH_INFO: `/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:38.845514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d793fa0-f96e-4bc8-9817-6f2d6d2a8a82 None admin] RBAC: Authorizing `identity:get_group(group_id=55eeb457cfb14c22a6fa715702f3d3cf)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:38.847266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d793fa0-f96e-4bc8-9817-6f2d6d2a8a82 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:38.849101 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 195/389] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 5 14:14:38 2022] GET /identity/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:38.854507 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d793fa0-f96e-4bc8-9817-6f2d6d2a8a82 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:38.863185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd475143-a59a-40d9-88e2-3484160fac0f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:38.910258 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb0699-53c8-4f32-acc3-5f22d5414391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:38.910584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb0699-53c8-4f32-acc3-5f22d5414391 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:38.910865 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb0699-53c8-4f32-acc3-5f22d5414391 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:38.911141 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb0699-53c8-4f32-acc3-5f22d5414391 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:38.930742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb0699-53c8-4f32-acc3-5f22d5414391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:38.941540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-83cb0699-53c8-4f32-acc3-5f22d5414391 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:38.941540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:38.941540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:38.941540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:38.941540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:38.941540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:38.941540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:38.941540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:38.941540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:38.941540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:38.941540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:38.941540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:38.941540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:38.941540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:38.941540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:38.941540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:38.942449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:38.942449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:38.942449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:38.942449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:38.942449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:38.942449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:38.942449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:38.942449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:38.942449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:38.942449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:38.942449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:38.942449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:38.942449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:38.942449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:38.942449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:38.942449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:38.943255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:38.943255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:38.943255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:38.943255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:38.943255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:38.943255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:38.943255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:38.943255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:38.943255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:38.943255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:38.943255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:38.943255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:38.946136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 195/390] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 5 14:14:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:38.947292 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb0699-53c8-4f32-acc3-5f22d5414391 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:38.999688 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d793fa0-f96e-4bc8-9817-6f2d6d2a8a82 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:39.043468 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78485a12-0543-4ab4-bf30-c42cf306051b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:39.044113 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78485a12-0543-4ab4-bf30-c42cf306051b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:39.044387 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78485a12-0543-4ab4-bf30-c42cf306051b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:39.044656 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78485a12-0543-4ab4-bf30-c42cf306051b None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:39.047991 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78485a12-0543-4ab4-bf30-c42cf306051b None admin] RBAC: Authorizing `identity:get_project(project_id=3d25847b7b534c73bfb985bc2a1852cc)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:39.049510 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78485a12-0543-4ab4-bf30-c42cf306051b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:39.051890 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 196/391] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:38 2022] GET /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:39.052794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78485a12-0543-4ab4-bf30-c42cf306051b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:39.071902 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:39.076502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb0699-53c8-4f32-acc3-5f22d5414391 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:39.081766 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:39.125105 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e260f25-c512-4bf6-9288-18c056d72360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:39.125705 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e260f25-c512-4bf6-9288-18c056d72360 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:39.125984 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e260f25-c512-4bf6-9288-18c056d72360 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:39.126250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e260f25-c512-4bf6-9288-18c056d72360 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:39.140797 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e260f25-c512-4bf6-9288-18c056d72360 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:39.147377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-7e260f25-c512-4bf6-9288-18c056d72360 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:39.147377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:39.147377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:39.147377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:39.147377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:39.147377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:39.147377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:39.147377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:39.147377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:39.147377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:39.147377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:39.147377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:39.147377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:39.147377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:39.147377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:39.147377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:39.148263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:39.148263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:39.148263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:39.148263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:39.148263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:39.148263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:39.148263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:39.148263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:39.148263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:39.148263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:39.148263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:39.148263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:39.148263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:39.148263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:39.148263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:39.148263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:39.149050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:39.149050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:39.149050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:39.149050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:39.149050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:39.149050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:39.149050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:39.149050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:39.149050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:39.149050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:39.149050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:39.149050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:39.149705 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 196/392] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:39.153078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e260f25-c512-4bf6-9288-18c056d72360 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:39.195341 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78485a12-0543-4ab4-bf30-c42cf306051b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:39.251926 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136ae40-2555-4c35-8043-0796d7dff1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:39.252539 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136ae40-2555-4c35-8043-0796d7dff1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:39.252814 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136ae40-2555-4c35-8043-0796d7dff1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:39.253100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136ae40-2555-4c35-8043-0796d7dff1f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:39.253769 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136ae40-2555-4c35-8043-0796d7dff1f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:39.254066 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136ae40-2555-4c35-8043-0796d7dff1f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:39.255427 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136ae40-2555-4c35-8043-0796d7dff1f0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:39.266685 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 197/393] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:14:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:39.267516 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136ae40-2555-4c35-8043-0796d7dff1f0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:39.307843 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e260f25-c512-4bf6-9288-18c056d72360 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:39.356101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8102286-7273-48c6-b88a-2377bc27393f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:39.356763 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8102286-7273-48c6-b88a-2377bc27393f None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:39.357038 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8102286-7273-48c6-b88a-2377bc27393f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:39.357337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8102286-7273-48c6-b88a-2377bc27393f None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc/groups/55eeb457cfb14c22a6fa715702f3d3cf/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:39.359285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8102286-7273-48c6-b88a-2377bc27393f None admin] RBAC: Authorizing `identity:create_grant(project_id=3d25847b7b534c73bfb985bc2a1852cc, group_id=55eeb457cfb14c22a6fa715702f3d3cf, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:39.361072 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8102286-7273-48c6-b88a-2377bc27393f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:39.372444 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:39.394211 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136ae40-2555-4c35-8043-0796d7dff1f0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:39.423832 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 197/394] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Sep 5 14:14:39 2022] PUT /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc/groups/55eeb457cfb14c22a6fa715702f3d3cf/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:14:39.424658 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8102286-7273-48c6-b88a-2377bc27393f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:39.454313 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a66bb6-726f-4c3d-9f14-5c49bd66d219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:39.454935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a66bb6-726f-4c3d-9f14-5c49bd66d219 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:39.455210 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a66bb6-726f-4c3d-9f14-5c49bd66d219 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:39.455478 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a66bb6-726f-4c3d-9f14-5c49bd66d219 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:39.456155 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a66bb6-726f-4c3d-9f14-5c49bd66d219 None admin] RBAC: Adding query filter params (name=member) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:39.456454 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a66bb6-726f-4c3d-9f14-5c49bd66d219 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:39.459005 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a66bb6-726f-4c3d-9f14-5c49bd66d219 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:39.464017 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:39.480974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 198/395] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:39.486708 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a66bb6-726f-4c3d-9f14-5c49bd66d219 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:39.572414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8102286-7273-48c6-b88a-2377bc27393f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:39.619155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e32e1d-df94-424e-8996-7222a4edfaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:39.619970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e32e1d-df94-424e-8996-7222a4edfaff None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:39.620307 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e32e1d-df94-424e-8996-7222a4edfaff None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:39.620854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e32e1d-df94-424e-8996-7222a4edfaff None admin] PATH_INFO: `/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:39.622076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e32e1d-df94-424e-8996-7222a4edfaff None admin] RBAC: Authorizing `identity:get_group(group_id=55eeb457cfb14c22a6fa715702f3d3cf)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:39.623545 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e32e1d-df94-424e-8996-7222a4edfaff None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:39.625889 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 198/396] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 5 14:14:39 2022] GET /identity/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:39.632457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e32e1d-df94-424e-8996-7222a4edfaff None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:39.693805 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a66bb6-726f-4c3d-9f14-5c49bd66d219 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:39.739544 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ddd57-91d5-414a-aae9-2d0ec80ca167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:39.740164 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:39.741673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ddd57-91d5-414a-aae9-2d0ec80ca167 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:39.742015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ddd57-91d5-414a-aae9-2d0ec80ca167 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:39.742362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ddd57-91d5-414a-aae9-2d0ec80ca167 None admin] PATH_INFO: `/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:39.743633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ddd57-91d5-414a-aae9-2d0ec80ca167 None admin] RBAC: Authorizing `identity:get_group(group_id=55eeb457cfb14c22a6fa715702f3d3cf)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:39.745675 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ddd57-91d5-414a-aae9-2d0ec80ca167 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:39.747741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 199/397] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 5 14:14:39 2022] GET /identity/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:39.752948 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ddd57-91d5-414a-aae9-2d0ec80ca167 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:39.761755 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e32e1d-df94-424e-8996-7222a4edfaff None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:39.767485 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:39.841537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08583663-1592-4b76-bc3e-3172b7fe859b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:39.842181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08583663-1592-4b76-bc3e-3172b7fe859b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:39.842464 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08583663-1592-4b76-bc3e-3172b7fe859b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:39.842738 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08583663-1592-4b76-bc3e-3172b7fe859b None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:39.845434 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08583663-1592-4b76-bc3e-3172b7fe859b None admin] RBAC: Authorizing `identity:get_project(project_id=3d25847b7b534c73bfb985bc2a1852cc)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:39.846908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08583663-1592-4b76-bc3e-3172b7fe859b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:39.848582 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 199/398] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:39 2022] GET /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:39.871814 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08583663-1592-4b76-bc3e-3172b7fe859b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:39.958914 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ddd57-91d5-414a-aae9-2d0ec80ca167 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:39.999310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d271cf-30a0-41b2-a01a-b8c30a208b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:39.999935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d271cf-30a0-41b2-a01a-b8c30a208b0c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:40.000216 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d271cf-30a0-41b2-a01a-b8c30a208b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:40.000489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d271cf-30a0-41b2-a01a-b8c30a208b0c None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:40.001655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d271cf-30a0-41b2-a01a-b8c30a208b0c None admin] RBAC: Authorizing `identity:get_project(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:40.003144 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d271cf-30a0-41b2-a01a-b8c30a208b0c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:40.005094 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 200/399] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:39 2022] GET /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:40.011690 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d271cf-30a0-41b2-a01a-b8c30a208b0c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:40.100053 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08583663-1592-4b76-bc3e-3172b7fe859b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:40.126142 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:40.141389 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d271cf-30a0-41b2-a01a-b8c30a208b0c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:40.148046 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cbcc8-070c-46af-aaca-b23aa986b637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:40.148718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cbcc8-070c-46af-aaca-b23aa986b637 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:40.148992 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cbcc8-070c-46af-aaca-b23aa986b637 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:40.149289 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cbcc8-070c-46af-aaca-b23aa986b637 None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc/groups/55eeb457cfb14c22a6fa715702f3d3cf/roles/a1ffbcf6f60f4aea99c7eb1dbcb34582` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:40.152651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cbcc8-070c-46af-aaca-b23aa986b637 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d25847b7b534c73bfb985bc2a1852cc, group_id=55eeb457cfb14c22a6fa715702f3d3cf, role_id=a1ffbcf6f60f4aea99c7eb1dbcb34582)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:40.157470 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cbcc8-070c-46af-aaca-b23aa986b637 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:40.188197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a033e1-84d4-47ba-8cf5-9f0bb331bef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:40.188954 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a033e1-84d4-47ba-8cf5-9f0bb331bef8 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:40.189265 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a033e1-84d4-47ba-8cf5-9f0bb331bef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:40.189535 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a033e1-84d4-47ba-8cf5-9f0bb331bef8 None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c/groups/55eeb457cfb14c22a6fa715702f3d3cf/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:40.191413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a033e1-84d4-47ba-8cf5-9f0bb331bef8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c, group_id=55eeb457cfb14c22a6fa715702f3d3cf, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:40.192910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a033e1-84d4-47ba-8cf5-9f0bb331bef8 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:40.215464 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 200/400] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Sep 5 14:14:39 2022] PUT /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc/groups/55eeb457cfb14c22a6fa715702f3d3cf/roles/a1ffbcf6f60f4aea99c7eb1dbcb34582 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:14:40.215464 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4be809-1cc8-40c4-9127-ec110dfe474c None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:40.215464 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4be809-1cc8-40c4-9127-ec110dfe474c None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:40.215464 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4be809-1cc8-40c4-9127-ec110dfe474c None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:40.216010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 201/401] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:40.216523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cc026-97ad-497b-9a1a-a0c8ebe117bd None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:40.216803 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cc026-97ad-497b-9a1a-a0c8ebe117bd None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:40.217105 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cc026-97ad-497b-9a1a-a0c8ebe117bd None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:40.219566 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 202/402] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:40.220896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d27d3-d06c-4856-9c51-5a245d9496a4 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:40.221246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d27d3-d06c-4856-9c51-5a245d9496a4 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:40.221518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d27d3-d06c-4856-9c51-5a245d9496a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:40.242273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-af3d27d3-d06c-4856-9c51-5a245d9496a4 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:40.243396 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-af3d27d3-d06c-4856-9c51-5a245d9496a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:40.257542 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:40.274660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 201/403] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Sep 5 14:14:40 2022] PUT /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c/groups/55eeb457cfb14c22a6fa715702f3d3cf/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:14:40.277805 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7f6f4-9b8c-4ffd-85e5-00e228685f75 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:40.278358 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7f6f4-9b8c-4ffd-85e5-00e228685f75 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:40.279010 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7f6f4-9b8c-4ffd-85e5-00e228685f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:40.306773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-28f7f6f4-9b8c-4ffd-85e5-00e228685f75 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:40.311084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-28f7f6f4-9b8c-4ffd-85e5-00e228685f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:40.346254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 203/404] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:14:40.407365 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 202/405] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:40.680260 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d27d3-d06c-4856-9c51-5a245d9496a4 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:40.734462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7f6f4-9b8c-4ffd-85e5-00e228685f75 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:40.818031 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d27d3-d06c-4856-9c51-5a245d9496a4 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:40.837394 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:40.859964 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168b26c-b79a-4be9-a2e7-911e00e1b04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:40.864330 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168b26c-b79a-4be9-a2e7-911e00e1b04d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:40.864330 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168b26c-b79a-4be9-a2e7-911e00e1b04d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:40.864330 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168b26c-b79a-4be9-a2e7-911e00e1b04d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:40.875410 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168b26c-b79a-4be9-a2e7-911e00e1b04d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:40.880692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-a168b26c-b79a-4be9-a2e7-911e00e1b04d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:14:40.880692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:40.880692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:40.880692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:40.880692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:40.880692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:40.880692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:40.880692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:40.880692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:40.880692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:40.880692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:40.880692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:40.880692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:40.880692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:40.880692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:40.880692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:40.881668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:40.881668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:40.881668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:40.881668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:40.881668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:40.881668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:40.881668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:40.881668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:40.881668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:40.881668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:40.881668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:40.881668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:40.881668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:40.881668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:40.881668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:40.881668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:40.882667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:40.882667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:40.882667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:40.882667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:40.882667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:40.882667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:40.882667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:40.882667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:40.882667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:40.882667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:40.882667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:14:40.882667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:40.882667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 204/406] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:14:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:40.890902 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168b26c-b79a-4be9-a2e7-911e00e1b04d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:40.901458 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:40.935520 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7f6f4-9b8c-4ffd-85e5-00e228685f75 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:41.003796 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736567e-c1e1-4152-be1b-9e629a76ceec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:41.004946 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736567e-c1e1-4152-be1b-9e629a76ceec None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:41.005527 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736567e-c1e1-4152-be1b-9e629a76ceec None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:41.006007 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736567e-c1e1-4152-be1b-9e629a76ceec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:41.008137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168b26c-b79a-4be9-a2e7-911e00e1b04d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:41.031107 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736567e-c1e1-4152-be1b-9e629a76ceec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:41.037308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-b736567e-c1e1-4152-be1b-9e629a76ceec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:41.037308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:41.037308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:41.037308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:41.037308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:41.037308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:41.037308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:41.037308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:41.037308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:41.037308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:41.037308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:41.037308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:41.037308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:41.037308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:41.037308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:41.037308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:41.038197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:41.038197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:41.038197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:41.038197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:41.038197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:41.038197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:41.038197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:41.038197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:41.038197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:41.038197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:41.038197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:41.038197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:41.038197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:41.038197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:41.038197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:41.038197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:41.039000 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:41.039000 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:41.039000 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:41.039000 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:41.039000 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:41.039000 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:41.039000 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:41.039000 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:41.039000 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:41.039000 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:41.039000 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:41.039000 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:41.045220 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8db588-b149-4ba3-9c8d-168b0962af52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:41.045670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8db588-b149-4ba3-9c8d-168b0962af52 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:41.046246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8db588-b149-4ba3-9c8d-168b0962af52 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:41.046515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8db588-b149-4ba3-9c8d-168b0962af52 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:41.047182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8db588-b149-4ba3-9c8d-168b0962af52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:41.047485 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8db588-b149-4ba3-9c8d-168b0962af52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:41.048052 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 203/407] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 5 14:14:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:41.048886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8db588-b149-4ba3-9c8d-168b0962af52 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:41.053919 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736567e-c1e1-4152-be1b-9e629a76ceec None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:41.059467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 205/408] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:41.064511 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8db588-b149-4ba3-9c8d-168b0962af52 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:41.153153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:41.180870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8db588-b149-4ba3-9c8d-168b0962af52 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:41.221871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7e62d-d312-4e8c-85a9-89d7bd4d9100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:41.222478 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7e62d-d312-4e8c-85a9-89d7bd4d9100 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:41.222757 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7e62d-d312-4e8c-85a9-89d7bd4d9100 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:41.223030 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7e62d-d312-4e8c-85a9-89d7bd4d9100 None admin] PATH_INFO: `/v3/groups/138e584f7f8b4eb49782c8d8e1185f68` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:41.224337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7e62d-d312-4e8c-85a9-89d7bd4d9100 None admin] RBAC: Authorizing `identity:get_group(group_id=138e584f7f8b4eb49782c8d8e1185f68)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:41.225818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7e62d-d312-4e8c-85a9-89d7bd4d9100 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:41.231323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 206/409] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 5 14:14:41 2022] GET /identity/v3/groups/138e584f7f8b4eb49782c8d8e1185f68 => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:41.233571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7e62d-d312-4e8c-85a9-89d7bd4d9100 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:41.345539 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7e62d-d312-4e8c-85a9-89d7bd4d9100 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:41.371584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736567e-c1e1-4152-be1b-9e629a76ceec None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:41.384100 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a004b9-d3da-43b8-a6b6-a0405710c4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:41.385558 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a004b9-d3da-43b8-a6b6-a0405710c4e9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:41.385558 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a004b9-d3da-43b8-a6b6-a0405710c4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:41.385933 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a004b9-d3da-43b8-a6b6-a0405710c4e9 None admin] PATH_INFO: `/v3/projects/c738420b616e421c9aa849509b94fc5a` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:41.391773 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a004b9-d3da-43b8-a6b6-a0405710c4e9 None admin] RBAC: Authorizing `identity:get_project(project_id=c738420b616e421c9aa849509b94fc5a)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:41.393278 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a004b9-d3da-43b8-a6b6-a0405710c4e9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:41.399233 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 207/410] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:41 2022] GET /identity/v3/projects/c738420b616e421c9aa849509b94fc5a => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:41.400362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a004b9-d3da-43b8-a6b6-a0405710c4e9 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:41.407874 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:41.433415 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:41.450586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4c76b-87e8-4341-9bc2-2846bd1c3ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:41.451252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4c76b-87e8-4341-9bc2-2846bd1c3ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:41.451539 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4c76b-87e8-4341-9bc2-2846bd1c3ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:41.451793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4c76b-87e8-4341-9bc2-2846bd1c3ec8 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:41.452514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4c76b-87e8-4341-9bc2-2846bd1c3ec8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:41.452820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4c76b-87e8-4341-9bc2-2846bd1c3ec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:41.454290 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4c76b-87e8-4341-9bc2-2846bd1c3ec8 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:41.473575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 204/411] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:14:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:41.477427 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4c76b-87e8-4341-9bc2-2846bd1c3ec8 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:41.618862 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a004b9-d3da-43b8-a6b6-a0405710c4e9 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:41.639818 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4c76b-87e8-4341-9bc2-2846bd1c3ec8 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:41.684160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1eadb-679d-4f81-b707-484669eab639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:41.685560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1eadb-679d-4f81-b707-484669eab639 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:41.686046 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1eadb-679d-4f81-b707-484669eab639 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:41.686545 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1eadb-679d-4f81-b707-484669eab639 None admin] PATH_INFO: `/v3/projects/c738420b616e421c9aa849509b94fc5a/groups/138e584f7f8b4eb49782c8d8e1185f68/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:41.690102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1eadb-679d-4f81-b707-484669eab639 None admin] RBAC: Authorizing `identity:create_grant(project_id=c738420b616e421c9aa849509b94fc5a, group_id=138e584f7f8b4eb49782c8d8e1185f68, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:41.691770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1eadb-679d-4f81-b707-484669eab639 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:41.707926 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c477b6-655b-41b9-a53a-1bbb6d9a0c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:41.708902 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c477b6-655b-41b9-a53a-1bbb6d9a0c0e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:41.709416 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c477b6-655b-41b9-a53a-1bbb6d9a0c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:41.709892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c477b6-655b-41b9-a53a-1bbb6d9a0c0e None admin] PATH_INFO: `/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:41.711225 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c477b6-655b-41b9-a53a-1bbb6d9a0c0e None admin] RBAC: Authorizing `identity:get_group(group_id=55eeb457cfb14c22a6fa715702f3d3cf)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:41.712861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c477b6-655b-41b9-a53a-1bbb6d9a0c0e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:41.714907 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 205/412] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 5 14:14:41 2022] GET /identity/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:41.722547 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c477b6-655b-41b9-a53a-1bbb6d9a0c0e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:41.766153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 208/413] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Sep 5 14:14:41 2022] PUT /identity/v3/projects/c738420b616e421c9aa849509b94fc5a/groups/138e584f7f8b4eb49782c8d8e1185f68/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:14:41.797461 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:41.846002 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb14d6b-5dcd-4e14-9150-493bdd9bd22e None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:41.846375 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb14d6b-5dcd-4e14-9150-493bdd9bd22e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:41.846547 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb14d6b-5dcd-4e14-9150-493bdd9bd22e None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:41.848976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 209/414] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:14:41.850923 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c477b6-655b-41b9-a53a-1bbb6d9a0c0e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:41.855230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347b73f-a9ae-4cea-922c-8f68e813cf06 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:41.855516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347b73f-a9ae-4cea-922c-8f68e813cf06 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:41.855787 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347b73f-a9ae-4cea-922c-8f68e813cf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:41.878995 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-6347b73f-a9ae-4cea-922c-8f68e813cf06 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:41.880777 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6347b73f-a9ae-4cea-922c-8f68e813cf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:41.896212 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2a537-d704-4fd3-b071-688fb88bed5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:41.897733 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2a537-d704-4fd3-b071-688fb88bed5a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:41.898305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2a537-d704-4fd3-b071-688fb88bed5a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:41.898761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2a537-d704-4fd3-b071-688fb88bed5a None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:41.900302 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2a537-d704-4fd3-b071-688fb88bed5a None admin] RBAC: Authorizing `identity:get_project(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:41.903332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2a537-d704-4fd3-b071-688fb88bed5a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:41.906047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 206/415] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:41 2022] GET /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:41.914801 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2a537-d704-4fd3-b071-688fb88bed5a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:42.001954 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:42.017549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 210/416] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:42.078771 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2a537-d704-4fd3-b071-688fb88bed5a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:42.105965 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:42.120793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5248e-f268-4d1d-9553-847fe19eed40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:42.122270 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5248e-f268-4d1d-9553-847fe19eed40 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:42.122270 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5248e-f268-4d1d-9553-847fe19eed40 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:42.122731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5248e-f268-4d1d-9553-847fe19eed40 None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c/groups/55eeb457cfb14c22a6fa715702f3d3cf/roles/a1ffbcf6f60f4aea99c7eb1dbcb34582` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:42.125118 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab5248e-f268-4d1d-9553-847fe19eed40 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c, group_id=55eeb457cfb14c22a6fa715702f3d3cf, role_id=a1ffbcf6f60f4aea99c7eb1dbcb34582)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:42.126823 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab5248e-f268-4d1d-9553-847fe19eed40 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:42.190597 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 207/417] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Sep 5 14:14:41 2022] PUT /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c/groups/55eeb457cfb14c22a6fa715702f3d3cf/roles/a1ffbcf6f60f4aea99c7eb1dbcb34582 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:14:42.414049 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347b73f-a9ae-4cea-922c-8f68e813cf06 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:42.541993 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347b73f-a9ae-4cea-922c-8f68e813cf06 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:42.599002 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b68c0a-fc38-421f-b537-42f93dbf0dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:42.599640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b68c0a-fc38-421f-b537-42f93dbf0dca None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:42.599917 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b68c0a-fc38-421f-b537-42f93dbf0dca None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:42.600187 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b68c0a-fc38-421f-b537-42f93dbf0dca None admin] PATH_INFO: `/v3/roles/member` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:42.616401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daea41-756e-4767-9c60-997d6fb848ca None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:42.616685 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daea41-756e-4767-9c60-997d6fb848ca None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:42.616955 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daea41-756e-4767-9c60-997d6fb848ca None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:42.618545 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 208/418] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:42.619906 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b68c0a-fc38-421f-b537-42f93dbf0dca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:42.623972 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa470a-bfc4-4f5e-a302-53b16a66fd7f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:42.624256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa470a-bfc4-4f5e-a302-53b16a66fd7f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:42.624528 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa470a-bfc4-4f5e-a302-53b16a66fd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:42.624747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-11b68c0a-fc38-421f-b537-42f93dbf0dca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:42.624747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:42.624747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:42.624747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:42.624747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:42.624747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:42.624747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:42.624747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:42.624747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:42.624747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:42.624747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:42.624747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:42.624747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:42.624747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:42.624747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:42.624747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:42.625625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:42.625625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:42.625625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:42.625625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:42.625625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:42.625625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:42.625625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:42.625625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:42.625625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:42.625625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:42.625625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:42.625625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:42.625625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:42.625625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:42.625625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:42.625625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:42.626767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:42.626767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:42.626767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:42.626767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:42.626767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:42.626767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:42.626767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:42.626767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:42.626767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:42.626767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:42.626767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:42.626767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:42.626767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 211/419] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:42.638331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b68c0a-fc38-421f-b537-42f93dbf0dca None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:42.652239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-31fa470a-bfc4-4f5e-a302-53b16a66fd7f None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:42.653491 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-31fa470a-bfc4-4f5e-a302-53b16a66fd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:42.737716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:42.777157 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 209/420] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:14:42.778546 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ff8ef-1f19-49c7-87a4-7c424be338c6 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:42.778828 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ff8ef-1f19-49c7-87a4-7c424be338c6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:42.779095 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ff8ef-1f19-49c7-87a4-7c424be338c6 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:42.780684 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 210/421] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:42.790379 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458d088-82e6-4c54-bc85-2a026fea8977 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:42.790650 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458d088-82e6-4c54-bc85-2a026fea8977 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:42.790921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458d088-82e6-4c54-bc85-2a026fea8977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:42.815126 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b68c0a-fc38-421f-b537-42f93dbf0dca None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:42.833806 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4458d088-82e6-4c54-bc85-2a026fea8977 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:42.835003 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4458d088-82e6-4c54-bc85-2a026fea8977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:42.852927 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcba12-78f6-4479-b102-a477d4713d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:42.853557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcba12-78f6-4479-b102-a477d4713d6e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:42.857080 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcba12-78f6-4479-b102-a477d4713d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:42.857080 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcba12-78f6-4479-b102-a477d4713d6e None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:42.857080 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bcba12-78f6-4479-b102-a477d4713d6e None admin] RBAC: Adding query filter params (name=member) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:42.857080 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bcba12-78f6-4479-b102-a477d4713d6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:42.857080 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bcba12-78f6-4479-b102-a477d4713d6e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:42.865836 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 212/422] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:42.871415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcba12-78f6-4479-b102-a477d4713d6e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:42.932885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 211/423] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:43.066102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcba12-78f6-4479-b102-a477d4713d6e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:43.086468 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458d088-82e6-4c54-bc85-2a026fea8977 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:43.091340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:43.117107 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20894d01-4ab8-46b3-b85e-9e99565f0c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:43.117715 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20894d01-4ab8-46b3-b85e-9e99565f0c92 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:43.117994 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20894d01-4ab8-46b3-b85e-9e99565f0c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:43.118263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20894d01-4ab8-46b3-b85e-9e99565f0c92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:43.146914 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:43.207069 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458d088-82e6-4c54-bc85-2a026fea8977 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:43.246966 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dea1fe-1183-4fd4-b0f6-8dbebfd2f62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:43.247889 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dea1fe-1183-4fd4-b0f6-8dbebfd2f62d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:43.248367 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dea1fe-1183-4fd4-b0f6-8dbebfd2f62d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:43.248825 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dea1fe-1183-4fd4-b0f6-8dbebfd2f62d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:43.251914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20894d01-4ab8-46b3-b85e-9e99565f0c92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:43.253443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20894d01-4ab8-46b3-b85e-9e99565f0c92 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:43.260171 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dea1fe-1183-4fd4-b0f6-8dbebfd2f62d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:43.265572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-21dea1fe-1183-4fd4-b0f6-8dbebfd2f62d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:43.265572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:43.265572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:43.265572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:43.265572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:43.265572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:43.265572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:43.265572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:43.265572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:43.265572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:43.265572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:43.265572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:43.265572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:43.265572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:43.265572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:43.265572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:43.266511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:43.266511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:43.266511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:43.266511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:43.266511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:43.266511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:43.266511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:43.266511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:43.266511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:43.266511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:43.266511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:43.266511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:43.266511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:43.266511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:43.266511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:43.266511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:43.267292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:43.267292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:43.267292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:43.267292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:43.267292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:43.267292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:43.267292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:43.267292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:43.267292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:43.267292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:43.267292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:43.267292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:43.270064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 212/424] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 5 14:14:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:43.276459 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dea1fe-1183-4fd4-b0f6-8dbebfd2f62d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:43.374490 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 213/425] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 14:14:43.375392 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20894d01-4ab8-46b3-b85e-9e99565f0c92 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:43.384613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dea1fe-1183-4fd4-b0f6-8dbebfd2f62d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:43.393264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:43.396244 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:43.420943 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5967c3-1e72-4c1e-a9d3-fca409808771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:43.421685 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5967c3-1e72-4c1e-a9d3-fca409808771 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:43.422025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5967c3-1e72-4c1e-a9d3-fca409808771 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:43.422644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5967c3-1e72-4c1e-a9d3-fca409808771 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:43.433927 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5967c3-1e72-4c1e-a9d3-fca409808771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:43.438875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-ac5967c3-1e72-4c1e-a9d3-fca409808771 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:43.438875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:43.438875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:43.438875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:43.438875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:43.438875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:43.438875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:43.438875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:43.438875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:43.438875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:43.438875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:43.438875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:43.438875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:43.438875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:43.438875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:43.438875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:43.439961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:43.439961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:43.439961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:43.439961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:43.439961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:43.439961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:43.439961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:43.439961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:43.439961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:43.439961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:43.439961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:43.439961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:43.439961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:43.439961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:43.439961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:43.439961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:43.445084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:43.445084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:43.445084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:43.445084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:43.445084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:43.445084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:43.445084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:43.445084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:43.445084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:43.445084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:43.445084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 14:14:43.445084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:43.445084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 213/426] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:43.445084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5967c3-1e72-4c1e-a9d3-fca409808771 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:43.495411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20894d01-4ab8-46b3-b85e-9e99565f0c92 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:43.540146 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf842ae-7e52-40b1-8f6b-a661d700be14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:43.541127 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf842ae-7e52-40b1-8f6b-a661d700be14 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:43.542295 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf842ae-7e52-40b1-8f6b-a661d700be14 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:43.542724 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf842ae-7e52-40b1-8f6b-a661d700be14 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:43.543575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf842ae-7e52-40b1-8f6b-a661d700be14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:43.544133 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf842ae-7e52-40b1-8f6b-a661d700be14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:43.545837 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf842ae-7e52-40b1-8f6b-a661d700be14 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:43.551576 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5967c3-1e72-4c1e-a9d3-fca409808771 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:43.555689 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 214/427] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:14:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:43.556723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf842ae-7e52-40b1-8f6b-a661d700be14 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:43.601738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f96d3-c2b7-4c88-9a06-8dabc0ca5971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:43.602797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f96d3-c2b7-4c88-9a06-8dabc0ca5971 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:43.603077 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f96d3-c2b7-4c88-9a06-8dabc0ca5971 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:43.603348 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f96d3-c2b7-4c88-9a06-8dabc0ca5971 None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:43.605632 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f96d3-c2b7-4c88-9a06-8dabc0ca5971 None admin] RBAC: Authorizing `identity:get_project(project_id=3d25847b7b534c73bfb985bc2a1852cc)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:43.607085 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f96d3-c2b7-4c88-9a06-8dabc0ca5971 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:43.609530 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 214/428] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:43 2022] GET /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:43.610361 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f96d3-c2b7-4c88-9a06-8dabc0ca5971 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:43.647307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:43.659322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:43.691687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf842ae-7e52-40b1-8f6b-a661d700be14 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:43.725495 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f96d3-c2b7-4c88-9a06-8dabc0ca5971 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:43.741569 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0962f1e-ae4c-4985-97a2-4e8c9c5651cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:43.743022 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0962f1e-ae4c-4985-97a2-4e8c9c5651cc None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:43.743945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0962f1e-ae4c-4985-97a2-4e8c9c5651cc None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:43.745121 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0962f1e-ae4c-4985-97a2-4e8c9c5651cc None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:43.746087 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0962f1e-ae4c-4985-97a2-4e8c9c5651cc None admin] RBAC: Adding query filter params (name=member) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:43.746951 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0962f1e-ae4c-4985-97a2-4e8c9c5651cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:43.748994 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0962f1e-ae4c-4985-97a2-4e8c9c5651cc None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:43.761518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 215/429] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:14:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:43.762649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0962f1e-ae4c-4985-97a2-4e8c9c5651cc None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:43.773399 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ed57f-af0d-40a7-8991-56397646f3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:43.774306 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ed57f-af0d-40a7-8991-56397646f3af None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:43.774805 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ed57f-af0d-40a7-8991-56397646f3af None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:43.776402 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ed57f-af0d-40a7-8991-56397646f3af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:43.870191 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ed57f-af0d-40a7-8991-56397646f3af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:43.873079 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ed57f-af0d-40a7-8991-56397646f3af None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:43.890087 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0962f1e-ae4c-4985-97a2-4e8c9c5651cc None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:43.916562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:43.942258 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d5ca9-252c-4daa-9cbc-e635b58538e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:43.943655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d5ca9-252c-4daa-9cbc-e635b58538e2 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:43.944136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d5ca9-252c-4daa-9cbc-e635b58538e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:43.944996 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d5ca9-252c-4daa-9cbc-e635b58538e2 None admin] PATH_INFO: `/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:43.948103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d5ca9-252c-4daa-9cbc-e635b58538e2 None admin] RBAC: Authorizing `identity:get_group(group_id=55eeb457cfb14c22a6fa715702f3d3cf)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:43.950893 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d5ca9-252c-4daa-9cbc-e635b58538e2 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:43.953812 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 216/430] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 5 14:14:43 2022] GET /identity/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:43.955944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d5ca9-252c-4daa-9cbc-e635b58538e2 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:43.969266 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:44.012269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 215/431] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:14:44.013492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ed57f-af0d-40a7-8991-56397646f3af None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:44.073405 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d5ca9-252c-4daa-9cbc-e635b58538e2 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:44.109315 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcdaba-5427-41ba-ad00-ed795d981360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:44.110029 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcdaba-5427-41ba-ad00-ed795d981360 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:44.110373 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcdaba-5427-41ba-ad00-ed795d981360 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:44.110724 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcdaba-5427-41ba-ad00-ed795d981360 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:44.130744 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ed57f-af0d-40a7-8991-56397646f3af None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:44.168594 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652a9da-d105-4f2b-a4c7-30fae38c2be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:44.169559 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652a9da-d105-4f2b-a4c7-30fae38c2be3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:44.170121 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652a9da-d105-4f2b-a4c7-30fae38c2be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:44.170393 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652a9da-d105-4f2b-a4c7-30fae38c2be3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:44.171107 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652a9da-d105-4f2b-a4c7-30fae38c2be3 None admin] RBAC: Adding query filter params (group.id=55eeb457cfb14c22a6fa715702f3d3cf, role.id=d818d9cd93494e0b8e7b6d6539bc808d, scope.project.id=3d25847b7b534c73bfb985bc2a1852cc) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:44.171412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652a9da-d105-4f2b-a4c7-30fae38c2be3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:44.172968 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652a9da-d105-4f2b-a4c7-30fae38c2be3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:44.174881 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:44.184542 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcdaba-5427-41ba-ad00-ed795d981360 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:44.185343 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 216/432] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 5 14:14:44 2022] GET /identity/v3/role_assignments?group.id=55eeb457cfb14c22a6fa715702f3d3cf&scope.project.id=3d25847b7b534c73bfb985bc2a1852cc&role.id=d818d9cd93494e0b8e7b6d6539bc808d => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:44.192429 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcdaba-5427-41ba-ad00-ed795d981360 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:44.192583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652a9da-d105-4f2b-a4c7-30fae38c2be3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:44.199305 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:44.322961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 217/433] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:14:44.324476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4372aa6-605e-4dbe-b16b-3132e859e337 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:44.324938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4372aa6-605e-4dbe-b16b-3132e859e337 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:44.325386 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4372aa6-605e-4dbe-b16b-3132e859e337 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:44.331099 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 218/434] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:44.332573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb8773-1669-479d-8ae6-509cb093c5e9 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:44.332997 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb8773-1669-479d-8ae6-509cb093c5e9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:44.333444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb8773-1669-479d-8ae6-509cb093c5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:44.333756 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652a9da-d105-4f2b-a4c7-30fae38c2be3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:44.355802 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b3bb8773-1669-479d-8ae6-509cb093c5e9 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:44.357282 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b3bb8773-1669-479d-8ae6-509cb093c5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:44.372670 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb7c52-1ad0-4527-82c1-40868c953a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:44.373348 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb7c52-1ad0-4527-82c1-40868c953a4e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:44.373631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb7c52-1ad0-4527-82c1-40868c953a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:44.374428 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb7c52-1ad0-4527-82c1-40868c953a4e None admin] PATH_INFO: `/v3/projects/3d25847b7b534c73bfb985bc2a1852cc` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:44.375476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb7c52-1ad0-4527-82c1-40868c953a4e None admin] RBAC: Authorizing `identity:get_project(project_id=3d25847b7b534c73bfb985bc2a1852cc)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:44.376515 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb7c52-1ad0-4527-82c1-40868c953a4e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:44.378362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 217/435] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:44 2022] GET /identity/v3/projects/3d25847b7b534c73bfb985bc2a1852cc => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:44.378911 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb7c52-1ad0-4527-82c1-40868c953a4e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:44.455087 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 219/436] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:44.455857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb8773-1669-479d-8ae6-509cb093c5e9 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:44.489333 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:44.508646 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:44.514144 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb7c52-1ad0-4527-82c1-40868c953a4e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:44.563264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49759671-934d-4086-9b70-be4c2ad1db88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:44.564468 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49759671-934d-4086-9b70-be4c2ad1db88 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:44.564926 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49759671-934d-4086-9b70-be4c2ad1db88 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:44.565415 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49759671-934d-4086-9b70-be4c2ad1db88 None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:44.566826 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49759671-934d-4086-9b70-be4c2ad1db88 None admin] RBAC: Authorizing `identity:get_project(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:44.568938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49759671-934d-4086-9b70-be4c2ad1db88 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:44.572338 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 218/437] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:44 2022] GET /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:44.572338 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c5390-4159-491a-96f1-ac3eece38c03 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:44.572338 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c5390-4159-491a-96f1-ac3eece38c03 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:44.572338 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c5390-4159-491a-96f1-ac3eece38c03 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:44.574778 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 219/438] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:44.578739 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c5390-4159-491a-96f1-ac3eece38c03 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:44.590310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb8773-1669-479d-8ae6-509cb093c5e9 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:44.644211 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267781e8-767a-402f-97b0-9bbe2f1e88bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:44.644942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267781e8-767a-402f-97b0-9bbe2f1e88bb None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:44.645317 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267781e8-767a-402f-97b0-9bbe2f1e88bb None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:44.645587 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267781e8-767a-402f-97b0-9bbe2f1e88bb None admin] PATH_INFO: `/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:44.646699 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267781e8-767a-402f-97b0-9bbe2f1e88bb None admin] RBAC: Authorizing `identity:get_group(group_id=55eeb457cfb14c22a6fa715702f3d3cf)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:44.648397 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267781e8-767a-402f-97b0-9bbe2f1e88bb None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:44.651474 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 220/439] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 5 14:14:44 2022] GET /identity/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:44.652050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58398203-96ed-4751-9e53-3ea08e59bbd4 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:44.652270 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58398203-96ed-4751-9e53-3ea08e59bbd4 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:44.652655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58398203-96ed-4751-9e53-3ea08e59bbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:44.674735 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-58398203-96ed-4751-9e53-3ea08e59bbd4 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:44.676214 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-58398203-96ed-4751-9e53-3ea08e59bbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:44.721973 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c5390-4159-491a-96f1-ac3eece38c03 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:44.757795 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad3aa6-922b-4d14-bb14-c564e349d327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:44.758414 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad3aa6-922b-4d14-bb14-c564e349d327 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:44.758692 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad3aa6-922b-4d14-bb14-c564e349d327 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:44.758959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad3aa6-922b-4d14-bb14-c564e349d327 None admin] PATH_INFO: `/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:44.760599 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad3aa6-922b-4d14-bb14-c564e349d327 None admin] RBAC: Authorizing `identity:get_group(group_id=55eeb457cfb14c22a6fa715702f3d3cf)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:44.762046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad3aa6-922b-4d14-bb14-c564e349d327 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:44.763369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 221/440] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:44.763891 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 220/441] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 5 14:14:44 2022] GET /identity/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:44.768743 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58398203-96ed-4751-9e53-3ea08e59bbd4 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:44.769220 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad3aa6-922b-4d14-bb14-c564e349d327 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:44.771953 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:44.805699 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:44.876789 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58398203-96ed-4751-9e53-3ea08e59bbd4 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:44.879929 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad3aa6-922b-4d14-bb14-c564e349d327 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:44.915160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8dea5-8f93-4849-bb14-03cfc9c9cf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:44.916036 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8dea5-8f93-4849-bb14-03cfc9c9cf8c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:44.916990 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8dea5-8f93-4849-bb14-03cfc9c9cf8c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:44.917366 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514ca5f-0961-44b3-b44d-5b9d7024ffed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:44.917812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8dea5-8f93-4849-bb14-03cfc9c9cf8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:44.917922 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514ca5f-0961-44b3-b44d-5b9d7024ffed None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:44.918183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514ca5f-0961-44b3-b44d-5b9d7024ffed None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:44.918455 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514ca5f-0961-44b3-b44d-5b9d7024ffed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:44.919033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8dea5-8f93-4849-bb14-03cfc9c9cf8c None admin] RBAC: Adding query filter params (group.id=55eeb457cfb14c22a6fa715702f3d3cf, role.id=d818d9cd93494e0b8e7b6d6539bc808d, scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:44.919180 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514ca5f-0961-44b3-b44d-5b9d7024ffed None admin] RBAC: Adding query filter params (group.id=55eeb457cfb14c22a6fa715702f3d3cf, role.id=a1ffbcf6f60f4aea99c7eb1dbcb34582, scope.project.id=3d25847b7b534c73bfb985bc2a1852cc) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:44.919490 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514ca5f-0961-44b3-b44d-5b9d7024ffed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:44.919759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8dea5-8f93-4849-bb14-03cfc9c9cf8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:44.920939 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514ca5f-0961-44b3-b44d-5b9d7024ffed None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:44.921473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8dea5-8f93-4849-bb14-03cfc9c9cf8c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:44.927000 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 222/442] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 5 14:14:44 2022] GET /identity/v3/role_assignments?group.id=55eeb457cfb14c22a6fa715702f3d3cf&scope.project.id=3d25847b7b534c73bfb985bc2a1852cc&role.id=a1ffbcf6f60f4aea99c7eb1dbcb34582 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:44.927770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514ca5f-0961-44b3-b44d-5b9d7024ffed None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:44.949099 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 221/443] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 5 14:14:44 2022] GET /identity/v3/role_assignments?group.id=55eeb457cfb14c22a6fa715702f3d3cf&scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c&role.id=d818d9cd93494e0b8e7b6d6539bc808d => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:45.036913 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8dea5-8f93-4849-bb14-03cfc9c9cf8c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:45.062786 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:45.066017 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514ca5f-0961-44b3-b44d-5b9d7024ffed None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:45.109153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc990a1-d557-40c2-aa0e-5c89875e3685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:45.109796 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc990a1-d557-40c2-aa0e-5c89875e3685 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:45.110078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc990a1-d557-40c2-aa0e-5c89875e3685 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:45.110352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc990a1-d557-40c2-aa0e-5c89875e3685 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:45.123074 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc990a1-d557-40c2-aa0e-5c89875e3685 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:45.127900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-3dc990a1-d557-40c2-aa0e-5c89875e3685 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:14:45.127900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:45.127900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:45.127900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:45.127900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:45.127900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:45.127900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:45.127900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:45.127900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:45.127900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:45.127900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:45.127900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:45.127900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:45.127900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:45.127900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:45.127900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:45.128793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:45.128793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:45.128793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:45.128793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:45.128793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:45.128793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:45.128793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:45.128793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:45.128793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:45.128793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:45.128793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:45.128793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:45.128793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:45.128793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:45.128793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:45.128793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:45.129690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:45.129690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:45.129690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:45.129690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:45.129690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:45.129690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:45.129690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:45.129690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:45.129690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:45.129690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:45.129690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:14:45.129690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:45.130300 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 223/444] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:14:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:45.136204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc990a1-d557-40c2-aa0e-5c89875e3685 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:45.138788 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:45.183030 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8dea5-8f93-4849-bb14-03cfc9c9cf8c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:45.226740 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4767458-fe7c-4309-b554-15e8c0660d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:45.227369 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4767458-fe7c-4309-b554-15e8c0660d58 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:45.227706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4767458-fe7c-4309-b554-15e8c0660d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:45.227973 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4767458-fe7c-4309-b554-15e8c0660d58 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:45.242901 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4767458-fe7c-4309-b554-15e8c0660d58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:45.248503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-d4767458-fe7c-4309-b554-15e8c0660d58 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:45.248503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:45.248503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:45.248503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:45.248503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:45.248503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:45.248503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:45.248503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:45.248503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:45.248503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:45.248503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:45.248503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:45.248503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:45.248503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:45.248503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:45.248503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:45.249536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:45.249536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:45.249536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:45.249536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:45.249536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:45.249536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:45.249536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:45.249536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:45.249536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:45.249536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:45.249536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:45.249536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:45.249536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:45.249536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:45.249536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:45.249536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:45.250328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:45.250328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:45.250328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:45.250328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:45.250328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:45.250328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:45.250328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:45.250328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:45.250328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:45.250328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:45.250328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:45.250328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:45.250938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 222/445] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 5 14:14:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:14:45.256415 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4767458-fe7c-4309-b554-15e8c0660d58 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:45.263031 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc990a1-d557-40c2-aa0e-5c89875e3685 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:45.304010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e45ce-4de5-414d-aa14-ccc087e6b4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:45.304610 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e45ce-4de5-414d-aa14-ccc087e6b4ca None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:45.305384 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e45ce-4de5-414d-aa14-ccc087e6b4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:45.305671 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e45ce-4de5-414d-aa14-ccc087e6b4ca None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:45.306351 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e45ce-4de5-414d-aa14-ccc087e6b4ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:45.306664 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e45ce-4de5-414d-aa14-ccc087e6b4ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:45.308795 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e45ce-4de5-414d-aa14-ccc087e6b4ca None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:45.319446 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 224/446] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:45.324255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e45ce-4de5-414d-aa14-ccc087e6b4ca None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:45.350373 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:45.381328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4767458-fe7c-4309-b554-15e8c0660d58 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:45.415936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:45.427256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448ea09-9674-4489-bb08-a969f6e41d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:45.427873 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448ea09-9674-4489-bb08-a969f6e41d64 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:45.428499 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448ea09-9674-4489-bb08-a969f6e41d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:45.428499 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448ea09-9674-4489-bb08-a969f6e41d64 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:45.429066 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448ea09-9674-4489-bb08-a969f6e41d64 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:45.429385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448ea09-9674-4489-bb08-a969f6e41d64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:45.430826 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448ea09-9674-4489-bb08-a969f6e41d64 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:45.442990 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 223/447] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:14:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:45.448366 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e45ce-4de5-414d-aa14-ccc087e6b4ca None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:45.448549 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448ea09-9674-4489-bb08-a969f6e41d64 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:45.492350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f045d59-c17b-495e-8ad0-dc47b33d229d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:45.493072 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f045d59-c17b-495e-8ad0-dc47b33d229d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:45.493658 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f045d59-c17b-495e-8ad0-dc47b33d229d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:45.493868 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f045d59-c17b-495e-8ad0-dc47b33d229d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:45.555493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448ea09-9674-4489-bb08-a969f6e41d64 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:45.565287 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f045d59-c17b-495e-8ad0-dc47b33d229d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:45.566751 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f045d59-c17b-495e-8ad0-dc47b33d229d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:45.588771 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aeff7b-bea6-4087-8edb-b1b23efe939d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:45.589504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeff7b-bea6-4087-8edb-b1b23efe939d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:45.589781 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeff7b-bea6-4087-8edb-b1b23efe939d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:45.589988 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:45.590075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeff7b-bea6-4087-8edb-b1b23efe939d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:45.644412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:45.656436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aeff7b-bea6-4087-8edb-b1b23efe939d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:45.657921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aeff7b-bea6-4087-8edb-b1b23efe939d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:45.664361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 225/448] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 14:14:45.670544 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f045d59-c17b-495e-8ad0-dc47b33d229d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:45.755926 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 224/449] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 14:14:45.762168 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aeff7b-bea6-4087-8edb-b1b23efe939d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:45.768093 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f045d59-c17b-495e-8ad0-dc47b33d229d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:45.790169 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:45.802366 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63b057-4794-47ed-a3b3-87dc334c2d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:45.803280 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63b057-4794-47ed-a3b3-87dc334c2d21 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:45.803280 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63b057-4794-47ed-a3b3-87dc334c2d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:45.803575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63b057-4794-47ed-a3b3-87dc334c2d21 None admin] PATH_INFO: `/v3/projects/c738420b616e421c9aa849509b94fc5a` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:45.804718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63b057-4794-47ed-a3b3-87dc334c2d21 None admin] RBAC: Authorizing `identity:get_project(project_id=c738420b616e421c9aa849509b94fc5a)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:45.806260 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63b057-4794-47ed-a3b3-87dc334c2d21 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:45.807868 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 226/450] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:45 2022] GET /identity/v3/projects/c738420b616e421c9aa849509b94fc5a => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:45.813251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63b057-4794-47ed-a3b3-87dc334c2d21 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:45.848963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:45.862036 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aeff7b-bea6-4087-8edb-b1b23efe939d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:45.896399 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527dc40-e47c-4071-8d32-d4b387ce2cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:45.897026 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527dc40-e47c-4071-8d32-d4b387ce2cac None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:45.897328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527dc40-e47c-4071-8d32-d4b387ce2cac None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:45.897600 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527dc40-e47c-4071-8d32-d4b387ce2cac None admin] PATH_INFO: `/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:45.898695 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527dc40-e47c-4071-8d32-d4b387ce2cac None admin] RBAC: Authorizing `identity:get_project(project_id=4ea82229c5fd4bc6b6f02a6f7957f03c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:45.900158 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527dc40-e47c-4071-8d32-d4b387ce2cac None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:45.901804 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 225/451] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:14:45 2022] GET /identity/v3/projects/4ea82229c5fd4bc6b6f02a6f7957f03c => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:45.907172 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527dc40-e47c-4071-8d32-d4b387ce2cac None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:45.914538 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63b057-4794-47ed-a3b3-87dc334c2d21 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:45.950030 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf0789-0f23-4412-9d8f-545e69e67d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:45.950650 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf0789-0f23-4412-9d8f-545e69e67d0e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:45.950927 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf0789-0f23-4412-9d8f-545e69e67d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:45.951195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf0789-0f23-4412-9d8f-545e69e67d0e None admin] PATH_INFO: `/v3/groups/138e584f7f8b4eb49782c8d8e1185f68` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:45.952298 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf0789-0f23-4412-9d8f-545e69e67d0e None admin] RBAC: Authorizing `identity:get_group(group_id=138e584f7f8b4eb49782c8d8e1185f68)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:45.953766 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf0789-0f23-4412-9d8f-545e69e67d0e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:45.955300 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 227/452] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 5 14:14:45 2022] GET /identity/v3/groups/138e584f7f8b4eb49782c8d8e1185f68 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:45.961107 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf0789-0f23-4412-9d8f-545e69e67d0e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:46.011237 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527dc40-e47c-4071-8d32-d4b387ce2cac None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:46.022464 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:46.045737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b1cb5-0649-4c07-976a-a541dfc255ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:46.046362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b1cb5-0649-4c07-976a-a541dfc255ef None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:46.046636 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b1cb5-0649-4c07-976a-a541dfc255ef None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:46.046907 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b1cb5-0649-4c07-976a-a541dfc255ef None admin] PATH_INFO: `/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:46.048004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b1cb5-0649-4c07-976a-a541dfc255ef None admin] RBAC: Authorizing `identity:get_group(group_id=55eeb457cfb14c22a6fa715702f3d3cf)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:46.049470 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b1cb5-0649-4c07-976a-a541dfc255ef None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:46.051557 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 226/453] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Sep 5 14:14:45 2022] GET /identity/v3/groups/55eeb457cfb14c22a6fa715702f3d3cf => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:46.057594 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b1cb5-0649-4c07-976a-a541dfc255ef None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:46.066297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf0789-0f23-4412-9d8f-545e69e67d0e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:46.082749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:46.099988 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1775cf-e1eb-433a-9436-212785f3ddce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:46.100579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1775cf-e1eb-433a-9436-212785f3ddce None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:46.100854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1775cf-e1eb-433a-9436-212785f3ddce None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:46.101149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1775cf-e1eb-433a-9436-212785f3ddce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:46.101866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1775cf-e1eb-433a-9436-212785f3ddce None admin] RBAC: Adding query filter params (group.id=138e584f7f8b4eb49782c8d8e1185f68, role.id=f22e6e660eab44c5be25e3dee1e3042c, scope.project.id=c738420b616e421c9aa849509b94fc5a) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:46.102168 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1775cf-e1eb-433a-9436-212785f3ddce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:46.103658 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1775cf-e1eb-433a-9436-212785f3ddce None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:46.109203 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 228/454] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 5 14:14:45 2022] GET /identity/v3/role_assignments?group.id=138e584f7f8b4eb49782c8d8e1185f68&scope.project.id=c738420b616e421c9aa849509b94fc5a&role.id=f22e6e660eab44c5be25e3dee1e3042c => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:46.161866 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b1cb5-0649-4c07-976a-a541dfc255ef None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:46.200003 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267d1fe-1e9e-441b-a159-ea21da1534f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:46.200632 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267d1fe-1e9e-441b-a159-ea21da1534f3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:46.200913 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267d1fe-1e9e-441b-a159-ea21da1534f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:46.201219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267d1fe-1e9e-441b-a159-ea21da1534f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:46.201964 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267d1fe-1e9e-441b-a159-ea21da1534f3 None admin] RBAC: Adding query filter params (group.id=55eeb457cfb14c22a6fa715702f3d3cf, role.id=a1ffbcf6f60f4aea99c7eb1dbcb34582, scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:46.202273 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267d1fe-1e9e-441b-a159-ea21da1534f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:46.203761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267d1fe-1e9e-441b-a159-ea21da1534f3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:46.210260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 227/455] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Sep 5 14:14:46 2022] GET /identity/v3/role_assignments?group.id=55eeb457cfb14c22a6fa715702f3d3cf&scope.project.id=4ea82229c5fd4bc6b6f02a6f7957f03c&role.id=a1ffbcf6f60f4aea99c7eb1dbcb34582 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:48.637673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcbca1-1a8b-46ef-966d-bb8e0e4b2f22 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:48.638654 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcbca1-1a8b-46ef-966d-bb8e0e4b2f22 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:48.639151 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcbca1-1a8b-46ef-966d-bb8e0e4b2f22 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:48.640956 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 229/456] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:48.646847 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13486fb-e874-4bb1-b4e0-29ab4e3ddb7b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:48.647700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13486fb-e874-4bb1-b4e0-29ab4e3ddb7b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:48.648209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13486fb-e874-4bb1-b4e0-29ab4e3ddb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:48.674675 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e13486fb-e874-4bb1-b4e0-29ab4e3ddb7b None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:48.676481 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e13486fb-e874-4bb1-b4e0-29ab4e3ddb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:48.766686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 228/457] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:14:48.820549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e4d3c-9426-467f-9827-2220a0f3b4dd None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:48.820858 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e4d3c-9426-467f-9827-2220a0f3b4dd None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:48.821121 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e4d3c-9426-467f-9827-2220a0f3b4dd None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:48.823299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 230/458] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:48.828552 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeac27-6bdd-43a3-9abc-b59cc31b694d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:48.829108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeac27-6bdd-43a3-9abc-b59cc31b694d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:48.829582 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeac27-6bdd-43a3-9abc-b59cc31b694d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:48.856317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3beeac27-6bdd-43a3-9abc-b59cc31b694d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:48.857883 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3beeac27-6bdd-43a3-9abc-b59cc31b694d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:48.872520 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:48.951196 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 229/459] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:49.002259 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8e967-a15a-4485-b3c7-d375081849ea None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:49.002572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8e967-a15a-4485-b3c7-d375081849ea None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:49.002799 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8e967-a15a-4485-b3c7-d375081849ea None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:49.004380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 231/460] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:49.009558 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358e620-12f3-4b15-ab18-519d41e30028 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:49.009959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358e620-12f3-4b15-ab18-519d41e30028 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:49.010366 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358e620-12f3-4b15-ab18-519d41e30028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:49.041244 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d358e620-12f3-4b15-ab18-519d41e30028 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:49.042464 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d358e620-12f3-4b15-ab18-519d41e30028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:49.125175 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 230/461] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:49.141981 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8e967-a15a-4485-b3c7-d375081849ea None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:49.278816 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8e967-a15a-4485-b3c7-d375081849ea None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:49.307029 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:49.324843 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e83cfa-0a44-492f-9962-d8a445a2c0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:49.325561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e83cfa-0a44-492f-9962-d8a445a2c0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:49.325834 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e83cfa-0a44-492f-9962-d8a445a2c0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:49.326099 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e83cfa-0a44-492f-9962-d8a445a2c0e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:49.337155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e83cfa-0a44-492f-9962-d8a445a2c0e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:49.339152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e83cfa-0a44-492f-9962-d8a445a2c0e1 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:49.358744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-c9e83cfa-0a44-492f-9962-d8a445a2c0e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:49.358744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:49.358744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:49.358744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:49.358744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:49.358744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:49.358744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:49.358744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:49.358744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:49.358744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:49.358744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:49.358744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:49.358744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:14:49.358744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:14:49.358744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:14:49.358744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:14:49.359690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:49.359690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:49.359690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:49.359690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:49.359690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:49.359690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:49.359690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:49.359690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:49.359690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:49.359690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:49.359690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:49.359690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:49.359690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:49.359690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:49.359690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:49.359690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:49.359690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:14:49.360604 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:14:49.360604 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:49.360604 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:49.365520 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 232/462] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:49.365773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358e620-12f3-4b15-ab18-519d41e30028 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:49.403262 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e83cfa-0a44-492f-9962-d8a445a2c0e1 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:49.526822 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:49.543342 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e83cfa-0a44-492f-9962-d8a445a2c0e1 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:49.546448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358e620-12f3-4b15-ab18-519d41e30028 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:49.578202 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b80a3-f7d7-469a-aba0-433ce372f2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:49.578823 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b80a3-f7d7-469a-aba0-433ce372f2db None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:49.579097 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b80a3-f7d7-469a-aba0-433ce372f2db None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:49.579364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b80a3-f7d7-469a-aba0-433ce372f2db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:49.583101 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54045372-7edc-472f-b8dd-444650dc6a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:49.583708 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54045372-7edc-472f-b8dd-444650dc6a17 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:49.583987 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54045372-7edc-472f-b8dd-444650dc6a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:49.584264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54045372-7edc-472f-b8dd-444650dc6a17 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:49.584906 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54045372-7edc-472f-b8dd-444650dc6a17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:49.585248 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54045372-7edc-472f-b8dd-444650dc6a17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:49.586733 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54045372-7edc-472f-b8dd-444650dc6a17 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:49.590499 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b80a3-f7d7-469a-aba0-433ce372f2db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:49.591972 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b80a3-f7d7-469a-aba0-433ce372f2db None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:49.599563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 231/463] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:49.600661 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54045372-7edc-472f-b8dd-444650dc6a17 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:49.612183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-a86b80a3-f7d7-469a-aba0-433ce372f2db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:49.612183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:49.612183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:49.612183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:49.612183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:49.612183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:49.612183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:49.612183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:49.612183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:49.612183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:49.612183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:49.612183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:49.612183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:14:49.612183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:14:49.612183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:14:49.612183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:14:49.614617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:49.614617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:49.614617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:49.614617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:49.614617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:49.614617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:49.614617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:49.614617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:49.614617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:49.614617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:49.614617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:49.614617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:49.614617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:49.614617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:49.614617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:49.614617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:49.614617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:14:49.616745 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:14:49.616745 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:49.616745 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:49.616745 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 233/464] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:49.616745 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b80a3-f7d7-469a-aba0-433ce372f2db None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:49.647594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:49.710910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54045372-7edc-472f-b8dd-444650dc6a17 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:49.723388 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b80a3-f7d7-469a-aba0-433ce372f2db None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:49.754322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9728da-edfa-4642-aed0-5bee1090ad01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:49.755363 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9728da-edfa-4642-aed0-5bee1090ad01 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:49.755788 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9728da-edfa-4642-aed0-5bee1090ad01 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:49.756191 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9728da-edfa-4642-aed0-5bee1090ad01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:49.763330 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5c07b-68f9-4bc8-babc-d089060bc4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:49.764033 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5c07b-68f9-4bc8-babc-d089060bc4e4 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:49.765296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5c07b-68f9-4bc8-babc-d089060bc4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:49.765296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5c07b-68f9-4bc8-babc-d089060bc4e4 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:49.765572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:49.765703 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5c07b-68f9-4bc8-babc-d089060bc4e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:49.766994 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5c07b-68f9-4bc8-babc-d089060bc4e4 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:49.768439 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9728da-edfa-4642-aed0-5bee1090ad01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:49.769985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9728da-edfa-4642-aed0-5bee1090ad01 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:49.786104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-dd9728da-edfa-4642-aed0-5bee1090ad01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:49.786104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:49.786104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:49.786104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:49.786104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:49.786104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:49.786104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:49.786104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:49.786104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:49.786104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:49.786104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:49.786104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:49.786104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:14:49.786104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:14:49.786104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:14:49.786104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:14:49.787042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:49.787042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:49.787042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:49.787042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:49.787042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:49.787042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:49.787042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:49.787042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:49.787042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:49.787042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:49.787042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:49.787042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:49.787042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:49.787042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:49.787042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:49.787042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:49.787042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:14:49.787898 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:14:49.787898 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:49.787898 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:49.787898 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 232/465] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:49.788404 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9728da-edfa-4642-aed0-5bee1090ad01 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:49.881114 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 234/466] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 5 14:14:49 2022] POST /identity/v3/users => generated 246 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:14:49.882657 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f97ddf-7205-4757-a064-741870ffcf25 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:49.882988 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f97ddf-7205-4757-a064-741870ffcf25 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:49.883266 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f97ddf-7205-4757-a064-741870ffcf25 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:49.884640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 235/467] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:49.885749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f97ddf-7205-4757-a064-741870ffcf25 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:49.907988 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9728da-edfa-4642-aed0-5bee1090ad01 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:49.951674 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dcf6d-7fcf-46c2-9eb4-2561949a5d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:49.952570 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dcf6d-7fcf-46c2-9eb4-2561949a5d10 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:49.953498 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dcf6d-7fcf-46c2-9eb4-2561949a5d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:49.953905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dcf6d-7fcf-46c2-9eb4-2561949a5d10 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:49.954968 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99dcf6d-7fcf-46c2-9eb4-2561949a5d10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:49.955375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99dcf6d-7fcf-46c2-9eb4-2561949a5d10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:49.957947 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99dcf6d-7fcf-46c2-9eb4-2561949a5d10 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:49.981248 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 233/468] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:49.984197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77158d6-c349-4d18-9958-6998431d4fe0 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:49.985789 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77158d6-c349-4d18-9958-6998431d4fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:49.986206 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77158d6-c349-4d18-9958-6998431d4fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:50.005874 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:50.015646 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a77158d6-c349-4d18-9958-6998431d4fe0 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:50.024170 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a77158d6-c349-4d18-9958-6998431d4fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:50.039124 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f97ddf-7205-4757-a064-741870ffcf25 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:50.084981 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:50.087456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876fe57-8da7-4a23-9cce-42785eb2b6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:50.088112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876fe57-8da7-4a23-9cce-42785eb2b6a6 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:50.088878 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876fe57-8da7-4a23-9cce-42785eb2b6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:50.088878 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876fe57-8da7-4a23-9cce-42785eb2b6a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:50.089888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876fe57-8da7-4a23-9cce-42785eb2b6a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:50.090813 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876fe57-8da7-4a23-9cce-42785eb2b6a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:50.091642 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876fe57-8da7-4a23-9cce-42785eb2b6a6 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:50.113854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 236/469] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:50.113854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876fe57-8da7-4a23-9cce-42785eb2b6a6 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:50.115620 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 234/470] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:50.116633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77158d6-c349-4d18-9958-6998431d4fe0 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:50.260866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876fe57-8da7-4a23-9cce-42785eb2b6a6 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:50.265809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77158d6-c349-4d18-9958-6998431d4fe0 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:50.303798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6583b-b0bb-4bf8-ad5e-cdea857996a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:50.303978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebf747-e7a5-4d28-ad64-582257a4b931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:50.304334 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6583b-b0bb-4bf8-ad5e-cdea857996a9 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:50.304633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6583b-b0bb-4bf8-ad5e-cdea857996a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:50.304729 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebf747-e7a5-4d28-ad64-582257a4b931 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:50.304872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6583b-b0bb-4bf8-ad5e-cdea857996a9 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:50.304960 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebf747-e7a5-4d28-ad64-582257a4b931 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:50.305184 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebf747-e7a5-4d28-ad64-582257a4b931 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:50.305541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6583b-b0bb-4bf8-ad5e-cdea857996a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:50.305859 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebf747-e7a5-4d28-ad64-582257a4b931 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:50.307038 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6583b-b0bb-4bf8-ad5e-cdea857996a9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:50.307989 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebf747-e7a5-4d28-ad64-582257a4b931 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:50.390083 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 235/471] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 5 14:14:50 2022] POST /identity/v3/users => generated 248 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:14:50.391393 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef8b63-8259-4d46-ac46-4ab2531b823c None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:50.391685 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef8b63-8259-4d46-ac46-4ab2531b823c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:50.391959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef8b63-8259-4d46-ac46-4ab2531b823c None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:50.393482 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 236/472] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:50.399416 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80dfbb-0ce7-4f67-a81f-c378897e623d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:50.400658 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80dfbb-0ce7-4f67-a81f-c378897e623d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:50.401368 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80dfbb-0ce7-4f67-a81f-c378897e623d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:50.406408 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:50.419021 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 237/473] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 5 14:14:50 2022] POST /identity/v3/users => generated 248 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:14:50.424897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9e80dfbb-0ce7-4f67-a81f-c378897e623d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:50.426785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9e80dfbb-0ce7-4f67-a81f-c378897e623d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:50.459977 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:50.470095 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebf747-e7a5-4d28-ad64-582257a4b931 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:50.513394 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 237/474] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:14:50.619941 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebf747-e7a5-4d28-ad64-582257a4b931 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:50.659487 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce2645-bd65-4292-9a95-6333eb4d5007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:50.660103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce2645-bd65-4292-9a95-6333eb4d5007 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:50.660383 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce2645-bd65-4292-9a95-6333eb4d5007 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:50.660729 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce2645-bd65-4292-9a95-6333eb4d5007 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:50.672041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce2645-bd65-4292-9a95-6333eb4d5007 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:50.673560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce2645-bd65-4292-9a95-6333eb4d5007 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:50.688698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-dcce2645-bd65-4292-9a95-6333eb4d5007 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:50.688698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:50.688698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:50.688698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:50.688698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:50.688698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:50.688698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:50.688698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:50.688698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:50.688698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:50.688698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:50.688698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:50.688698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:14:50.688698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:14:50.688698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:14:50.688698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:14:50.689653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:50.689653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:50.689653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:50.689653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:50.689653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:50.689653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:50.689653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:50.689653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:50.689653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:50.689653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:50.689653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:50.689653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:50.689653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:50.689653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:50.689653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:50.689653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:50.689653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:14:50.690490 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:14:50.690490 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:50.690490 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:50.690490 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 238/475] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:50.697653 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80dfbb-0ce7-4f67-a81f-c378897e623d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:50.812352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80dfbb-0ce7-4f67-a81f-c378897e623d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:50.826622 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce2645-bd65-4292-9a95-6333eb4d5007 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:50.856573 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfceec-2da7-4050-8ca0-0f2f11761110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:50.857405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfceec-2da7-4050-8ca0-0f2f11761110 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:50.857819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfceec-2da7-4050-8ca0-0f2f11761110 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:50.858093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfceec-2da7-4050-8ca0-0f2f11761110 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:50.859031 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfceec-2da7-4050-8ca0-0f2f11761110 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:50.859338 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfceec-2da7-4050-8ca0-0f2f11761110 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:50.861285 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfceec-2da7-4050-8ca0-0f2f11761110 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:50.877770 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 238/476] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:50.884027 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfceec-2da7-4050-8ca0-0f2f11761110 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:50.903446 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:50.917482 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:50.963808 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce2645-bd65-4292-9a95-6333eb4d5007 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:51.003922 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f176a-e099-4c1e-b1ab-7a18005c9720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:51.004878 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f176a-e099-4c1e-b1ab-7a18005c9720 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:51.005485 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f176a-e099-4c1e-b1ab-7a18005c9720 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:51.005973 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f176a-e099-4c1e-b1ab-7a18005c9720 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:51.007290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f176a-e099-4c1e-b1ab-7a18005c9720 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:51.009046 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f176a-e099-4c1e-b1ab-7a18005c9720 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:51.039639 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfceec-2da7-4050-8ca0-0f2f11761110 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:51.048532 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.sql.core [None req-b47f176a-e099-4c1e-b1ab-7a18005c9720 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 05 14:14:51.048532 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 05 14:14:51.048532 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [parameters: {'id': '1ade11b9c31545bb8a1f1fdc6b5b475c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 05 14:14:51.048532 dv-cinder-842905-3-smb devstack@keystone.service[81624]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81624) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 05 14:14:51.075739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-b47f176a-e099-4c1e-b1ab-7a18005c9720 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 05 14:14:51.075739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:51.075739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 14:14:51.075739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 14:14:51.075739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 14:14:51.075739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 14:14:51.075739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 14:14:51.075739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 14:14:51.075739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 14:14:51.075739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application conn.query(q) Sep 05 14:14:51.075739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 14:14:51.075739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 14:14:51.075739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 14:14:51.075739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application result.read() Sep 05 14:14:51.075739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 14:14:51.076847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 14:14:51.076847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 14:14:51.076847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 14:14:51.076847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 14:14:51.076847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 14:14:51.076847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 14:14:51.076847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 14:14:51.076847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 05 14:14:51.076847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:51.076847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 05 14:14:51.076847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:51.076847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:51.076847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 05 14:14:51.076847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 05 14:14:51.076847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 05 14:14:51.076847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return ref.to_dict() Sep 05 14:14:51.076847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 14:14:51.076847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application next(self.gen) Sep 05 14:14:51.078013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 05 14:14:51.078013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application yield resource Sep 05 14:14:51.078013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 14:14:51.078013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application next(self.gen) Sep 05 14:14:51.078013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 05 14:14:51.078013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self.session.rollback() Sep 05 14:14:51.078013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 05 14:14:51.078013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self.force_reraise() Sep 05 14:14:51.078013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 05 14:14:51.078013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise self.value Sep 05 14:14:51.078013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 05 14:14:51.078013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 05 14:14:51.078013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 05 14:14:51.078013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application session.commit() Sep 05 14:14:51.078013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 05 14:14:51.078013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 05 14:14:51.078013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 05 14:14:51.079057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._prepare_impl() Sep 05 14:14:51.079057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 05 14:14:51.079057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self.session.flush() Sep 05 14:14:51.079057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 05 14:14:51.079057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._flush(objects) Sep 05 14:14:51.079057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 05 14:14:51.079057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 05 14:14:51.079057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 05 14:14:51.079057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application compat.raise_( Sep 05 14:14:51.079057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 14:14:51.079057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception Sep 05 14:14:51.079057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 05 14:14:51.079057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application flush_context.execute() Sep 05 14:14:51.079057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 05 14:14:51.079057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rec.execute(self) Sep 05 14:14:51.079057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 05 14:14:51.079057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 05 14:14:51.080137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 05 14:14:51.080137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 05 14:14:51.080137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 05 14:14:51.080137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 05 14:14:51.080137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 05 14:14:51.080137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 05 14:14:51.080137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 05 14:14:51.080137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 05 14:14:51.080137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 05 14:14:51.080137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 05 14:14:51.080137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 05 14:14:51.080137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 05 14:14:51.080137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 05 14:14:51.080137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 05 14:14:51.080137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 14:14:51.080137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception Sep 05 14:14:51.085303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 14:14:51.085303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 14:14:51.085303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 14:14:51.085303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 14:14:51.085303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 14:14:51.085303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 14:14:51.085303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 14:14:51.085303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application conn.query(q) Sep 05 14:14:51.085303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 14:14:51.085303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 14:14:51.085303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 14:14:51.085303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application result.read() Sep 05 14:14:51.085303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 14:14:51.085303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 14:14:51.085303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 14:14:51.085303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 14:14:51.086110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 14:14:51.086110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 14:14:51.086110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 14:14:51.086110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 14:14:51.086110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 05 14:14:51.086110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 05 14:14:51.086110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [parameters: {'id': '1ade11b9c31545bb8a1f1fdc6b5b475c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 05 14:14:51.086110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 05 14:14:51.086110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:51.086110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:14:51.086110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:51.086110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:51.086110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:51.086110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:51.086110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:51.086110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:51.086888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:51.086888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:51.086888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:51.086888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:51.086888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:51.086888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:51.086888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 05 14:14:51.086888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 05 14:14:51.086888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:51.086888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:51.086888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 05 14:14:51.086888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 05 14:14:51.086888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 05 14:14:51.086888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 05 14:14:51.086888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 05 14:14:51.086888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:51.096618 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40e6b3-ecbd-4af8-a23f-1251f9874224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:51.096909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 239/477] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Sep 5 14:14:50 2022] POST /identity/v3/roles => generated 144 bytes in 265 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:14:51.097790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40e6b3-ecbd-4af8-a23f-1251f9874224 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:51.098377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40e6b3-ecbd-4af8-a23f-1251f9874224 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:51.098835 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40e6b3-ecbd-4af8-a23f-1251f9874224 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:51.099739 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40e6b3-ecbd-4af8-a23f-1251f9874224 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:51.101495 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40e6b3-ecbd-4af8-a23f-1251f9874224 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:51.106440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f176a-e099-4c1e-b1ab-7a18005c9720 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:51.207551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 239/478] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 5 14:14:50 2022] POST /identity/v3/users => generated 249 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:14:51.231083 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f176a-e099-4c1e-b1ab-7a18005c9720 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:51.249521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:51.269957 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa38c6f-1dd2-412e-b156-58e2458f752c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:51.270607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa38c6f-1dd2-412e-b156-58e2458f752c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:51.271003 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa38c6f-1dd2-412e-b156-58e2458f752c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:51.271241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa38c6f-1dd2-412e-b156-58e2458f752c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:51.286158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa38c6f-1dd2-412e-b156-58e2458f752c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:51.291413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-4fa38c6f-1dd2-412e-b156-58e2458f752c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:51.291413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:51.291413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:51.291413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:51.291413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:51.291413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:51.291413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:51.291413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:51.291413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:51.291413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:51.291413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:51.291413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:51.291413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:51.291413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:51.291413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:51.291413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:51.292359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:51.292359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:51.292359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:51.292359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:51.292359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:51.292359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:51.292359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:51.292359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:51.292359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:51.292359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:51.292359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:51.292359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:51.292359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:51.292359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:51.292359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:51.292359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:51.293183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:51.293183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:51.293183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:51.293183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:51.293183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:51.293183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:51.293183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:51.293183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:51.293183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:51.293183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:51.293183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 14:14:51.293183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:51.297181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 240/479] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 5 14:14:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:51.298840 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40e6b3-ecbd-4af8-a23f-1251f9874224 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:51.396098 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:51.415665 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40e6b3-ecbd-4af8-a23f-1251f9874224 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:51.453789 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb47b53-de88-47ed-a2ec-60e036c7663f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:51.454408 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb47b53-de88-47ed-a2ec-60e036c7663f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:51.455241 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb47b53-de88-47ed-a2ec-60e036c7663f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:51.455517 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb47b53-de88-47ed-a2ec-60e036c7663f None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:51.456190 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb47b53-de88-47ed-a2ec-60e036c7663f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:51.457145 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb47b53-de88-47ed-a2ec-60e036c7663f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:51.458591 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb47b53-de88-47ed-a2ec-60e036c7663f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:51.471798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 240/480] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:14:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:52.144702 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32997c6-8094-4147-bc3d-a77f3f893964 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:52.145254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32997c6-8094-4147-bc3d-a77f3f893964 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:52.145254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32997c6-8094-4147-bc3d-a77f3f893964 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:52.146975 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 241/481] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:52.153568 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361b968-0d7d-4a2f-9b97-f06f01ff3836 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:52.154105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361b968-0d7d-4a2f-9b97-f06f01ff3836 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:52.154105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361b968-0d7d-4a2f-9b97-f06f01ff3836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:52.172702 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a361b968-0d7d-4a2f-9b97-f06f01ff3836 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:52.173933 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a361b968-0d7d-4a2f-9b97-f06f01ff3836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:52.248301 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 241/482] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:52.562732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32997c6-8094-4147-bc3d-a77f3f893964 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:52.682638 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32997c6-8094-4147-bc3d-a77f3f893964 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:52.725763 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813c87b-6419-457d-8cde-335ac0f452fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:52.726380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813c87b-6419-457d-8cde-335ac0f452fc None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:52.726658 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813c87b-6419-457d-8cde-335ac0f452fc None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:52.726927 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813c87b-6419-457d-8cde-335ac0f452fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:52.744281 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137091c-321a-4e4b-b0c0-775c38922685 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:52.744861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137091c-321a-4e4b-b0c0-775c38922685 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:52.745359 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137091c-321a-4e4b-b0c0-775c38922685 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:52.745482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813c87b-6419-457d-8cde-335ac0f452fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:52.747239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 242/483] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:52.750648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-7813c87b-6419-457d-8cde-335ac0f452fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:14:52.750648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:52.750648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:52.750648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:52.750648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:52.750648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:52.750648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:52.750648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:52.750648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:52.750648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:52.750648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:52.750648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:52.750648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:52.750648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:52.750648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:52.750648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:52.751516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:52.751516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:52.751516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:52.751516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:52.751516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:52.751516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:52.751516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:52.751516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:52.751516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:52.751516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:52.751516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:52.751516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:52.751516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:52.751516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:52.751516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:52.751516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:52.752304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:52.752304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:52.752304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:52.752304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:52.752304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:52.752304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:52.752304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:52.752304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:52.752304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:52.752304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:52.752304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:14:52.752304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:52.752304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 242/484] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:14:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:52.755655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbafd8f-5d68-4e54-b2d1-0e1bce1bdd0b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:52.756192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbafd8f-5d68-4e54-b2d1-0e1bce1bdd0b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:52.756897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbafd8f-5d68-4e54-b2d1-0e1bce1bdd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:52.757477 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813c87b-6419-457d-8cde-335ac0f452fc None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:52.782056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-dcbafd8f-5d68-4e54-b2d1-0e1bce1bdd0b None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:52.783234 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-dcbafd8f-5d68-4e54-b2d1-0e1bce1bdd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:52.825523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:52.917081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 243/485] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:52.951236 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813c87b-6419-457d-8cde-335ac0f452fc None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:53.014927 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb40ac-e27a-4b51-bfb2-78a5fd7f48ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:53.015883 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb40ac-e27a-4b51-bfb2-78a5fd7f48ca None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:53.016378 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb40ac-e27a-4b51-bfb2-78a5fd7f48ca None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:53.016838 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb40ac-e27a-4b51-bfb2-78a5fd7f48ca None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:53.017721 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb40ac-e27a-4b51-bfb2-78a5fd7f48ca None admin] RBAC: Adding query filter params (name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:53.018215 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb40ac-e27a-4b51-bfb2-78a5fd7f48ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:53.019813 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb40ac-e27a-4b51-bfb2-78a5fd7f48ca None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:53.024678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c9c60-7ab3-46d4-9ccb-05258783bf43 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:53.024970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c9c60-7ab3-46d4-9ccb-05258783bf43 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:53.025809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c9c60-7ab3-46d4-9ccb-05258783bf43 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:53.027647 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 244/486] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:14:53.032884 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d0f49-0eff-493a-91e1-590a5de609f0 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:53.033253 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d0f49-0eff-493a-91e1-590a5de609f0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:53.033535 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d0f49-0eff-493a-91e1-590a5de609f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:53.034540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 243/487] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 5 14:14:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:53.042058 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb40ac-e27a-4b51-bfb2-78a5fd7f48ca None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:53.051623 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:53.060457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-bf7d0f49-0eff-493a-91e1-590a5de609f0 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:53.060457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bf7d0f49-0eff-493a-91e1-590a5de609f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:53.183198 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 245/488] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:14:53.202209 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:53.210330 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb40ac-e27a-4b51-bfb2-78a5fd7f48ca None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:53.250095 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d0f49-0eff-493a-91e1-590a5de609f0 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:53.262842 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02014f-0e80-455a-9f9f-9ae375e85a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:53.263474 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02014f-0e80-455a-9f9f-9ae375e85a61 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:53.263753 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02014f-0e80-455a-9f9f-9ae375e85a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:53.264028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02014f-0e80-455a-9f9f-9ae375e85a61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:53.276196 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02014f-0e80-455a-9f9f-9ae375e85a61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:53.277794 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02014f-0e80-455a-9f9f-9ae375e85a61 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:53.298050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-8f02014f-0e80-455a-9f9f-9ae375e85a61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:53.298050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:53.298050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:53.298050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:53.298050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:53.298050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:53.298050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:53.298050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:53.298050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:53.298050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:53.298050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:53.298050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:53.298050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:14:53.298050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:14:53.298050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:14:53.298050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:14:53.298932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:53.298932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:53.298932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:53.298932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:53.298932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:53.298932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:53.298932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:53.298932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:53.298932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:53.298932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:53.298932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:53.298932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:53.298932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:53.298932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:53.298932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:53.298932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:53.298932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:14:53.299791 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:14:53.299791 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:53.299791 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:53.301251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 244/489] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:14:53.304938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02014f-0e80-455a-9f9f-9ae375e85a61 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:53.487882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d0f49-0eff-493a-91e1-590a5de609f0 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:53.502836 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02014f-0e80-455a-9f9f-9ae375e85a61 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:53.533230 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e84e3-cad9-4604-a81a-9ea83f7eb460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:53.534308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e84e3-cad9-4604-a81a-9ea83f7eb460 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:53.535041 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e84e3-cad9-4604-a81a-9ea83f7eb460 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:53.535752 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e84e3-cad9-4604-a81a-9ea83f7eb460 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:53.538297 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:53.539753 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef90323-fd6a-4c2a-8d5d-d2758ba80335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:53.540501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef90323-fd6a-4c2a-8d5d-d2758ba80335 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:53.540778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef90323-fd6a-4c2a-8d5d-d2758ba80335 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:53.541711 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef90323-fd6a-4c2a-8d5d-d2758ba80335 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:53.542522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef90323-fd6a-4c2a-8d5d-d2758ba80335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:53.542896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef90323-fd6a-4c2a-8d5d-d2758ba80335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:53.544412 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef90323-fd6a-4c2a-8d5d-d2758ba80335 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:53.551115 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e84e3-cad9-4604-a81a-9ea83f7eb460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:53.557525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-2d0e84e3-cad9-4604-a81a-9ea83f7eb460 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:14:53.557525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:53.557525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:53.557525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:53.557525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:53.557525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:53.557525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:53.557525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:53.557525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:53.557525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:53.557525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:53.557525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:53.557525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:53.557525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:53.557525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:53.557525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:53.558417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:53.558417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:53.558417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:53.558417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:53.558417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:53.558417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:53.558417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:53.558417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:53.558417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:53.558417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:53.558417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:53.558417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:53.558417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:53.558417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:53.558417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:53.558417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:53.559180 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:53.559180 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:53.559180 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:53.559180 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:53.559180 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:53.559180 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:53.559180 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:53.559180 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:53.559180 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:53.559180 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:53.559180 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:14:53.559180 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:53.559787 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 245/490] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:14:53.559787 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef90323-fd6a-4c2a-8d5d-d2758ba80335 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:53.562235 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 246/491] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:14:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:14:53.565850 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e84e3-cad9-4604-a81a-9ea83f7eb460 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:53.576231 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:53.683870 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e84e3-cad9-4604-a81a-9ea83f7eb460 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:53.703412 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef90323-fd6a-4c2a-8d5d-d2758ba80335 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:53.722028 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943d954-b903-4481-8a78-d769ce566ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:53.722992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943d954-b903-4481-8a78-d769ce566ebb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:53.723469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943d954-b903-4481-8a78-d769ce566ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:53.723938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943d954-b903-4481-8a78-d769ce566ebb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:53.731871 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943d954-b903-4481-8a78-d769ce566ebb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:53.733726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943d954-b903-4481-8a78-d769ce566ebb None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:53.747044 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4b412-1be4-4704-ba6e-aae05471fe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:53.747623 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4b412-1be4-4704-ba6e-aae05471fe44 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:53.747887 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4b412-1be4-4704-ba6e-aae05471fe44 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:53.748155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4b412-1be4-4704-ba6e-aae05471fe44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:53.749962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-9943d954-b903-4481-8a78-d769ce566ebb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 14:14:53.749962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:53.749962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:53.749962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:53.749962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:53.749962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:53.749962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:53.749962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:53.749962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:53.749962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:53.749962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:53.749962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:53.749962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:14:53.749962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:14:53.749962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:14:53.749962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:14:53.750824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:53.750824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:53.750824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:14:53.750824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:14:53.750824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:14:53.750824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:14:53.750824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:53.750824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:53.750824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:53.750824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:53.750824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:53.750824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:53.750824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:53.750824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:53.750824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:53.750824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:53.750824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:53.750824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:53.751700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:53.751700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:53.751700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:14:53.751700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:14:53.751700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:14:53.751700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:14:53.751700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:14:53.751700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:14:53.751700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 14:14:53.751700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:53.760834 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 247/492] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 5 14:14:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:53.760834 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943d954-b903-4481-8a78-d769ce566ebb None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:53.768142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4b412-1be4-4704-ba6e-aae05471fe44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:53.775961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-9da4b412-1be4-4704-ba6e-aae05471fe44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:14:53.775961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:53.775961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:53.775961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:53.775961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:53.775961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:53.775961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:53.775961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:53.775961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:53.775961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:53.775961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:53.775961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:53.775961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:53.775961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:53.775961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:53.775961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:53.776968 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:53.776968 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:53.776968 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:53.776968 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:53.776968 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:53.776968 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:53.776968 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:53.776968 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:53.776968 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:53.776968 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:53.776968 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:53.776968 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:53.776968 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:53.776968 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:53.776968 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:53.776968 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:53.777782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:53.777782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:53.777782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:53.777782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:53.777782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:53.777782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:53.777782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:53.777782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:53.777782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:53.777782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:53.777782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:14:53.777782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:53.782599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 246/493] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:14:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:53.783641 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4b412-1be4-4704-ba6e-aae05471fe44 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:53.839235 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:53.877260 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:53.894272 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943d954-b903-4481-8a78-d769ce566ebb None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:53.914340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4b412-1be4-4704-ba6e-aae05471fe44 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:53.939969 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0d0ab-539b-4fdd-9772-94ad3a89e2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:53.940915 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0d0ab-539b-4fdd-9772-94ad3a89e2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:53.941425 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0d0ab-539b-4fdd-9772-94ad3a89e2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:53.941914 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0d0ab-539b-4fdd-9772-94ad3a89e2b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:53.942774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0d0ab-539b-4fdd-9772-94ad3a89e2b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:53.943306 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0d0ab-539b-4fdd-9772-94ad3a89e2b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:53.944887 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0d0ab-539b-4fdd-9772-94ad3a89e2b0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:53.951903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc851e2-1f28-4886-b80c-a6aff0bc96fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:53.952335 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc851e2-1f28-4886-b80c-a6aff0bc96fd None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:53.952611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc851e2-1f28-4886-b80c-a6aff0bc96fd None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:53.952879 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc851e2-1f28-4886-b80c-a6aff0bc96fd None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:53.953740 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc851e2-1f28-4886-b80c-a6aff0bc96fd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:53.953959 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc851e2-1f28-4886-b80c-a6aff0bc96fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:53.955443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc851e2-1f28-4886-b80c-a6aff0bc96fd None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:53.956370 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 248/494] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 5 14:14:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:53.957468 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0d0ab-539b-4fdd-9772-94ad3a89e2b0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:53.999532 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 247/495] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 5 14:14:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:54.000402 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc851e2-1f28-4886-b80c-a6aff0bc96fd None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:54.072746 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0d0ab-539b-4fdd-9772-94ad3a89e2b0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:54.090718 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:54.107883 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a7e7e-0e62-42c4-9cee-bb8120419c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:54.108488 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a7e7e-0e62-42c4-9cee-bb8120419c33 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:54.108862 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a7e7e-0e62-42c4-9cee-bb8120419c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:54.109160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a7e7e-0e62-42c4-9cee-bb8120419c33 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:54.109821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a7e7e-0e62-42c4-9cee-bb8120419c33 None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:54.114592 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a7e7e-0e62-42c4-9cee-bb8120419c33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:54.114732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc851e2-1f28-4886-b80c-a6aff0bc96fd None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:54.114870 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a7e7e-0e62-42c4-9cee-bb8120419c33 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:54.120344 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 249/496] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 5 14:14:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:54.121174 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a7e7e-0e62-42c4-9cee-bb8120419c33 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:54.137948 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:54.153171 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65c81e-de16-4d23-a69f-7471bb08a58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:54.153958 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65c81e-de16-4d23-a69f-7471bb08a58d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:54.154239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65c81e-de16-4d23-a69f-7471bb08a58d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:54.154507 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65c81e-de16-4d23-a69f-7471bb08a58d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:54.165481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65c81e-de16-4d23-a69f-7471bb08a58d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:54.167782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65c81e-de16-4d23-a69f-7471bb08a58d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:54.182904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-de65c81e-de16-4d23-a69f-7471bb08a58d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:54.182904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:54.182904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:54.182904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:54.182904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:54.182904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:54.182904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:54.182904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:54.182904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:54.182904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:54.182904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:54.182904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:54.182904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:14:54.182904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:14:54.182904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:14:54.182904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:14:54.183827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:54.183827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:54.183827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:54.183827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:54.183827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:54.183827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:54.183827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:54.183827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:54.183827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:54.183827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:54.183827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:54.183827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:54.183827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:54.183827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:54.183827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:54.183827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:54.183827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:14:54.184652 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:14:54.184652 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:54.184652 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:54.184652 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 248/497] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:54.185212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07de2f8-b495-4aed-be87-2f3287621907 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:54.185498 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07de2f8-b495-4aed-be87-2f3287621907 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:54.185767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07de2f8-b495-4aed-be87-2f3287621907 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:54.186978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 249/498] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:54.187972 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f90fe-2861-4173-8c2b-8fc500905a52 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:54.188252 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f90fe-2861-4173-8c2b-8fc500905a52 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:54.188522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f90fe-2861-4173-8c2b-8fc500905a52 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:54.189701 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 250/499] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:54.190393 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f90fe-2861-4173-8c2b-8fc500905a52 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:54.239388 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a7e7e-0e62-42c4-9cee-bb8120419c33 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:54.273111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b43d66-72a2-4669-ae5c-b3502837f39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:54.273644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b43d66-72a2-4669-ae5c-b3502837f39d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:54.273920 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b43d66-72a2-4669-ae5c-b3502837f39d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:54.274187 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b43d66-72a2-4669-ae5c-b3502837f39d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:54.295954 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f90fe-2861-4173-8c2b-8fc500905a52 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:54.321403 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:54.329605 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500c7af-cdfc-4ce0-a769-ca9230bb8c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:54.334580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500c7af-cdfc-4ce0-a769-ca9230bb8c53 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:54.334580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500c7af-cdfc-4ce0-a769-ca9230bb8c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:54.334580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500c7af-cdfc-4ce0-a769-ca9230bb8c53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:54.340794 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500c7af-cdfc-4ce0-a769-ca9230bb8c53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:54.342371 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500c7af-cdfc-4ce0-a769-ca9230bb8c53 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:54.343330 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b43d66-72a2-4669-ae5c-b3502837f39d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:54.345285 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b43d66-72a2-4669-ae5c-b3502837f39d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:54.356076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-9500c7af-cdfc-4ce0-a769-ca9230bb8c53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:54.356076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:54.356076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:54.356076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:54.356076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:54.356076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:54.356076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:54.356076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:54.356076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:54.356076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:54.356076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:54.356076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:54.356076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:14:54.356076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:14:54.356076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:14:54.356076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:14:54.356979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:54.356979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:54.356979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:54.356979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:54.356979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:54.356979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:54.356979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:54.356979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:54.356979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:54.356979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:54.356979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:54.356979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:54.356979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:54.356979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:54.356979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:54.356979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:54.356979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:14:54.357865 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:14:54.357865 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:54.357865 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:54.357865 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 251/500] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:54.358087 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500c7af-cdfc-4ce0-a769-ca9230bb8c53 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:54.389154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:54.446476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 250/501] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:14:54.447939 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d080d-1a81-468b-a882-7397d227dc7d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:54.448339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d080d-1a81-468b-a882-7397d227dc7d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:54.448627 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d080d-1a81-468b-a882-7397d227dc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:54.458940 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500c7af-cdfc-4ce0-a769-ca9230bb8c53 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:54.467095 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d11d080d-1a81-468b-a882-7397d227dc7d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:54.468283 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d11d080d-1a81-468b-a882-7397d227dc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:54.494512 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb7c9f-32f8-4915-833c-6884b8225191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:54.495121 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb7c9f-32f8-4915-833c-6884b8225191 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:54.495398 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb7c9f-32f8-4915-833c-6884b8225191 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:54.495668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb7c9f-32f8-4915-833c-6884b8225191 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:54.496312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb7c9f-32f8-4915-833c-6884b8225191 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:54.496611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb7c9f-32f8-4915-833c-6884b8225191 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:54.498009 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb7c9f-32f8-4915-833c-6884b8225191 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:54.508850 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 252/502] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:54.510063 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec1ea5-4d8c-4bb9-a758-dd1bc940a5a6 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:54.510345 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec1ea5-4d8c-4bb9-a758-dd1bc940a5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:54.510617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec1ea5-4d8c-4bb9-a758-dd1bc940a5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:54.529012 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-82ec1ea5-4d8c-4bb9-a758-dd1bc940a5a6 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:54.530166 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-82ec1ea5-4d8c-4bb9-a758-dd1bc940a5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:54.536130 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 251/503] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:54.536957 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d080d-1a81-468b-a882-7397d227dc7d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:54.552376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:54.602925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 253/504] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:54.614289 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec1ea5-4d8c-4bb9-a758-dd1bc940a5a6 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:54.642965 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:54.648339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d080d-1a81-468b-a882-7397d227dc7d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:54.687179 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3a409-9dc5-43d4-b556-2fcc9adac490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:54.688073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3a409-9dc5-43d4-b556-2fcc9adac490 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:54.688661 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3a409-9dc5-43d4-b556-2fcc9adac490 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:54.689144 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3a409-9dc5-43d4-b556-2fcc9adac490 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:54.690074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3a409-9dc5-43d4-b556-2fcc9adac490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:54.690554 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3a409-9dc5-43d4-b556-2fcc9adac490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:54.692255 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3a409-9dc5-43d4-b556-2fcc9adac490 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:54.706056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 252/505] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:54.707358 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3a409-9dc5-43d4-b556-2fcc9adac490 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:54.743758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec1ea5-4d8c-4bb9-a758-dd1bc940a5a6 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:54.780761 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c29e7a-80f3-4df2-8244-1b0bc0790f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:54.781799 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c29e7a-80f3-4df2-8244-1b0bc0790f68 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:54.782305 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c29e7a-80f3-4df2-8244-1b0bc0790f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:54.782777 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c29e7a-80f3-4df2-8244-1b0bc0790f68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:54.793871 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:54.794476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c29e7a-80f3-4df2-8244-1b0bc0790f68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:54.796158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c29e7a-80f3-4df2-8244-1b0bc0790f68 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:54.813584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-76c29e7a-80f3-4df2-8244-1b0bc0790f68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:54.813584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:54.813584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:54.813584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:54.813584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:54.813584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:54.813584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:54.813584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:54.813584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:54.813584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:54.813584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:54.813584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:54.813584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:14:54.813584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:14:54.813584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:14:54.813584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:14:54.814496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:54.814496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:54.814496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:54.814496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:54.814496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:54.814496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:54.814496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:54.814496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:54.814496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:54.814496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:54.814496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:54.814496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:54.814496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:54.814496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:54.814496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:54.814496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:54.814496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:14:54.815993 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:14:54.815993 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:54.815993 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:54.815993 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 254/506] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:54.815993 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c29e7a-80f3-4df2-8244-1b0bc0790f68 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:54.835133 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3a409-9dc5-43d4-b556-2fcc9adac490 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:54.872013 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0aa40-247e-4285-a38c-86fc4fb5eac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:54.872634 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0aa40-247e-4285-a38c-86fc4fb5eac1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:54.872909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0aa40-247e-4285-a38c-86fc4fb5eac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:54.873210 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0aa40-247e-4285-a38c-86fc4fb5eac1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:54.881493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0aa40-247e-4285-a38c-86fc4fb5eac1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:54.882913 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0aa40-247e-4285-a38c-86fc4fb5eac1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:54.894655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-25a0aa40-247e-4285-a38c-86fc4fb5eac1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 14:14:54.894655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:54.894655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:54.894655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:54.894655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:54.894655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:54.894655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:54.894655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:54.894655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:54.894655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:54.894655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:54.894655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:54.894655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:14:54.894655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:14:54.894655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:14:54.894655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:14:54.895571 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:54.895571 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:54.895571 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:14:54.895571 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:14:54.895571 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:14:54.895571 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:14:54.895571 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:54.895571 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:54.895571 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:54.895571 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:54.895571 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:54.895571 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:54.895571 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:54.895571 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:54.895571 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:54.895571 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:54.895571 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:54.895571 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:54.896979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:54.896979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:54.896979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:14:54.896979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:14:54.896979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:14:54.896979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:14:54.896979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:14:54.896979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:14:54.896979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 14:14:54.896979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:54.896979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 253/507] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:54.896979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0aa40-247e-4285-a38c-86fc4fb5eac1 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:54.898329 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:54.931505 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c29e7a-80f3-4df2-8244-1b0bc0790f68 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:54.964457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81f45e-cd21-489a-b686-ff85e01b3d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:54.965103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81f45e-cd21-489a-b686-ff85e01b3d80 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:54.965390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81f45e-cd21-489a-b686-ff85e01b3d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:54.965663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81f45e-cd21-489a-b686-ff85e01b3d80 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:54.972930 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81f45e-cd21-489a-b686-ff85e01b3d80 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:54.974413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81f45e-cd21-489a-b686-ff85e01b3d80 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:54.987228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-ce81f45e-cd21-489a-b686-ff85e01b3d80 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 05 14:14:54.987228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:54.987228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:54.987228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:54.987228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:54.987228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:54.987228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:54.987228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:54.987228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:54.987228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:54.987228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:54.987228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:54.987228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:14:54.987228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:14:54.987228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:14:54.987228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:14:54.988239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:54.988239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:54.988239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:14:54.988239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:14:54.988239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:14:54.988239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:14:54.988239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:54.988239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:54.988239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:54.988239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:54.988239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:54.988239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:54.988239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:54.988239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:54.988239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:54.988239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:54.988239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:54.988239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:54.989149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:54.989149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:54.989149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:14:54.989149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:14:54.989149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:14:54.989149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:14:54.989149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:14:54.989149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:14:54.989149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 05 14:14:54.989149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:54.989149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 255/508] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:14:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:54.989149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81f45e-cd21-489a-b686-ff85e01b3d80 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:55.002311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0aa40-247e-4285-a38c-86fc4fb5eac1 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:55.028453 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:55.040749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338eda01-6205-4667-add4-e661004bae95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:55.040749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338eda01-6205-4667-add4-e661004bae95 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:55.040749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338eda01-6205-4667-add4-e661004bae95 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:55.040749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338eda01-6205-4667-add4-e661004bae95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:55.049236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338eda01-6205-4667-add4-e661004bae95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:55.054295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-338eda01-6205-4667-add4-e661004bae95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:14:55.054295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:55.054295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:55.054295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:55.054295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:55.054295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:55.054295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:55.054295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:55.054295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:55.054295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:55.054295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:55.054295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:55.054295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:55.054295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:55.054295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:55.054295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:55.055239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:55.055239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:55.055239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:55.055239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:55.055239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:55.055239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:55.055239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:55.055239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:55.055239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:55.055239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:55.055239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:55.055239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:55.055239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:55.055239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:55.055239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:55.055239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:55.056310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:55.056310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:55.056310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:55.056310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:55.056310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:55.056310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:55.056310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:55.056310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:55.056310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:55.056310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:55.056310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:14:55.056310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:55.056310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 254/509] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:14:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:55.056310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338eda01-6205-4667-add4-e661004bae95 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:55.093638 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81f45e-cd21-489a-b686-ff85e01b3d80 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:55.122581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:55.127291 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20f898-8548-46f9-963b-a8d41b237e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:55.127891 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20f898-8548-46f9-963b-a8d41b237e7d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:55.128173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20f898-8548-46f9-963b-a8d41b237e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:55.128446 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20f898-8548-46f9-963b-a8d41b237e7d None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:55.129107 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20f898-8548-46f9-963b-a8d41b237e7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:55.129416 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20f898-8548-46f9-963b-a8d41b237e7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:55.130863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20f898-8548-46f9-963b-a8d41b237e7d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:55.142680 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 256/510] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:55.143293 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20f898-8548-46f9-963b-a8d41b237e7d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:55.158199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338eda01-6205-4667-add4-e661004bae95 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:55.192752 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae12d6-d5d2-464a-8ba8-6ee0f0f85139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:55.193406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae12d6-d5d2-464a-8ba8-6ee0f0f85139 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:55.193685 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae12d6-d5d2-464a-8ba8-6ee0f0f85139 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:55.193953 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae12d6-d5d2-464a-8ba8-6ee0f0f85139 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:55.205291 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae12d6-d5d2-464a-8ba8-6ee0f0f85139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:55.206804 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae12d6-d5d2-464a-8ba8-6ee0f0f85139 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:55.221447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-41ae12d6-d5d2-464a-8ba8-6ee0f0f85139 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:55.221447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:55.221447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:55.221447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:55.221447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:55.221447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:55.221447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:55.221447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:55.221447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:55.221447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:55.221447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:55.221447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:55.221447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:14:55.221447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:14:55.221447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:14:55.221447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:14:55.222426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:55.222426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:55.222426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:55.222426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:55.222426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:55.222426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:55.222426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:55.222426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:55.222426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:55.222426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:55.222426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:55.222426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:55.222426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:55.222426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:55.222426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:55.222426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:55.222426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:14:55.223274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:14:55.223274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:55.223274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:55.223274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 255/511] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:55.223274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae12d6-d5d2-464a-8ba8-6ee0f0f85139 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:55.245385 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20f898-8548-46f9-963b-a8d41b237e7d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:55.266808 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:55.279903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca9896-db33-4bd1-b52e-af9392817a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:55.280586 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca9896-db33-4bd1-b52e-af9392817a4f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:55.280872 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca9896-db33-4bd1-b52e-af9392817a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:55.281175 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca9896-db33-4bd1-b52e-af9392817a4f None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:55.281908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca9896-db33-4bd1-b52e-af9392817a4f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:55.282214 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca9896-db33-4bd1-b52e-af9392817a4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:55.283653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca9896-db33-4bd1-b52e-af9392817a4f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:55.300564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 257/512] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Sep 5 14:14:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:55.302381 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca9896-db33-4bd1-b52e-af9392817a4f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:55.328616 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae12d6-d5d2-464a-8ba8-6ee0f0f85139 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:55.352599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:55.362591 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737274b-a093-42c4-99fb-11906480d5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:55.363187 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737274b-a093-42c4-99fb-11906480d5da None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:55.363462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737274b-a093-42c4-99fb-11906480d5da None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:55.363817 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737274b-a093-42c4-99fb-11906480d5da None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:55.364535 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737274b-a093-42c4-99fb-11906480d5da None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:55.364838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737274b-a093-42c4-99fb-11906480d5da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:55.366340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737274b-a093-42c4-99fb-11906480d5da None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:55.402796 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 256/513] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Sep 5 14:14:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:55.403284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca9896-db33-4bd1-b52e-af9392817a4f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:55.403625 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737274b-a093-42c4-99fb-11906480d5da None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:55.440991 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1c10b-d170-43b1-b7ad-169d2fe0e3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:55.441640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1c10b-d170-43b1-b7ad-169d2fe0e3e0 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:55.441922 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1c10b-d170-43b1-b7ad-169d2fe0e3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:55.442196 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1c10b-d170-43b1-b7ad-169d2fe0e3e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:55.442856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1c10b-d170-43b1-b7ad-169d2fe0e3e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:55.443163 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1c10b-d170-43b1-b7ad-169d2fe0e3e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:55.444544 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1c10b-d170-43b1-b7ad-169d2fe0e3e0 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:55.452880 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 258/514] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 5 14:14:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:55.453726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1c10b-d170-43b1-b7ad-169d2fe0e3e0 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:55.499876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:55.503378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737274b-a093-42c4-99fb-11906480d5da None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:55.538148 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfaf4b-3893-4176-ad63-c9021306811c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:55.538774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfaf4b-3893-4176-ad63-c9021306811c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:55.539050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfaf4b-3893-4176-ad63-c9021306811c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:55.539321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfaf4b-3893-4176-ad63-c9021306811c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:55.545950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfaf4b-3893-4176-ad63-c9021306811c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:55.547405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfaf4b-3893-4176-ad63-c9021306811c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:55.555580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1c10b-d170-43b1-b7ad-169d2fe0e3e0 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:55.559105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-fddfaf4b-3893-4176-ad63-c9021306811c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:14:55.559105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:55.559105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:55.559105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:55.559105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:55.559105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:55.559105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:55.559105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:55.559105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:55.559105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:55.559105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:55.559105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:55.559105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:14:55.559105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:14:55.559105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:14:55.559950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:14:55.559950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:55.559950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:55.559950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:55.559950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:55.559950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:55.559950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:55.559950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:55.559950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:55.559950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:55.559950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:55.559950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:55.559950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:55.559950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:55.559950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:55.559950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:55.559950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:55.560783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:14:55.560783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:14:55.560783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:14:55.560783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:14:55.560783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:14:55.560783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:14:55.560783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:14:55.560783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:55.564874 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 257/515] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:14:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:55.565678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfaf4b-3893-4176-ad63-c9021306811c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:55.568458 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:55.591025 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06de281-2f63-4ab9-a335-2e1106ca26dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:55.591969 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06de281-2f63-4ab9-a335-2e1106ca26dd None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:55.592443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06de281-2f63-4ab9-a335-2e1106ca26dd None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:55.592921 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06de281-2f63-4ab9-a335-2e1106ca26dd None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:55.594020 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06de281-2f63-4ab9-a335-2e1106ca26dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:55.594462 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06de281-2f63-4ab9-a335-2e1106ca26dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:55.596839 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06de281-2f63-4ab9-a335-2e1106ca26dd None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:55.616291 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 259/516] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:55.617557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06de281-2f63-4ab9-a335-2e1106ca26dd None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:55.688210 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfaf4b-3893-4176-ad63-c9021306811c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:55.721579 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc8829-d2f5-433a-a3f7-c979f9fb1a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:55.722175 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc8829-d2f5-433a-a3f7-c979f9fb1a3b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:55.722455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc8829-d2f5-433a-a3f7-c979f9fb1a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:55.722728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc8829-d2f5-433a-a3f7-c979f9fb1a3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:55.728791 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06de281-2f63-4ab9-a335-2e1106ca26dd None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:55.749909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:55.762884 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13507433-c42e-47a1-9a8b-4a8f701aabd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:55.769912 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13507433-c42e-47a1-9a8b-4a8f701aabd3 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:55.769912 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13507433-c42e-47a1-9a8b-4a8f701aabd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:55.769912 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13507433-c42e-47a1-9a8b-4a8f701aabd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:55.791741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc8829-d2f5-433a-a3f7-c979f9fb1a3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:55.793413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc8829-d2f5-433a-a3f7-c979f9fb1a3b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:55.805291 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:55.831664 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13507433-c42e-47a1-9a8b-4a8f701aabd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:55.833083 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13507433-c42e-47a1-9a8b-4a8f701aabd3 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:55.890077 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 258/517] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:14:55.891222 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc8829-d2f5-433a-a3f7-c979f9fb1a3b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:55.935401 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 260/518] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:14:55.936372 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13507433-c42e-47a1-9a8b-4a8f701aabd3 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:55.953663 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:55.995110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc8829-d2f5-433a-a3f7-c979f9fb1a3b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:56.004467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:56.028687 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d41bcc-e5cd-4168-8387-51b6a73e944b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:56.029333 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d41bcc-e5cd-4168-8387-51b6a73e944b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:56.029612 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d41bcc-e5cd-4168-8387-51b6a73e944b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:56.029884 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d41bcc-e5cd-4168-8387-51b6a73e944b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:56.032505 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13507433-c42e-47a1-9a8b-4a8f701aabd3 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:56.040041 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d41bcc-e5cd-4168-8387-51b6a73e944b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:56.041907 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d41bcc-e5cd-4168-8387-51b6a73e944b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:56.055726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-77d41bcc-e5cd-4168-8387-51b6a73e944b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:56.055726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:56.055726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:56.055726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:56.055726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:56.055726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:56.055726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:56.055726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:56.055726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:56.055726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:56.055726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:56.055726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:56.055726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:14:56.055726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:14:56.055726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:14:56.055726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:14:56.057385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:56.057385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:56.057385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:56.057385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:56.057385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:56.057385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:56.057385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:56.057385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:56.057385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:56.057385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:56.057385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:56.057385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:56.057385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:56.057385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:56.057385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:56.057385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:56.057385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:14:56.058476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:14:56.058476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:56.058476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:56.058476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 259/519] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:56.058761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d41bcc-e5cd-4168-8387-51b6a73e944b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:56.070250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e25cf-bf33-4416-8fd1-c3b0ffda4795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:56.070926 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e25cf-bf33-4416-8fd1-c3b0ffda4795 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:56.071206 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e25cf-bf33-4416-8fd1-c3b0ffda4795 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:56.071474 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e25cf-bf33-4416-8fd1-c3b0ffda4795 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:56.072843 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e25cf-bf33-4416-8fd1-c3b0ffda4795 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:56.073413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e25cf-bf33-4416-8fd1-c3b0ffda4795 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:56.074931 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e25cf-bf33-4416-8fd1-c3b0ffda4795 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:56.093560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 261/520] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:14:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:56.094399 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e25cf-bf33-4416-8fd1-c3b0ffda4795 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:56.167673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d41bcc-e5cd-4168-8387-51b6a73e944b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:56.178225 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:56.198443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e25cf-bf33-4416-8fd1-c3b0ffda4795 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:56.202604 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e80d74-8685-43f5-8f31-69f9d34bb7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:56.203214 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e80d74-8685-43f5-8f31-69f9d34bb7b4 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:56.203490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e80d74-8685-43f5-8f31-69f9d34bb7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:56.203759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e80d74-8685-43f5-8f31-69f9d34bb7b4 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:56.204401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e80d74-8685-43f5-8f31-69f9d34bb7b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:56.205875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e80d74-8685-43f5-8f31-69f9d34bb7b4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:56.227716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:56.233983 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065480c2-0d4d-4901-82ff-b2cf79eef08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:56.234609 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065480c2-0d4d-4901-82ff-b2cf79eef08c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:56.234886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065480c2-0d4d-4901-82ff-b2cf79eef08c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:56.235153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065480c2-0d4d-4901-82ff-b2cf79eef08c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:56.246133 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065480c2-0d4d-4901-82ff-b2cf79eef08c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:56.247592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065480c2-0d4d-4901-82ff-b2cf79eef08c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:56.261143 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-065480c2-0d4d-4901-82ff-b2cf79eef08c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:56.261143 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:56.261143 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:56.261143 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:56.261143 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:56.261143 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:56.261143 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:56.261143 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:56.261143 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:56.261143 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:56.261143 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:56.261143 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:56.261143 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:14:56.261143 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:14:56.261143 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:14:56.261143 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:14:56.262343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:56.262343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:56.262343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:56.262343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:56.262343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:56.262343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:56.262343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:56.262343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:56.262343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:56.262343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:56.262343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:56.262343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:56.262343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:56.262343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:56.262343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:56.262343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:56.262343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:14:56.263197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:14:56.263197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:56.263197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:56.263197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 262/521] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:56.263197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065480c2-0d4d-4901-82ff-b2cf79eef08c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:56.293315 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 260/522] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 5 14:14:56 2022] POST /identity/v3/users => generated 247 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:14:56.294228 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e80d74-8685-43f5-8f31-69f9d34bb7b4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:56.378041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065480c2-0d4d-4901-82ff-b2cf79eef08c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:56.416272 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e80d74-8685-43f5-8f31-69f9d34bb7b4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:56.419675 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000768d-4a65-4e90-a599-4c63321d938e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:56.420404 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000768d-4a65-4e90-a599-4c63321d938e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:56.420685 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000768d-4a65-4e90-a599-4c63321d938e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:56.420956 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000768d-4a65-4e90-a599-4c63321d938e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:56.433199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000768d-4a65-4e90-a599-4c63321d938e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:56.434713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000768d-4a65-4e90-a599-4c63321d938e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:56.452152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-5000768d-4a65-4e90-a599-4c63321d938e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:56.452152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:56.452152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:56.452152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:56.452152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:56.452152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:56.452152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:56.452152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:56.452152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:56.452152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:56.452152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:56.452152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:56.452152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:14:56.452152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:14:56.452152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:14:56.452152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:14:56.453155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:56.453155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:56.453155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:56.453155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:56.453155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:56.453155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:56.453155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:56.453155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:56.453155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:56.453155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:56.453155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:56.453155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:56.453155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:56.453155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:56.453155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:56.453155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:56.453155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:14:56.455332 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:14:56.455332 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:56.455332 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:56.455332 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 263/523] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:56.455332 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000768d-4a65-4e90-a599-4c63321d938e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:56.459794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a33dc6-6c04-4a9e-900e-6394b1f44e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:56.459794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a33dc6-6c04-4a9e-900e-6394b1f44e7a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:56.460001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a33dc6-6c04-4a9e-900e-6394b1f44e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:56.460265 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a33dc6-6c04-4a9e-900e-6394b1f44e7a None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:56.460913 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a33dc6-6c04-4a9e-900e-6394b1f44e7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:56.461252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a33dc6-6c04-4a9e-900e-6394b1f44e7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:56.462724 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a33dc6-6c04-4a9e-900e-6394b1f44e7a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:56.477524 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 261/524] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:56.479043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a33dc6-6c04-4a9e-900e-6394b1f44e7a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:56.498632 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:56.513482 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:56.565478 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000768d-4a65-4e90-a599-4c63321d938e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:56.591808 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a33dc6-6c04-4a9e-900e-6394b1f44e7a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:56.601369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef2c2e-d13f-4ff3-afdc-eb8bfed06c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:56.601972 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef2c2e-d13f-4ff3-afdc-eb8bfed06c12 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:56.602252 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef2c2e-d13f-4ff3-afdc-eb8bfed06c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:56.602522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef2c2e-d13f-4ff3-afdc-eb8bfed06c12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:56.603292 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef2c2e-d13f-4ff3-afdc-eb8bfed06c12 None admin] RBAC: Adding query filter params (role.id=5351e6d174334a8eaf71e8d2b3c079a7, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=d5515accf3b64006bc41422265a641bc) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:56.604347 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef2c2e-d13f-4ff3-afdc-eb8bfed06c12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:56.605916 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef2c2e-d13f-4ff3-afdc-eb8bfed06c12 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:56.621101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 264/525] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:14:56 2022] GET /identity/v3/role_assignments?user.id=d5515accf3b64006bc41422265a641bc&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=5351e6d174334a8eaf71e8d2b3c079a7 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:56.621101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef2c2e-d13f-4ff3-afdc-eb8bfed06c12 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:56.638855 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6904e95-4cd5-4b60-8867-b7534a85d0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:56.639575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6904e95-4cd5-4b60-8867-b7534a85d0b1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:56.639925 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6904e95-4cd5-4b60-8867-b7534a85d0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:56.640267 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6904e95-4cd5-4b60-8867-b7534a85d0b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:56.640988 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6904e95-4cd5-4b60-8867-b7534a85d0b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:56.641388 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6904e95-4cd5-4b60-8867-b7534a85d0b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:56.643111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6904e95-4cd5-4b60-8867-b7534a85d0b1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:56.661572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 262/526] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:56.662651 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6904e95-4cd5-4b60-8867-b7534a85d0b1 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:56.738495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:56.742780 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef2c2e-d13f-4ff3-afdc-eb8bfed06c12 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:56.787585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:56.797033 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f9cba-1c76-4c55-8056-56854c27ceba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:56.797670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f9cba-1c76-4c55-8056-56854c27ceba None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:56.797943 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f9cba-1c76-4c55-8056-56854c27ceba None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:56.798210 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f9cba-1c76-4c55-8056-56854c27ceba None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:56.798862 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f9cba-1c76-4c55-8056-56854c27ceba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:56.799161 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f9cba-1c76-4c55-8056-56854c27ceba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:56.801160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f9cba-1c76-4c55-8056-56854c27ceba None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:56.811041 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6904e95-4cd5-4b60-8867-b7534a85d0b1 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:56.818286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 265/527] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:56.819370 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f9cba-1c76-4c55-8056-56854c27ceba None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:56.854813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecdca7-92d6-42b8-ba12-7063f4849af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:56.855453 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecdca7-92d6-42b8-ba12-7063f4849af1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:56.855734 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecdca7-92d6-42b8-ba12-7063f4849af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:56.856008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecdca7-92d6-42b8-ba12-7063f4849af1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:56.865003 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecdca7-92d6-42b8-ba12-7063f4849af1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:56.866679 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecdca7-92d6-42b8-ba12-7063f4849af1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:56.880219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-9cecdca7-92d6-42b8-ba12-7063f4849af1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 14:14:56.880219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:56.880219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:56.880219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:56.880219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:56.880219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:56.880219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:56.880219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:56.880219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:56.880219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:56.880219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:56.880219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:56.880219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:14:56.880219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:14:56.880219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:14:56.880219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:14:56.881377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:56.881377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:56.881377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:14:56.881377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:14:56.881377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:14:56.881377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:14:56.881377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:56.881377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:56.881377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:56.881377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:56.881377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:56.881377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:56.881377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:56.881377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:56.881377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:56.881377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:56.881377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:56.881377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:56.882448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:56.882448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:56.882448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:14:56.882448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:14:56.882448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:14:56.882448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:14:56.882448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:14:56.882448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:14:56.882448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 14:14:56.882448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:56.885371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 263/528] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:14:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:56.886865 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecdca7-92d6-42b8-ba12-7063f4849af1 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:56.942503 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f9cba-1c76-4c55-8056-56854c27ceba None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:56.979893 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d08da-eebd-41ef-b811-70f3309362cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:56.980680 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d08da-eebd-41ef-b811-70f3309362cd None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:56.981127 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d08da-eebd-41ef-b811-70f3309362cd None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:56.981501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d08da-eebd-41ef-b811-70f3309362cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:56.989784 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d08da-eebd-41ef-b811-70f3309362cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:56.991540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d08da-eebd-41ef-b811-70f3309362cd None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:56.996323 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecdca7-92d6-42b8-ba12-7063f4849af1 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:57.005102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-912d08da-eebd-41ef-b811-70f3309362cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:14:57.005102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:57.005102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:57.005102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:57.005102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:57.005102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:57.005102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:57.005102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:57.005102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:57.005102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:57.005102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:57.005102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:57.005102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:14:57.005102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:14:57.005102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:14:57.006154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:14:57.006154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:57.006154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:57.006154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:57.006154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:57.006154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:57.006154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:57.006154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:57.006154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:57.006154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:57.006154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:57.006154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:57.006154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:57.006154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:57.006154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:57.006154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:57.006154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:57.007189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:14:57.007189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:14:57.007189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:14:57.007189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:14:57.007189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:14:57.007189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:14:57.007189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:14:57.007189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:57.008689 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 266/529] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:14:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:57.010108 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d08da-eebd-41ef-b811-70f3309362cd None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:57.036213 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654513ae-6b56-4833-ab67-de6994c5f45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:57.036420 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:57.037562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654513ae-6b56-4833-ab67-de6994c5f45f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:57.037990 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654513ae-6b56-4833-ab67-de6994c5f45f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:57.038405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654513ae-6b56-4833-ab67-de6994c5f45f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:57.046734 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654513ae-6b56-4833-ab67-de6994c5f45f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:57.048352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654513ae-6b56-4833-ab67-de6994c5f45f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:57.061134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-654513ae-6b56-4833-ab67-de6994c5f45f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:14:57.061134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:57.061134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:57.061134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:57.061134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:57.061134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:57.061134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:57.061134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:57.061134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:57.061134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:57.061134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:57.061134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:57.061134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:14:57.061134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:14:57.061134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:14:57.073882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:14:57.073882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:57.073882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:57.073882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:57.073882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:57.073882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:57.073882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:57.073882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:57.073882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:57.073882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:57.073882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:57.073882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:57.073882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:57.073882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:57.073882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:57.073882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:57.073882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:57.074879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:14:57.074879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:14:57.074879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:14:57.074879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:14:57.074879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:14:57.074879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:14:57.074879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:14:57.074879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:57.074879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 264/530] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:14:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:57.074879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654513ae-6b56-4833-ab67-de6994c5f45f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:57.076139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:57.129160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d08da-eebd-41ef-b811-70f3309362cd None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:57.173996 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688eb8b-ac14-4682-bf5d-c72e6b47908c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:57.175086 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688eb8b-ac14-4682-bf5d-c72e6b47908c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:57.175560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688eb8b-ac14-4682-bf5d-c72e6b47908c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:57.176280 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688eb8b-ac14-4682-bf5d-c72e6b47908c None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:57.177287 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688eb8b-ac14-4682-bf5d-c72e6b47908c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:57.177791 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688eb8b-ac14-4682-bf5d-c72e6b47908c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:57.177998 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654513ae-6b56-4833-ab67-de6994c5f45f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:57.179752 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688eb8b-ac14-4682-bf5d-c72e6b47908c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:57.201381 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 267/531] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Sep 5 14:14:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:57.202626 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688eb8b-ac14-4682-bf5d-c72e6b47908c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:57.219147 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8065f5-0d68-4c4b-9af0-fdd3499d685f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:57.219751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8065f5-0d68-4c4b-9af0-fdd3499d685f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:57.220034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8065f5-0d68-4c4b-9af0-fdd3499d685f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:57.220306 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8065f5-0d68-4c4b-9af0-fdd3499d685f None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:57.220999 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8065f5-0d68-4c4b-9af0-fdd3499d685f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:57.221333 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8065f5-0d68-4c4b-9af0-fdd3499d685f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:57.222992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8065f5-0d68-4c4b-9af0-fdd3499d685f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:57.246221 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 265/532] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:14:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:57.246770 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8065f5-0d68-4c4b-9af0-fdd3499d685f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:57.293902 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:57.317362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688eb8b-ac14-4682-bf5d-c72e6b47908c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:57.317539 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:57.355856 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8065f5-0d68-4c4b-9af0-fdd3499d685f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:57.358025 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95bd2e-65e9-41bb-9671-2488291c1303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:57.359739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95bd2e-65e9-41bb-9671-2488291c1303 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:57.360254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95bd2e-65e9-41bb-9671-2488291c1303 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:57.360886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95bd2e-65e9-41bb-9671-2488291c1303 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:57.361798 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95bd2e-65e9-41bb-9671-2488291c1303 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:57.362299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95bd2e-65e9-41bb-9671-2488291c1303 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:57.364383 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95bd2e-65e9-41bb-9671-2488291c1303 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:57.384861 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 268/533] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:14:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:57.384861 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95bd2e-65e9-41bb-9671-2488291c1303 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:57.399870 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b5b8d-6174-4b08-9b1e-4a76f932de04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:57.401697 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b5b8d-6174-4b08-9b1e-4a76f932de04 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:57.402084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b5b8d-6174-4b08-9b1e-4a76f932de04 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:57.402652 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b5b8d-6174-4b08-9b1e-4a76f932de04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:57.490712 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b5b8d-6174-4b08-9b1e-4a76f932de04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:57.492960 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b5b8d-6174-4b08-9b1e-4a76f932de04 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:57.512765 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95bd2e-65e9-41bb-9671-2488291c1303 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:57.549736 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477c372-d49f-4da9-9f94-3e1696082102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:57.550191 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477c372-d49f-4da9-9f94-3e1696082102 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:57.550594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477c372-d49f-4da9-9f94-3e1696082102 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:57.551225 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477c372-d49f-4da9-9f94-3e1696082102 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:57.552058 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477c372-d49f-4da9-9f94-3e1696082102 None admin] RBAC: Adding query filter params (role.id=5351e6d174334a8eaf71e8d2b3c079a7, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=d7e1db2b6f70497ab535e0e9e86ec4ae) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:57.552470 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477c372-d49f-4da9-9f94-3e1696082102 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:57.554039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477c372-d49f-4da9-9f94-3e1696082102 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:57.560659 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 269/534] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:14:57 2022] GET /identity/v3/role_assignments?user.id=d7e1db2b6f70497ab535e0e9e86ec4ae&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=5351e6d174334a8eaf71e8d2b3c079a7 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:57.561614 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477c372-d49f-4da9-9f94-3e1696082102 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:57.565192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:57.565430 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:57.604503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 266/535] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:14:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:14:57.614245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b5b8d-6174-4b08-9b1e-4a76f932de04 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:57.735376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477c372-d49f-4da9-9f94-3e1696082102 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:57.777432 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339314dc-54c5-4a53-baf7-c3e2097b573e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:57.778048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339314dc-54c5-4a53-baf7-c3e2097b573e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:57.778328 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339314dc-54c5-4a53-baf7-c3e2097b573e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:57.778602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339314dc-54c5-4a53-baf7-c3e2097b573e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:57.779341 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339314dc-54c5-4a53-baf7-c3e2097b573e None admin] RBAC: Adding query filter params (role.id=5351e6d174334a8eaf71e8d2b3c079a7, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=1a7e9f0daa1c48eca87d92ced265afdb) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:57.779635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339314dc-54c5-4a53-baf7-c3e2097b573e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:57.781119 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339314dc-54c5-4a53-baf7-c3e2097b573e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:57.787337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 270/536] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:14:57 2022] GET /identity/v3/role_assignments?user.id=1a7e9f0daa1c48eca87d92ced265afdb&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=5351e6d174334a8eaf71e8d2b3c079a7 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:57.804843 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b5b8d-6174-4b08-9b1e-4a76f932de04 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:57.848946 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09113c-cf2a-47d2-883c-0f98663d3f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:57.850072 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09113c-cf2a-47d2-883c-0f98663d3f46 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:57.850574 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09113c-cf2a-47d2-883c-0f98663d3f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:57.851040 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09113c-cf2a-47d2-883c-0f98663d3f46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:57.869096 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09113c-cf2a-47d2-883c-0f98663d3f46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:57.870925 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09113c-cf2a-47d2-883c-0f98663d3f46 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:57.887199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-be09113c-cf2a-47d2-883c-0f98663d3f46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:57.887199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:57.887199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:57.887199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:57.887199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:57.887199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:57.887199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:57.887199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:57.887199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:57.887199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:57.887199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:57.887199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:57.887199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:14:57.887199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:14:57.887199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:14:57.887199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:14:57.888129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:57.888129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:57.888129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:57.888129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:57.888129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:57.888129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:57.888129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:57.888129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:57.888129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:57.888129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:57.888129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:57.888129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:57.888129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:57.888129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:57.888129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:57.888129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:57.888129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:14:57.888951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:14:57.888951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:57.888951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:57.895307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 267/537] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:57.906157 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339314dc-54c5-4a53-baf7-c3e2097b573e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:58.019639 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:58.058594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339314dc-54c5-4a53-baf7-c3e2097b573e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:58.094333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8ba18-839b-4413-a2d2-1b01354bfe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:58.094935 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8ba18-839b-4413-a2d2-1b01354bfe2c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:58.095209 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8ba18-839b-4413-a2d2-1b01354bfe2c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:58.095473 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8ba18-839b-4413-a2d2-1b01354bfe2c None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:58.096108 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8ba18-839b-4413-a2d2-1b01354bfe2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:58.096409 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8ba18-839b-4413-a2d2-1b01354bfe2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:58.097800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8ba18-839b-4413-a2d2-1b01354bfe2c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:58.121179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 271/538] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:58.135360 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09113c-cf2a-47d2-883c-0f98663d3f46 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:58.170188 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:58.289088 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09113c-cf2a-47d2-883c-0f98663d3f46 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:58.335762 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a1619-555a-42c4-ab01-9de93b9af365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:58.336372 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a1619-555a-42c4-ab01-9de93b9af365 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:58.336593 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a1619-555a-42c4-ab01-9de93b9af365 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:58.336841 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a1619-555a-42c4-ab01-9de93b9af365 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:58.350555 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a1619-555a-42c4-ab01-9de93b9af365 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:58.352148 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a1619-555a-42c4-ab01-9de93b9af365 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:58.366859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-a78a1619-555a-42c4-ab01-9de93b9af365 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:14:58.366859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:58.366859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:58.366859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:58.366859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:58.366859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:58.366859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:58.366859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:58.366859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:58.366859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:58.366859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:58.366859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:58.366859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:14:58.366859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:14:58.366859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:14:58.367760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:14:58.367760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:58.367760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:58.367760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:58.367760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:58.367760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:58.367760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:58.367760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:58.367760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:58.367760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:58.367760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:58.367760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:58.367760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:58.367760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:58.367760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:58.367760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:58.367760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:58.369047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:14:58.369047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:14:58.369047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:14:58.369047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:14:58.369047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:14:58.369047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:14:58.369047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:14:58.369047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:58.369047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 268/539] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:14:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:58.374052 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8ba18-839b-4413-a2d2-1b01354bfe2c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:58.517339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a141d2c-547b-4dc1-bc42-a6aee4d0a946 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:58.517721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a141d2c-547b-4dc1-bc42-a6aee4d0a946 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:58.517953 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a141d2c-547b-4dc1-bc42-a6aee4d0a946 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:58.519556 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 269/540] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:14:58.524483 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0b0c8-c500-4a47-a41f-12211fdb2e8f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:58.524769 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0b0c8-c500-4a47-a41f-12211fdb2e8f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:58.525049 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0b0c8-c500-4a47-a41f-12211fdb2e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:58.542921 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8ba18-839b-4413-a2d2-1b01354bfe2c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:58.556674 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f8d0b0c8-c500-4a47-a41f-12211fdb2e8f None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:58.558053 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f8d0b0c8-c500-4a47-a41f-12211fdb2e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:58.583780 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:58.601256 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e28e6f-c45a-4d76-95f6-31f31baa16d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:58.601256 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e28e6f-c45a-4d76-95f6-31f31baa16d2 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:58.601256 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e28e6f-c45a-4d76-95f6-31f31baa16d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:58.601256 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e28e6f-c45a-4d76-95f6-31f31baa16d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:58.601599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e28e6f-c45a-4d76-95f6-31f31baa16d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:58.601599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e28e6f-c45a-4d76-95f6-31f31baa16d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:58.601599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e28e6f-c45a-4d76-95f6-31f31baa16d2 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:58.626868 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 272/541] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:14:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:58.632112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e28e6f-c45a-4d76-95f6-31f31baa16d2 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:58.697367 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 270/542] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:14:58.799701 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e28e6f-c45a-4d76-95f6-31f31baa16d2 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:58.850941 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaca4c1-d040-428b-8649-ff9810fb38fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:58.851981 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaca4c1-d040-428b-8649-ff9810fb38fc None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:58.852456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaca4c1-d040-428b-8649-ff9810fb38fc None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:58.852920 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaca4c1-d040-428b-8649-ff9810fb38fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:58.854750 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaca4c1-d040-428b-8649-ff9810fb38fc None admin] RBAC: Adding query filter params (role.id=5351e6d174334a8eaf71e8d2b3c079a7, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=b0ec118e5a114429b3e1c91041f7caf6) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:58.855256 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaca4c1-d040-428b-8649-ff9810fb38fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:58.856878 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaca4c1-d040-428b-8649-ff9810fb38fc None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:58.869417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 273/543] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:14:58 2022] GET /identity/v3/role_assignments?user.id=b0ec118e5a114429b3e1c91041f7caf6&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=5351e6d174334a8eaf71e8d2b3c079a7 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:58.979794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0b0c8-c500-4a47-a41f-12211fdb2e8f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:58.990121 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:59.109034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77901430-8eaf-438e-afb3-6e0628424529 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:59.109353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77901430-8eaf-438e-afb3-6e0628424529 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:59.109520 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77901430-8eaf-438e-afb3-6e0628424529 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:59.111251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 274/544] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:59.114422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0b0c8-c500-4a47-a41f-12211fdb2e8f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:59.116935 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59e6e6-dd9c-4b3d-8df3-e8bd96625167 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:59.117251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59e6e6-dd9c-4b3d-8df3-e8bd96625167 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:59.117526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59e6e6-dd9c-4b3d-8df3-e8bd96625167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:59.158929 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-fa59e6e6-dd9c-4b3d-8df3-e8bd96625167 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:14:59.160128 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fa59e6e6-dd9c-4b3d-8df3-e8bd96625167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:14:59.177976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d888536-9f2f-4efc-85da-19f1f0322ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:59.178607 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d888536-9f2f-4efc-85da-19f1f0322ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:59.178880 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d888536-9f2f-4efc-85da-19f1f0322ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:59.179145 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d888536-9f2f-4efc-85da-19f1f0322ce1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:59.204920 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d888536-9f2f-4efc-85da-19f1f0322ce1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:59.209737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-7d888536-9f2f-4efc-85da-19f1f0322ce1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:14:59.209737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:59.209737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:59.209737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:59.209737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:59.209737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:59.209737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:59.209737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:59.209737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:59.209737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:59.209737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:59.209737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:59.209737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:59.209737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:59.209737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:59.209737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:59.210602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:59.210602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:59.210602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:59.210602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:59.210602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:59.210602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:59.210602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:59.210602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:59.210602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:59.210602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:59.210602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:59.210602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:59.210602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:59.210602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:59.210602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:59.210602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:59.211392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:59.211392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:59.211392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:59.211392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:59.211392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:59.211392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:59.211392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:59.211392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:59.211392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:59.211392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:59.211392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:14:59.211392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:59.211392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 271/545] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:14:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:59.217075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d888536-9f2f-4efc-85da-19f1f0322ce1 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:59.280506 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:59.304013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 275/546] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:14:59.339800 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:59.395209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d888536-9f2f-4efc-85da-19f1f0322ce1 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:59.452399 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d5b0e-b3c7-4dd7-b656-3a45735cd0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:59.453005 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d5b0e-b3c7-4dd7-b656-3a45735cd0fd None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:59.453316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d5b0e-b3c7-4dd7-b656-3a45735cd0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:59.453587 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d5b0e-b3c7-4dd7-b656-3a45735cd0fd None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:59.454248 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d5b0e-b3c7-4dd7-b656-3a45735cd0fd None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:59.454549 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d5b0e-b3c7-4dd7-b656-3a45735cd0fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:59.455929 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d5b0e-b3c7-4dd7-b656-3a45735cd0fd None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:59.467849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 272/547] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 5 14:14:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:59.473228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59e6e6-dd9c-4b3d-8df3-e8bd96625167 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:59.579705 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d5b0e-b3c7-4dd7-b656-3a45735cd0fd None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:59.600628 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59e6e6-dd9c-4b3d-8df3-e8bd96625167 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:59.638830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd476d9-e60e-4293-8911-9f9dce9fba37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:59.639483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd476d9-e60e-4293-8911-9f9dce9fba37 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:59.639800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd476d9-e60e-4293-8911-9f9dce9fba37 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:59.640078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd476d9-e60e-4293-8911-9f9dce9fba37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:59.651347 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd476d9-e60e-4293-8911-9f9dce9fba37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:59.652822 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd476d9-e60e-4293-8911-9f9dce9fba37 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:59.668828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-7fd476d9-e60e-4293-8911-9f9dce9fba37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:59.668828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:59.668828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:59.668828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:59.668828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:59.668828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:59.668828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:59.668828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:59.668828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:59.668828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:59.668828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:59.668828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:59.668828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:14:59.668828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:14:59.668828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:14:59.668828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:14:59.669800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:59.669800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:59.669800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:59.669800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:59.669800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:59.669800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:59.669800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:59.669800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:59.669800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:59.669800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:59.669800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:59.669800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:59.669800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:59.669800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:59.669800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:59.669800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:59.669800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:14:59.671134 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:14:59.671134 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:14:59.671134 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:14:59.671134 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 276/548] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:59.677727 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd476d9-e60e-4293-8911-9f9dce9fba37 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:59.717523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:59.795391 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd476d9-e60e-4293-8911-9f9dce9fba37 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:59.819832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d5b0e-b3c7-4dd7-b656-3a45735cd0fd None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:14:59.832273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e557e8-7411-44fc-bf30-d3c3df233d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:59.832994 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e557e8-7411-44fc-bf30-d3c3df233d83 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:59.833307 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e557e8-7411-44fc-bf30-d3c3df233d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:59.833587 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e557e8-7411-44fc-bf30-d3c3df233d83 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:59.834344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e557e8-7411-44fc-bf30-d3c3df233d83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:14:59.834658 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e557e8-7411-44fc-bf30-d3c3df233d83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:14:59.836042 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e557e8-7411-44fc-bf30-d3c3df233d83 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:14:59.849181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 277/549] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:14:59.856159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e557e8-7411-44fc-bf30-d3c3df233d83 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:59.878532 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:59.889526 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afda860-fcb9-4cd4-88dc-a30a21aeda14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:14:59.890605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afda860-fcb9-4cd4-88dc-a30a21aeda14 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:59.890889 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afda860-fcb9-4cd4-88dc-a30a21aeda14 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:59.891167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afda860-fcb9-4cd4-88dc-a30a21aeda14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:59.912414 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afda860-fcb9-4cd4-88dc-a30a21aeda14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:14:59.918944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-5afda860-fcb9-4cd4-88dc-a30a21aeda14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:14:59.918944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:14:59.918944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:14:59.918944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:14:59.918944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:14:59.918944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:14:59.918944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:14:59.918944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:14:59.918944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:14:59.918944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:14:59.918944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:14:59.918944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:14:59.918944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:14:59.918944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:14:59.918944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:14:59.918944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:14:59.921260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:14:59.921260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:14:59.921260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:14:59.921260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:14:59.921260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:14:59.921260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:14:59.921260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:14:59.921260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:14:59.921260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:14:59.921260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:14:59.921260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:14:59.921260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:14:59.921260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:14:59.921260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:14:59.921260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:14:59.921260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:14:59.923289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:14:59.923289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:14:59.923289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:14:59.923289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:14:59.923289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:14:59.923289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:14:59.923289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:14:59.923289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:14:59.923289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:14:59.923289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:14:59.923289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:14:59.923289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:14:59.924836 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 273/550] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:14:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:14:59.929089 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769e788-a022-4014-b748-274cd90e5d2c None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:14:59.929089 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769e788-a022-4014-b748-274cd90e5d2c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:14:59.929089 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769e788-a022-4014-b748-274cd90e5d2c None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:14:59.932313 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 274/551] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:14:59.933375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769e788-a022-4014-b748-274cd90e5d2c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:14:59.984824 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:14:59.995465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e557e8-7411-44fc-bf30-d3c3df233d83 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:00.034709 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd53207-00b0-4bca-9377-ddd28406d315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:00.035720 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd53207-00b0-4bca-9377-ddd28406d315 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:00.036172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd53207-00b0-4bca-9377-ddd28406d315 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:00.036747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd53207-00b0-4bca-9377-ddd28406d315 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:00.041988 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769e788-a022-4014-b748-274cd90e5d2c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:00.045749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd53207-00b0-4bca-9377-ddd28406d315 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:00.047462 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd53207-00b0-4bca-9377-ddd28406d315 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:00.060285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-1bd53207-00b0-4bca-9377-ddd28406d315 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 14:15:00.060285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:00.060285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:00.060285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:00.060285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:00.060285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:00.060285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:00.060285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:00.060285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:00.060285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:00.060285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:00.060285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:00.060285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:00.060285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:00.060285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:00.060285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:00.061425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:00.061425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:00.061425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:00.061425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:00.061425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:00.061425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:00.061425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:00.061425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:00.061425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:00.061425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:00.061425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:00.061425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:00.061425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:00.061425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:00.061425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:00.061425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:00.061425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:00.061425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:00.062564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:00.062564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:00.062564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:00.062564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:00.062564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:00.062564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:00.062564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:00.062564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:00.062564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 14:15:00.062564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:00.064751 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 278/552] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:14:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:00.066386 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c364d91-dff6-4243-a40d-e55580ac75ab None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:00.066866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c364d91-dff6-4243-a40d-e55580ac75ab None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:00.067394 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c364d91-dff6-4243-a40d-e55580ac75ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:00.079268 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e98c25-0a59-405e-bab5-fea39ef07d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:00.079933 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e98c25-0a59-405e-bab5-fea39ef07d15 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:00.080214 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e98c25-0a59-405e-bab5-fea39ef07d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:00.080479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e98c25-0a59-405e-bab5-fea39ef07d15 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:00.081236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e98c25-0a59-405e-bab5-fea39ef07d15 None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:00.081543 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e98c25-0a59-405e-bab5-fea39ef07d15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:00.082975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e98c25-0a59-405e-bab5-fea39ef07d15 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:00.089464 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-8c364d91-dff6-4243-a40d-e55580ac75ab None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:00.090917 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8c364d91-dff6-4243-a40d-e55580ac75ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:00.096229 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 275/553] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 5 14:14:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:00.096229 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e98c25-0a59-405e-bab5-fea39ef07d15 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:00.162743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:00.182250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 279/554] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:15:00.185274 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c364d91-dff6-4243-a40d-e55580ac75ab None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:00.234559 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e98c25-0a59-405e-bab5-fea39ef07d15 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:00.273545 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257d059-550f-4d35-9d2e-30132ff135dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:00.274146 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257d059-550f-4d35-9d2e-30132ff135dc None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:00.274422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257d059-550f-4d35-9d2e-30132ff135dc None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:00.274688 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257d059-550f-4d35-9d2e-30132ff135dc None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:00.275940 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257d059-550f-4d35-9d2e-30132ff135dc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:00.276232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257d059-550f-4d35-9d2e-30132ff135dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:00.277686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257d059-550f-4d35-9d2e-30132ff135dc None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:00.297196 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 276/555] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Sep 5 14:15:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:00.298577 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d608ce9-5815-4ae6-afd0-de542e2e863c None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:00.298863 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d608ce9-5815-4ae6-afd0-de542e2e863c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:00.299181 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d608ce9-5815-4ae6-afd0-de542e2e863c None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:00.301156 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 277/556] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:00.305957 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50ae90-d44e-42fc-beb4-120d598e09c5 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:00.307055 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50ae90-d44e-42fc-beb4-120d598e09c5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:00.307545 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50ae90-d44e-42fc-beb4-120d598e09c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:00.314055 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:00.329281 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ac50ae90-d44e-42fc-beb4-120d598e09c5 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:00.330789 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ac50ae90-d44e-42fc-beb4-120d598e09c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:00.335966 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c364d91-dff6-4243-a40d-e55580ac75ab None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:00.381449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50513c6-6b9b-4e0e-8884-2fe0b4e83f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:00.382096 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50513c6-6b9b-4e0e-8884-2fe0b4e83f32 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:00.382631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50513c6-6b9b-4e0e-8884-2fe0b4e83f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:00.382919 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50513c6-6b9b-4e0e-8884-2fe0b4e83f32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:00.397722 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50513c6-6b9b-4e0e-8884-2fe0b4e83f32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:00.400532 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50513c6-6b9b-4e0e-8884-2fe0b4e83f32 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:00.410199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 278/557] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:15:00.411749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50ae90-d44e-42fc-beb4-120d598e09c5 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:00.419268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-f50513c6-6b9b-4e0e-8884-2fe0b4e83f32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:00.419268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:00.419268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:00.419268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:00.419268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:00.419268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:00.419268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:00.419268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:00.419268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:00.419268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:00.419268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:00.419268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:00.419268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:00.419268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:00.419268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:00.419268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:00.420250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:00.420250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:00.420250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:00.420250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:00.420250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:00.420250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:00.420250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:00.420250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:00.420250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:00.420250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:00.420250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:00.420250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:00.420250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:00.420250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:00.420250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:00.420250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:00.420250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:00.421518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:00.421518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:00.421518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:00.421518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 280/558] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:00.427570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50513c6-6b9b-4e0e-8884-2fe0b4e83f32 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:00.473546 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:00.536579 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50ae90-d44e-42fc-beb4-120d598e09c5 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:00.557639 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50513c6-6b9b-4e0e-8884-2fe0b4e83f32 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:00.575218 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878187b-1bbc-4188-a969-4a90d629759f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:00.575826 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878187b-1bbc-4188-a969-4a90d629759f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:00.576107 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878187b-1bbc-4188-a969-4a90d629759f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:00.576431 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878187b-1bbc-4188-a969-4a90d629759f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:00.595211 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c936e-425f-459c-8105-be9f15e5c7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:00.596160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c936e-425f-459c-8105-be9f15e5c7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:00.596634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c936e-425f-459c-8105-be9f15e5c7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:00.597124 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c936e-425f-459c-8105-be9f15e5c7e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:00.597955 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c936e-425f-459c-8105-be9f15e5c7e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:00.598853 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c936e-425f-459c-8105-be9f15e5c7e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:00.600498 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c936e-425f-459c-8105-be9f15e5c7e2 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:00.602196 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:00.618118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 281/559] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:00.619393 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c936e-425f-459c-8105-be9f15e5c7e2 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:00.650741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878187b-1bbc-4188-a969-4a90d629759f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:00.652246 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878187b-1bbc-4188-a969-4a90d629759f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:00.695527 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:00.727948 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c936e-425f-459c-8105-be9f15e5c7e2 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:00.764568 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 279/560] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:15:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:15:00.765714 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878187b-1bbc-4188-a969-4a90d629759f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:00.766289 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d99583-457a-4ce5-8c1c-22f5d5acf8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:00.767011 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d99583-457a-4ce5-8c1c-22f5d5acf8ea None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:00.767383 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d99583-457a-4ce5-8c1c-22f5d5acf8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:00.767765 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d99583-457a-4ce5-8c1c-22f5d5acf8ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:00.779137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d99583-457a-4ce5-8c1c-22f5d5acf8ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:15:00.783890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-05d99583-457a-4ce5-8c1c-22f5d5acf8ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:00.783890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:00.783890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:00.783890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:00.783890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:00.783890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:00.783890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:00.783890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:00.783890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:00.783890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:00.783890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:00.783890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:00.783890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:15:00.783890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:15:00.783890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:15:00.783890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:15:00.784800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:15:00.784800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:15:00.784800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:15:00.784800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:15:00.784800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:00.784800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:00.784800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:00.784800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:00.784800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:00.784800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:00.784800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:00.784800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:00.784800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:00.784800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:00.784800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:00.784800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:00.790198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:00.790198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:00.790198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:00.790198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:00.790198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:15:00.790198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:15:00.790198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:15:00.790198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:15:00.790198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:15:00.790198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:15:00.790198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:00.790198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:00.790198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 282/561] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:15:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:00.790198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d99583-457a-4ce5-8c1c-22f5d5acf8ea None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:00.850696 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:00.883639 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878187b-1bbc-4188-a969-4a90d629759f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:00.906833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d99583-457a-4ce5-8c1c-22f5d5acf8ea None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:00.921294 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e8721-0c15-47c4-915f-5bb24a3a256a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:00.921658 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e8721-0c15-47c4-915f-5bb24a3a256a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:00.921934 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e8721-0c15-47c4-915f-5bb24a3a256a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:00.922203 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e8721-0c15-47c4-915f-5bb24a3a256a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:00.929848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e8721-0c15-47c4-915f-5bb24a3a256a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:00.931302 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e8721-0c15-47c4-915f-5bb24a3a256a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:00.934403 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:00.943624 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19041264-a4a1-4645-811f-6e45b374084b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:00.944205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-104e8721-0c15-47c4-915f-5bb24a3a256a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 14:15:00.944205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:00.944205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:00.944205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:00.944205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:00.944205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:00.944205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:00.944205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:00.944205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:00.944205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:00.944205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:00.944205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:00.944205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:00.944205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:00.944205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:00.944205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:00.945129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:00.945129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:00.945129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:00.945129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:00.945129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:00.945129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:00.945129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:00.945129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:00.945129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:00.945129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:00.945129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:00.945129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:00.945129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:00.945129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:00.945129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:00.945129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:00.945129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:00.945129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:00.946108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:00.946108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:00.946108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:00.946108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:00.946108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:00.946108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:00.946108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:00.946108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:00.946108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 14:15:00.946108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:00.946655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19041264-a4a1-4645-811f-6e45b374084b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:00.946655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19041264-a4a1-4645-811f-6e45b374084b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:00.946655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19041264-a4a1-4645-811f-6e45b374084b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:00.947347 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 280/562] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 5 14:15:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:00.950672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e8721-0c15-47c4-915f-5bb24a3a256a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:00.958467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19041264-a4a1-4645-811f-6e45b374084b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:15:00.964479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-19041264-a4a1-4645-811f-6e45b374084b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:00.964479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:00.964479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:00.964479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:00.964479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:00.964479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:00.964479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:00.964479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:00.964479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:00.964479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:00.964479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:00.964479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:00.964479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:15:00.964479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:15:00.964479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:15:00.964479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:15:00.965617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:15:00.965617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:15:00.965617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:15:00.965617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:15:00.965617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:00.965617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:00.965617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:00.965617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:00.965617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:00.965617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:00.965617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:00.965617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:00.965617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:00.965617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:00.965617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:00.965617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:00.966459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:00.966459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:00.966459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:00.966459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:00.966459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:15:00.966459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:15:00.966459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:15:00.966459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:15:00.966459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:15:00.966459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:15:00.966459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:00.966459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:00.966459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 283/563] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:15:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:00.967141 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19041264-a4a1-4645-811f-6e45b374084b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:01.063063 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e8721-0c15-47c4-915f-5bb24a3a256a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:01.073929 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19041264-a4a1-4645-811f-6e45b374084b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:01.088771 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:01.100926 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f059e8-7aa6-443f-851c-f6e993f4eba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:01.101573 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f059e8-7aa6-443f-851c-f6e993f4eba7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:01.101849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f059e8-7aa6-443f-851c-f6e993f4eba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:01.102118 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f059e8-7aa6-443f-851c-f6e993f4eba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:01.109536 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361deea0-030f-4126-884b-d0d0f922b0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:01.110155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361deea0-030f-4126-884b-d0d0f922b0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:01.110435 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361deea0-030f-4126-884b-d0d0f922b0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:01.110708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361deea0-030f-4126-884b-d0d0f922b0c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:01.111371 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361deea0-030f-4126-884b-d0d0f922b0c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:01.111681 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361deea0-030f-4126-884b-d0d0f922b0c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:01.112833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f059e8-7aa6-443f-851c-f6e993f4eba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:01.113081 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361deea0-030f-4126-884b-d0d0f922b0c5 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:01.114289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f059e8-7aa6-443f-851c-f6e993f4eba7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:01.122029 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 284/564] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 5 14:15:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:01.122826 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361deea0-030f-4126-884b-d0d0f922b0c5 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:01.129449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-99f059e8-7aa6-443f-851c-f6e993f4eba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:01.129449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:01.129449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:01.129449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:01.129449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:01.129449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:01.129449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:01.129449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:01.129449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:01.129449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:01.129449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:01.129449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:01.129449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:01.129449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:01.129449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:01.129449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:01.130450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:01.130450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:01.130450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:01.130450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:01.130450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:01.130450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:01.130450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:01.130450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:01.130450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:01.130450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:01.130450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:01.130450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:01.130450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:01.130450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:01.130450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:01.130450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:01.130450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:01.131323 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:01.131323 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:01.131323 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:01.131323 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 281/565] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:01.132278 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f059e8-7aa6-443f-851c-f6e993f4eba7 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:01.186361 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:01.225997 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361deea0-030f-4126-884b-d0d0f922b0c5 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:01.233311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f059e8-7aa6-443f-851c-f6e993f4eba7 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:01.264570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549fe65-81f5-4ef8-9bb1-61afc885d329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:01.265218 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549fe65-81f5-4ef8-9bb1-61afc885d329 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:01.265507 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549fe65-81f5-4ef8-9bb1-61afc885d329 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:01.265778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549fe65-81f5-4ef8-9bb1-61afc885d329 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:01.266505 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549fe65-81f5-4ef8-9bb1-61afc885d329 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:01.266811 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549fe65-81f5-4ef8-9bb1-61afc885d329 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:01.267364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ac6e0-31ba-494f-8f9b-e1795d60f5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:01.267960 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ac6e0-31ba-494f-8f9b-e1795d60f5ef None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:01.268235 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ac6e0-31ba-494f-8f9b-e1795d60f5ef None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:01.268332 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549fe65-81f5-4ef8-9bb1-61afc885d329 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:01.268505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ac6e0-31ba-494f-8f9b-e1795d60f5ef None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:01.269185 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ac6e0-31ba-494f-8f9b-e1795d60f5ef None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:01.269487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ac6e0-31ba-494f-8f9b-e1795d60f5ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:01.270822 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ac6e0-31ba-494f-8f9b-e1795d60f5ef None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:01.278694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 282/566] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 5 14:15:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:01.278694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cd034-6308-4953-8526-e94f58489080 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:01.278694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cd034-6308-4953-8526-e94f58489080 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:01.278694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cd034-6308-4953-8526-e94f58489080 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:01.278694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 283/567] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:01.278694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4cd034-6308-4953-8526-e94f58489080 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:01.287726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 285/568] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 5 14:15:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:01.288400 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549fe65-81f5-4ef8-9bb1-61afc885d329 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:01.324765 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:01.385801 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4cd034-6308-4953-8526-e94f58489080 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:01.391233 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549fe65-81f5-4ef8-9bb1-61afc885d329 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:01.399244 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:01.419299 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d72ac-e9a7-4176-b61d-56c657f4c582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:01.419949 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d72ac-e9a7-4176-b61d-56c657f4c582 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:01.420190 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d72ac-e9a7-4176-b61d-56c657f4c582 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:01.420463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d72ac-e9a7-4176-b61d-56c657f4c582 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:01.425597 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3525d5a-ef60-4a62-8516-e43e84b05a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:01.426460 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3525d5a-ef60-4a62-8516-e43e84b05a1f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:01.426730 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3525d5a-ef60-4a62-8516-e43e84b05a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:01.427364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3525d5a-ef60-4a62-8516-e43e84b05a1f None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:01.427638 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3525d5a-ef60-4a62-8516-e43e84b05a1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:01.427939 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3525d5a-ef60-4a62-8516-e43e84b05a1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:01.429366 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3525d5a-ef60-4a62-8516-e43e84b05a1f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:01.431733 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d72ac-e9a7-4176-b61d-56c657f4c582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:01.433274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d72ac-e9a7-4176-b61d-56c657f4c582 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:01.440586 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 286/569] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:01.441412 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3525d5a-ef60-4a62-8516-e43e84b05a1f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:01.452575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-350d72ac-e9a7-4176-b61d-56c657f4c582 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:01.452575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:01.452575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:01.452575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:01.452575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:01.452575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:01.452575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:01.452575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:01.452575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:01.452575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:01.452575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:01.452575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:01.452575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:01.452575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:01.452575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:01.452575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:01.453783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:01.453783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:01.453783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:01.453783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:01.453783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:01.453783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:01.453783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:01.453783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:01.453783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:01.453783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:01.453783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:01.453783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:01.453783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:01.453783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:01.453783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:01.453783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:01.453783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:01.454997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:01.454997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:01.454997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:01.454997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 284/570] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:01.457128 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56413c7-25bc-42cd-a20e-9e55af20bb28 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:01.457420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56413c7-25bc-42cd-a20e-9e55af20bb28 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:01.457780 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56413c7-25bc-42cd-a20e-9e55af20bb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:01.475559 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e56413c7-25bc-42cd-a20e-9e55af20bb28 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:01.476795 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e56413c7-25bc-42cd-a20e-9e55af20bb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:01.536749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:01.543886 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 285/571] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:15:01.544022 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3525d5a-ef60-4a62-8516-e43e84b05a1f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:01.550512 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56413c7-25bc-42cd-a20e-9e55af20bb28 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:01.579475 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb38286-6deb-44a8-9ed8-adf257abd88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:01.580103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb38286-6deb-44a8-9ed8-adf257abd88c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:01.580381 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb38286-6deb-44a8-9ed8-adf257abd88c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:01.580655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb38286-6deb-44a8-9ed8-adf257abd88c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:01.591023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb38286-6deb-44a8-9ed8-adf257abd88c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:01.592468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb38286-6deb-44a8-9ed8-adf257abd88c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:01.607764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-1eb38286-6deb-44a8-9ed8-adf257abd88c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:01.607764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:01.607764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:01.607764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:01.607764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:01.607764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:01.607764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:01.607764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:01.607764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:01.607764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:01.607764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:01.607764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:01.607764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:01.607764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:01.607764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:01.607764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:01.609158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:01.609158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:01.609158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:01.609158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:01.609158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:01.609158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:01.609158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:01.609158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:01.609158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:01.609158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:01.609158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:01.609158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:01.609158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:01.609158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:01.609158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:01.609158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:01.609158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:01.610049 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:01.610049 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:01.610049 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:01.610049 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 287/572] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:01.610049 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb38286-6deb-44a8-9ed8-adf257abd88c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:01.667974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:01.674101 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56413c7-25bc-42cd-a20e-9e55af20bb28 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:01.708992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05280e-b856-43df-9740-755554111aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:01.709646 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05280e-b856-43df-9740-755554111aad None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:01.709930 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05280e-b856-43df-9740-755554111aad None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:01.710199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05280e-b856-43df-9740-755554111aad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:01.713836 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb38286-6deb-44a8-9ed8-adf257abd88c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:01.720424 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05280e-b856-43df-9740-755554111aad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:01.721909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05280e-b856-43df-9740-755554111aad None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:01.739295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-ff05280e-b856-43df-9740-755554111aad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:01.739295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:01.739295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:01.739295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:01.739295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:01.739295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:01.739295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:01.739295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:01.739295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:01.739295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:01.739295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:01.739295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:01.739295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:01.739295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:01.739295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:01.739295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:01.740232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:01.740232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:01.740232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:01.740232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:01.740232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:01.740232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:01.740232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:01.740232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:01.740232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:01.740232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:01.740232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:01.740232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:01.740232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:01.740232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:01.740232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:01.740232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:01.740232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:01.746562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:01.746562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:01.746562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:01.746562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 286/573] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:01.746562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05280e-b856-43df-9740-755554111aad None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:01.748248 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f65139-1012-402f-b7cb-a5fdfad4b0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:01.749214 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f65139-1012-402f-b7cb-a5fdfad4b0fc None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:01.749492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f65139-1012-402f-b7cb-a5fdfad4b0fc None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:01.749761 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f65139-1012-402f-b7cb-a5fdfad4b0fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:01.756750 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f65139-1012-402f-b7cb-a5fdfad4b0fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:01.758242 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f65139-1012-402f-b7cb-a5fdfad4b0fc None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:01.771179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-a1f65139-1012-402f-b7cb-a5fdfad4b0fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:01.771179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:01.771179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:01.771179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:01.771179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:01.771179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:01.771179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:01.771179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:01.771179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:01.771179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:01.771179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:01.771179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:01.771179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:01.771179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:01.771179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:01.772230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:01.772230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:01.772230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:01.772230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:01.772230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:01.772230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:01.772230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:01.772230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:01.772230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:01.772230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:01.772230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:01.772230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:01.772230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:01.772230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:01.772230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:01.772230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:01.772230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:01.773181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:01.773181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:01.773181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:01.773181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:01.773181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:01.773181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:01.773181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:01.773181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:01.773181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 288/574] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:01.773181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f65139-1012-402f-b7cb-a5fdfad4b0fc None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:01.787929 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:01.853600 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05280e-b856-43df-9740-755554111aad None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:01.882065 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f65139-1012-402f-b7cb-a5fdfad4b0fc None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:01.887693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a39001-2108-4469-9792-78e2b4e54c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:01.888294 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a39001-2108-4469-9792-78e2b4e54c66 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:01.888575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a39001-2108-4469-9792-78e2b4e54c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:01.888847 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a39001-2108-4469-9792-78e2b4e54c66 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:01.889512 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a39001-2108-4469-9792-78e2b4e54c66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:01.889814 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a39001-2108-4469-9792-78e2b4e54c66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:01.891180 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a39001-2108-4469-9792-78e2b4e54c66 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:01.902919 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 287/575] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:01.903698 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a39001-2108-4469-9792-78e2b4e54c66 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:01.915644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e5172-a8cc-4264-a6e1-3283a5c8963d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:01.916251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e5172-a8cc-4264-a6e1-3283a5c8963d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:01.916685 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e5172-a8cc-4264-a6e1-3283a5c8963d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:01.916966 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e5172-a8cc-4264-a6e1-3283a5c8963d None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:01.917201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:01.917646 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e5172-a8cc-4264-a6e1-3283a5c8963d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:01.917950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e5172-a8cc-4264-a6e1-3283a5c8963d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:01.919328 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e5172-a8cc-4264-a6e1-3283a5c8963d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:01.931743 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 289/576] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:01.931743 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e5172-a8cc-4264-a6e1-3283a5c8963d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:01.998708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:02.007740 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a39001-2108-4469-9792-78e2b4e54c66 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:02.034051 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e5172-a8cc-4264-a6e1-3283a5c8963d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:02.043552 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cf39b-0072-4a66-9ade-fd93ffcb669f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:02.044153 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cf39b-0072-4a66-9ade-fd93ffcb669f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:02.044436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cf39b-0072-4a66-9ade-fd93ffcb669f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:02.044715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cf39b-0072-4a66-9ade-fd93ffcb669f None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:02.045378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01cf39b-0072-4a66-9ade-fd93ffcb669f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:02.045680 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01cf39b-0072-4a66-9ade-fd93ffcb669f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:02.047059 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01cf39b-0072-4a66-9ade-fd93ffcb669f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:02.059352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 288/577] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:02.060139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cf39b-0072-4a66-9ade-fd93ffcb669f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:02.069459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ffe46-4417-4852-b5c8-a5cff549b989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:02.070061 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ffe46-4417-4852-b5c8-a5cff549b989 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:02.070344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ffe46-4417-4852-b5c8-a5cff549b989 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:02.070614 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ffe46-4417-4852-b5c8-a5cff549b989 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:02.071306 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ffe46-4417-4852-b5c8-a5cff549b989 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:02.071611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ffe46-4417-4852-b5c8-a5cff549b989 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:02.073673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ffe46-4417-4852-b5c8-a5cff549b989 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:02.086524 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 290/578] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:02.087309 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ffe46-4417-4852-b5c8-a5cff549b989 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:02.132561 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:02.166710 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cf39b-0072-4a66-9ade-fd93ffcb669f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:02.197712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ffe46-4417-4852-b5c8-a5cff549b989 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:02.201401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995b8cf-c3ed-457a-b347-5a8cd3e57b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:02.202042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995b8cf-c3ed-457a-b347-5a8cd3e57b4e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:02.202382 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995b8cf-c3ed-457a-b347-5a8cd3e57b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:02.202590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995b8cf-c3ed-457a-b347-5a8cd3e57b4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:02.213497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995b8cf-c3ed-457a-b347-5a8cd3e57b4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:15:02.218936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-5995b8cf-c3ed-457a-b347-5a8cd3e57b4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:02.218936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:02.218936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:02.218936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:02.218936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:02.218936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:02.218936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:02.218936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:02.218936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:02.218936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:02.218936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:02.218936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:02.218936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:15:02.218936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:15:02.218936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:15:02.218936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:15:02.220016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:15:02.220016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:15:02.220016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:15:02.220016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:15:02.220016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:02.220016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:02.220016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:02.220016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:02.220016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:02.220016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:02.220016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:02.220016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:02.220016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:02.220016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:02.220016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:02.220016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:02.220846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:02.220846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:02.220846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:02.220846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:02.220846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:15:02.220846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:15:02.220846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:15:02.220846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:15:02.220846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:15:02.220846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:15:02.220846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:02.220846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:02.220846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 289/579] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:15:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:02.220846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995b8cf-c3ed-457a-b347-5a8cd3e57b4e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:02.228240 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:02.239500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126c387-afe3-4bda-a0a8-30bee96ca232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:02.240159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126c387-afe3-4bda-a0a8-30bee96ca232 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:02.240446 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126c387-afe3-4bda-a0a8-30bee96ca232 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:02.240724 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126c387-afe3-4bda-a0a8-30bee96ca232 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:02.248637 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126c387-afe3-4bda-a0a8-30bee96ca232 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:02.250172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126c387-afe3-4bda-a0a8-30bee96ca232 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:02.262217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-8126c387-afe3-4bda-a0a8-30bee96ca232 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 14:15:02.262217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:02.262217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:02.262217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:02.262217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:02.262217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:02.262217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:02.262217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:02.262217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:02.262217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:02.262217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:02.262217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:02.262217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:02.262217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:02.262217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:02.262217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:02.263286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:02.263286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:02.263286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:02.263286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:02.263286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:02.263286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:02.263286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:02.263286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:02.263286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:02.263286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:02.263286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:02.263286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:02.263286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:02.263286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:02.263286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:02.263286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:02.263286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:02.263286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:02.264226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:02.264226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:02.264226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:02.264226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:02.264226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:02.264226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:02.264226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:02.264226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:02.264226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 14:15:02.264226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:02.264226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 291/580] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:15:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:02.264226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126c387-afe3-4bda-a0a8-30bee96ca232 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:02.324230 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995b8cf-c3ed-457a-b347-5a8cd3e57b4e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:02.349620 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:02.358011 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f0b0c-ca2a-4918-8766-cf79922ed3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:02.358635 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f0b0c-ca2a-4918-8766-cf79922ed3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:02.358914 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f0b0c-ca2a-4918-8766-cf79922ed3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:02.359188 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f0b0c-ca2a-4918-8766-cf79922ed3f9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:02.363501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126c387-afe3-4bda-a0a8-30bee96ca232 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:02.367277 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f0b0c-ca2a-4918-8766-cf79922ed3f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:02.368752 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f0b0c-ca2a-4918-8766-cf79922ed3f9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:02.379644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-aa7f0b0c-ca2a-4918-8766-cf79922ed3f9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 05 14:15:02.379644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:02.379644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:02.379644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:02.379644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:02.379644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:02.379644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:02.379644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:02.379644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:02.379644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:02.379644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:02.379644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:02.379644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:02.379644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:02.379644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:02.379644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:02.380694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:02.380694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:02.380694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:02.380694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:02.380694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:02.380694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:02.380694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:02.380694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:02.380694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:02.380694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:02.380694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:02.380694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:02.380694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:02.380694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:02.380694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:02.380694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:02.380694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:02.380694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:02.381660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:02.381660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:02.381660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:02.381660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:02.381660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:02.381660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:02.381660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:02.381660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:02.381660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 05 14:15:02.381660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:02.381660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 290/581] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:15:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:02.381660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f0b0c-ca2a-4918-8766-cf79922ed3f9 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:02.400834 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c16b9-3243-49db-8db3-64815568a5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:02.401490 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c16b9-3243-49db-8db3-64815568a5d9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:02.401772 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c16b9-3243-49db-8db3-64815568a5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:02.402048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c16b9-3243-49db-8db3-64815568a5d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:02.408611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c16b9-3243-49db-8db3-64815568a5d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:02.410072 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c16b9-3243-49db-8db3-64815568a5d9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:02.421686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-530c16b9-3243-49db-8db3-64815568a5d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:02.421686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:02.421686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:02.421686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:02.421686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:02.421686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:02.421686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:02.421686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:02.421686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:02.421686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:02.421686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:02.421686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:02.421686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:02.421686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:02.421686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:02.422778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:02.422778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:02.422778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:02.422778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:02.422778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:02.422778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:02.422778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:02.422778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:02.422778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:02.422778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:02.422778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:02.422778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:02.422778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:02.422778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:02.422778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:02.422778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:02.422778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:02.423674 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:02.423674 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:02.423674 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:02.423674 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:02.423674 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:02.423674 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:02.423674 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:02.423674 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:02.423674 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 292/582] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:02.423674 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c16b9-3243-49db-8db3-64815568a5d9 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:02.468779 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:02.486753 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f0b0c-ca2a-4918-8766-cf79922ed3f9 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:02.524302 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de22b1-039f-4302-91ed-06a211a92560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:02.524840 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de22b1-039f-4302-91ed-06a211a92560 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:02.525985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de22b1-039f-4302-91ed-06a211a92560 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:02.526266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de22b1-039f-4302-91ed-06a211a92560 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:02.527004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de22b1-039f-4302-91ed-06a211a92560 None admin] RBAC: Adding query filter params (role.id=5351e6d174334a8eaf71e8d2b3c079a7, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=1ed60e9eecb94ef39c2f4a5e5f50d670) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:02.527311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de22b1-039f-4302-91ed-06a211a92560 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:02.528765 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de22b1-039f-4302-91ed-06a211a92560 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:02.531438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c16b9-3243-49db-8db3-64815568a5d9 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:02.534383 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 291/583] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:15:02 2022] GET /identity/v3/role_assignments?user.id=1ed60e9eecb94ef39c2f4a5e5f50d670&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=5351e6d174334a8eaf71e8d2b3c079a7 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:02.534911 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de22b1-039f-4302-91ed-06a211a92560 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:02.576786 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe5d94-10bf-4737-adaf-0f641bd6d75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:02.577443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe5d94-10bf-4737-adaf-0f641bd6d75c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:02.577719 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe5d94-10bf-4737-adaf-0f641bd6d75c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:02.577988 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe5d94-10bf-4737-adaf-0f641bd6d75c None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:02.578671 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe5d94-10bf-4737-adaf-0f641bd6d75c None admin] RBAC: Adding query filter params (name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:02.578977 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe5d94-10bf-4737-adaf-0f641bd6d75c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:02.580385 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe5d94-10bf-4737-adaf-0f641bd6d75c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:02.590535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 293/584] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 5 14:15:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:02.591405 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe5d94-10bf-4737-adaf-0f641bd6d75c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:02.609091 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:02.664323 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de22b1-039f-4302-91ed-06a211a92560 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:02.704693 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe5d94-10bf-4737-adaf-0f641bd6d75c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:02.714743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903850be-55e4-47f3-bba6-f2967a3b6945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:02.715365 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903850be-55e4-47f3-bba6-f2967a3b6945 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:02.715855 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903850be-55e4-47f3-bba6-f2967a3b6945 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:02.716420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903850be-55e4-47f3-bba6-f2967a3b6945 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:02.716915 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903850be-55e4-47f3-bba6-f2967a3b6945 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:02.717021 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:02.717267 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903850be-55e4-47f3-bba6-f2967a3b6945 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:02.719270 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903850be-55e4-47f3-bba6-f2967a3b6945 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:02.740733 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 292/585] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Sep 5 14:15:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:02.741631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903850be-55e4-47f3-bba6-f2967a3b6945 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:02.750945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525a477-1c39-4e92-b8ea-2898c2d1bb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:02.751889 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525a477-1c39-4e92-b8ea-2898c2d1bb93 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:02.752232 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525a477-1c39-4e92-b8ea-2898c2d1bb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:02.752506 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525a477-1c39-4e92-b8ea-2898c2d1bb93 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:02.753481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525a477-1c39-4e92-b8ea-2898c2d1bb93 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:02.753833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525a477-1c39-4e92-b8ea-2898c2d1bb93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:02.755924 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525a477-1c39-4e92-b8ea-2898c2d1bb93 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:02.779121 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 294/586] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Sep 5 14:15:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:02.779121 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525a477-1c39-4e92-b8ea-2898c2d1bb93 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:02.867988 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903850be-55e4-47f3-bba6-f2967a3b6945 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:02.884743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:02.916322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da9e15-d8a1-4435-80db-b673f5e70ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:02.917383 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da9e15-d8a1-4435-80db-b673f5e70ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:02.917995 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da9e15-d8a1-4435-80db-b673f5e70ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:02.918386 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da9e15-d8a1-4435-80db-b673f5e70ff0 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:02.919329 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da9e15-d8a1-4435-80db-b673f5e70ff0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:02.919641 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da9e15-d8a1-4435-80db-b673f5e70ff0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:02.921923 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da9e15-d8a1-4435-80db-b673f5e70ff0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:02.926628 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525a477-1c39-4e92-b8ea-2898c2d1bb93 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:02.936079 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 293/587] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:02.936887 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da9e15-d8a1-4435-80db-b673f5e70ff0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:02.979617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd3b96-58d5-4f14-9d80-ffda0316c92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:02.980263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd3b96-58d5-4f14-9d80-ffda0316c92b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:02.980545 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd3b96-58d5-4f14-9d80-ffda0316c92b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:02.980824 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd3b96-58d5-4f14-9d80-ffda0316c92b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:02.992732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd3b96-58d5-4f14-9d80-ffda0316c92b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:02.994995 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd3b96-58d5-4f14-9d80-ffda0316c92b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:03.015599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-ccfd3b96-58d5-4f14-9d80-ffda0316c92b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:03.015599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:03.015599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:03.015599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:03.015599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:03.015599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:03.015599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:03.015599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:03.015599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:03.015599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:03.015599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:03.015599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:03.015599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:03.015599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:03.015599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:03.015599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:03.016607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:03.016607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:03.016607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:03.016607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:03.016607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:03.016607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:03.016607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:03.016607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:03.016607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:03.016607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:03.016607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:03.016607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:03.016607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:03.016607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:03.016607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:03.016607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:03.016607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:03.017524 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:03.017524 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:03.017524 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:03.021364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 295/588] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:03.022602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd3b96-58d5-4f14-9d80-ffda0316c92b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:03.051272 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:03.068776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da9e15-d8a1-4435-80db-b673f5e70ff0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:03.116124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49618eff-6c46-4749-87ae-3105631402f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:03.117955 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49618eff-6c46-4749-87ae-3105631402f9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:03.118234 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49618eff-6c46-4749-87ae-3105631402f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:03.118518 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49618eff-6c46-4749-87ae-3105631402f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:03.132245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49618eff-6c46-4749-87ae-3105631402f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:03.134014 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49618eff-6c46-4749-87ae-3105631402f9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:03.150012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-49618eff-6c46-4749-87ae-3105631402f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:03.150012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:03.150012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:03.150012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:03.150012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:03.150012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:03.150012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:03.150012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:03.150012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:03.150012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:03.150012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:03.150012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:03.150012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:03.150012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:03.150012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:03.150012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:03.151182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:03.151182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:03.151182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:03.151182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:03.151182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:03.151182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:03.151182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:03.151182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:03.151182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:03.151182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:03.151182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:03.151182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:03.151182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:03.151182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:03.151182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:03.151182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:03.151182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:03.152191 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:03.152191 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:03.152191 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:03.152365 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 294/589] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:03.154263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49618eff-6c46-4749-87ae-3105631402f9 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:03.167461 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd3b96-58d5-4f14-9d80-ffda0316c92b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:03.185317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:03.215345 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc87fe4-c87d-4fd3-aa8d-f1889bac7ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:03.217660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc87fe4-c87d-4fd3-aa8d-f1889bac7ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:03.217947 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc87fe4-c87d-4fd3-aa8d-f1889bac7ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:03.218225 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc87fe4-c87d-4fd3-aa8d-f1889bac7ba2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:03.231294 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc87fe4-c87d-4fd3-aa8d-f1889bac7ba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:03.232849 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc87fe4-c87d-4fd3-aa8d-f1889bac7ba2 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:03.250195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-8bc87fe4-c87d-4fd3-aa8d-f1889bac7ba2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:03.250195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:03.250195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:03.250195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:03.250195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:03.250195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:03.250195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:03.250195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:03.250195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:03.250195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:03.250195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:03.250195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:03.250195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:03.250195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:03.250195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:03.250195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:03.251204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:03.251204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:03.251204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:03.251204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:03.251204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:03.251204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:03.251204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:03.251204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:03.251204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:03.251204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:03.251204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:03.251204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:03.251204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:03.251204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:03.251204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:03.251204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:03.251204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:03.253692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:03.253692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:03.253692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:03.253692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 296/590] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:03.253692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc87fe4-c87d-4fd3-aa8d-f1889bac7ba2 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:03.295320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49618eff-6c46-4749-87ae-3105631402f9 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:03.333272 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dec6ff-ea48-4373-8bf5-6a76ae5a14b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:03.333845 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dec6ff-ea48-4373-8bf5-6a76ae5a14b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:03.334125 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dec6ff-ea48-4373-8bf5-6a76ae5a14b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:03.334397 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dec6ff-ea48-4373-8bf5-6a76ae5a14b9 None admin] PATH_INFO: `/v3/projects/975f49bcc95643fe876cc03d0d731423/users/d5515accf3b64006bc41422265a641bc/roles/5351e6d174334a8eaf71e8d2b3c079a7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:03.346008 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:03.354952 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dec6ff-ea48-4373-8bf5-6a76ae5a14b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=975f49bcc95643fe876cc03d0d731423, user_id=d5515accf3b64006bc41422265a641bc, role_id=5351e6d174334a8eaf71e8d2b3c079a7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:03.356518 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dec6ff-ea48-4373-8bf5-6a76ae5a14b9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:03.379427 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc87fe4-c87d-4fd3-aa8d-f1889bac7ba2 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:03.421417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d20f1b-b946-462a-abb2-ffd217086fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:03.422032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d20f1b-b946-462a-abb2-ffd217086fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:03.422351 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d20f1b-b946-462a-abb2-ffd217086fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:03.422621 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d20f1b-b946-462a-abb2-ffd217086fb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:03.423262 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d20f1b-b946-462a-abb2-ffd217086fb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:03.423562 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d20f1b-b946-462a-abb2-ffd217086fb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:03.424936 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d20f1b-b946-462a-abb2-ffd217086fb2 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:03.446270 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 297/591] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:03.447291 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d20f1b-b946-462a-abb2-ffd217086fb2 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:03.458316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 295/592] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:15:03 2022] PUT /identity/v3/projects/975f49bcc95643fe876cc03d0d731423/users/d5515accf3b64006bc41422265a641bc/roles/5351e6d174334a8eaf71e8d2b3c079a7 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:15:03.470114 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dec6ff-ea48-4373-8bf5-6a76ae5a14b9 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:03.593264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:03.596267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d20f1b-b946-462a-abb2-ffd217086fb2 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:03.643546 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:03.648977 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dec6ff-ea48-4373-8bf5-6a76ae5a14b9 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:03.652089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a38f5-cecc-48e7-9665-b7a7ade5fdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:03.652850 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a38f5-cecc-48e7-9665-b7a7ade5fdbd None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:03.654199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a38f5-cecc-48e7-9665-b7a7ade5fdbd None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:03.654199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a38f5-cecc-48e7-9665-b7a7ade5fdbd None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:03.654525 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a38f5-cecc-48e7-9665-b7a7ade5fdbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:03.654922 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a38f5-cecc-48e7-9665-b7a7ade5fdbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:03.656810 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a38f5-cecc-48e7-9665-b7a7ade5fdbd None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:03.679444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 298/593] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:03.679444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a38f5-cecc-48e7-9665-b7a7ade5fdbd None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:03.708468 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d596b-317c-4929-98c6-433ed4db3e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:03.709799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d596b-317c-4929-98c6-433ed4db3e22 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:03.710233 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d596b-317c-4929-98c6-433ed4db3e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:03.712698 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d596b-317c-4929-98c6-433ed4db3e22 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:03.713768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d596b-317c-4929-98c6-433ed4db3e22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:03.714252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d596b-317c-4929-98c6-433ed4db3e22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:03.716417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d596b-317c-4929-98c6-433ed4db3e22 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:03.733613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 296/594] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:03.734699 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d596b-317c-4929-98c6-433ed4db3e22 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:03.813467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a38f5-cecc-48e7-9665-b7a7ade5fdbd None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:03.854872 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1e0f7-e6d3-47f4-94fd-71530af382e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:03.855653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1e0f7-e6d3-47f4-94fd-71530af382e4 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:03.856027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1e0f7-e6d3-47f4-94fd-71530af382e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:03.857205 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1e0f7-e6d3-47f4-94fd-71530af382e4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:03.867615 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1e0f7-e6d3-47f4-94fd-71530af382e4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:03.869533 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1e0f7-e6d3-47f4-94fd-71530af382e4 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:03.882644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-f3e1e0f7-e6d3-47f4-94fd-71530af382e4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 14:15:03.882644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:03.882644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:03.882644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:03.882644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:03.882644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:03.882644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:03.882644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:03.882644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:03.882644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:03.882644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:03.882644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:03.882644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:03.882644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:03.882644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:03.882644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:03.883630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:03.883630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:03.883630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:03.883630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:03.883630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:03.883630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:03.883630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:03.883630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:03.883630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:03.883630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:03.883630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:03.883630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:03.883630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:03.883630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:03.883630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:03.883630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:03.883630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:03.883630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:03.885238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:03.885238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:03.885238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:03.885238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:03.885238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:03.885238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:03.885238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:03.885238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:03.885238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 14:15:03.885238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:03.886585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d596b-317c-4929-98c6-433ed4db3e22 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:03.892258 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 299/595] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:15:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:03.893318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1e0f7-e6d3-47f4-94fd-71530af382e4 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:03.918998 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:03.925006 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a736ae7-dc6e-4856-ac72-21d4f838579b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:03.926205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a736ae7-dc6e-4856-ac72-21d4f838579b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:03.926392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a736ae7-dc6e-4856-ac72-21d4f838579b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:03.933252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a736ae7-dc6e-4856-ac72-21d4f838579b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:03.935059 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a736ae7-dc6e-4856-ac72-21d4f838579b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:03.936649 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a736ae7-dc6e-4856-ac72-21d4f838579b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:03.949350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:03.952504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-7a736ae7-dc6e-4856-ac72-21d4f838579b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:03.952504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:03.952504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:03.952504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:03.952504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:03.952504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:03.952504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:03.952504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:03.952504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:03.952504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:03.952504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:03.952504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:03.952504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:03.952504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:03.952504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:03.953411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:03.953411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:03.953411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:03.953411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:03.953411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:03.953411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:03.953411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:03.953411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:03.953411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:03.953411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:03.953411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:03.953411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:03.953411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:03.953411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:03.953411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:03.953411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:03.953411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:03.954343 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:03.954343 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:03.954343 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:03.954343 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:03.954343 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:03.954343 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:03.954343 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:03.954343 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:03.958667 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 297/596] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:03.959657 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a736ae7-dc6e-4856-ac72-21d4f838579b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:04.012738 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1e0f7-e6d3-47f4-94fd-71530af382e4 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:04.066510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94bf24-ee25-445a-a400-e8869a229178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:04.067860 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94bf24-ee25-445a-a400-e8869a229178 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:04.068430 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94bf24-ee25-445a-a400-e8869a229178 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:04.069246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94bf24-ee25-445a-a400-e8869a229178 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:04.079477 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94bf24-ee25-445a-a400-e8869a229178 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:04.081240 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94bf24-ee25-445a-a400-e8869a229178 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:04.081570 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a736ae7-dc6e-4856-ac72-21d4f838579b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:04.093914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-ac94bf24-ee25-445a-a400-e8869a229178 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:04.093914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:04.093914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:04.093914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:04.093914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:04.093914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:04.093914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:04.093914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:04.093914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:04.093914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:04.093914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:04.093914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:04.093914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:04.093914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:04.093914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:04.094844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:04.094844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:04.094844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:04.094844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:04.094844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:04.094844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:04.094844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:04.094844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:04.094844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:04.094844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:04.094844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:04.094844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:04.094844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:04.094844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:04.094844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:04.094844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:04.094844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:04.095818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:04.095818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:04.095818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:04.095818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:04.095818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:04.095818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:04.095818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:04.095818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:04.098324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 300/597] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:04.099532 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94bf24-ee25-445a-a400-e8869a229178 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:04.131796 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a9902-45bb-4916-9303-169a99dbc435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:04.132714 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a9902-45bb-4916-9303-169a99dbc435 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:04.133216 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a9902-45bb-4916-9303-169a99dbc435 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:04.133665 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a9902-45bb-4916-9303-169a99dbc435 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:04.134633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a9902-45bb-4916-9303-169a99dbc435 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:04.135133 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a9902-45bb-4916-9303-169a99dbc435 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:04.136865 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a9902-45bb-4916-9303-169a99dbc435 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:04.160323 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 298/598] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Sep 5 14:15:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:04.161689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a9902-45bb-4916-9303-169a99dbc435 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:04.229905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:04.258940 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94bf24-ee25-445a-a400-e8869a229178 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:04.272560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:04.297962 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37398e00-0631-4f23-a4c6-81ce1972625f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:04.298910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a9902-45bb-4916-9303-169a99dbc435 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:04.299112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37398e00-0631-4f23-a4c6-81ce1972625f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:04.299594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37398e00-0631-4f23-a4c6-81ce1972625f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:04.300085 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37398e00-0631-4f23-a4c6-81ce1972625f None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:04.301420 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37398e00-0631-4f23-a4c6-81ce1972625f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:04.301942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37398e00-0631-4f23-a4c6-81ce1972625f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:04.303898 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37398e00-0631-4f23-a4c6-81ce1972625f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:04.319372 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 301/599] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:04.320877 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37398e00-0631-4f23-a4c6-81ce1972625f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:04.348807 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42c471-d18f-4c88-9fc0-24d9505d75df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:04.349846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42c471-d18f-4c88-9fc0-24d9505d75df None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:04.350141 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42c471-d18f-4c88-9fc0-24d9505d75df None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:04.350417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42c471-d18f-4c88-9fc0-24d9505d75df None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:04.351252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42c471-d18f-4c88-9fc0-24d9505d75df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:04.351667 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42c471-d18f-4c88-9fc0-24d9505d75df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:04.354668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42c471-d18f-4c88-9fc0-24d9505d75df None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:04.370922 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 299/600] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:04.372162 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42c471-d18f-4c88-9fc0-24d9505d75df None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:04.436884 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37398e00-0631-4f23-a4c6-81ce1972625f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:04.478514 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0610e-858f-4109-8035-ecef224f8e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:04.479654 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0610e-858f-4109-8035-ecef224f8e8c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:04.480138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0610e-858f-4109-8035-ecef224f8e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:04.480708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0610e-858f-4109-8035-ecef224f8e8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:04.492182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0610e-858f-4109-8035-ecef224f8e8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:04.494199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0610e-858f-4109-8035-ecef224f8e8c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:04.507341 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42c471-d18f-4c88-9fc0-24d9505d75df None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:04.511534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-1fc0610e-858f-4109-8035-ecef224f8e8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:04.511534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:04.511534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:04.511534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:04.511534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:04.511534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:04.511534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:04.511534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:04.511534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:04.511534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:04.511534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:04.511534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:04.511534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:04.511534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:04.511534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:04.511534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:04.512465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:04.512465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:04.512465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:04.512465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:04.512465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:04.512465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:04.512465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:04.512465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:04.512465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:04.512465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:04.512465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:04.512465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:04.512465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:04.512465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:04.512465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:04.512465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:04.512465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:04.513439 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:04.513439 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:04.513439 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:04.520168 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:04.521075 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 302/601] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:04.522219 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0610e-858f-4109-8035-ecef224f8e8c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:04.550273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:04.551496 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca1d04-e823-4d51-88a8-d945276e22f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:04.552579 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca1d04-e823-4d51-88a8-d945276e22f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:04.552947 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca1d04-e823-4d51-88a8-d945276e22f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:04.553272 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca1d04-e823-4d51-88a8-d945276e22f7 None admin] PATH_INFO: `/v3/projects/975f49bcc95643fe876cc03d0d731423/users/d7e1db2b6f70497ab535e0e9e86ec4ae/roles/5351e6d174334a8eaf71e8d2b3c079a7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:04.574370 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca1d04-e823-4d51-88a8-d945276e22f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=975f49bcc95643fe876cc03d0d731423, user_id=d7e1db2b6f70497ab535e0e9e86ec4ae, role_id=5351e6d174334a8eaf71e8d2b3c079a7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:04.576426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca1d04-e823-4d51-88a8-d945276e22f7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:04.638579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0610e-858f-4109-8035-ecef224f8e8c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:04.669619 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 300/602] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:15:04 2022] PUT /identity/v3/projects/975f49bcc95643fe876cc03d0d731423/users/d7e1db2b6f70497ab535e0e9e86ec4ae/roles/5351e6d174334a8eaf71e8d2b3c079a7 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:15:04.670654 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca1d04-e823-4d51-88a8-d945276e22f7 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:04.676652 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848f4eb-1e1c-48e2-be4a-3306788f0872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:04.677368 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848f4eb-1e1c-48e2-be4a-3306788f0872 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:04.677647 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848f4eb-1e1c-48e2-be4a-3306788f0872 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:04.677918 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848f4eb-1e1c-48e2-be4a-3306788f0872 None admin] PATH_INFO: `/v3/projects/975f49bcc95643fe876cc03d0d731423/users/1a7e9f0daa1c48eca87d92ced265afdb/roles/5351e6d174334a8eaf71e8d2b3c079a7` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:04.694479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848f4eb-1e1c-48e2-be4a-3306788f0872 None admin] RBAC: Authorizing `identity:create_grant(project_id=975f49bcc95643fe876cc03d0d731423, user_id=1a7e9f0daa1c48eca87d92ced265afdb, role_id=5351e6d174334a8eaf71e8d2b3c079a7)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:04.695874 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848f4eb-1e1c-48e2-be4a-3306788f0872 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:04.797719 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 303/603] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:15:04 2022] PUT /identity/v3/projects/975f49bcc95643fe876cc03d0d731423/users/1a7e9f0daa1c48eca87d92ced265afdb/roles/5351e6d174334a8eaf71e8d2b3c079a7 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:15:04.799385 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db12a8-dad5-45fe-a1e3-6729aba608d0 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:04.799692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db12a8-dad5-45fe-a1e3-6729aba608d0 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:04.800548 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db12a8-dad5-45fe-a1e3-6729aba608d0 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:04.812986 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 304/604] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:04.812986 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a643a-8cd5-4df0-a51d-ff9afcdcc898 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:04.812986 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a643a-8cd5-4df0-a51d-ff9afcdcc898 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:04.812986 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a643a-8cd5-4df0-a51d-ff9afcdcc898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:04.820012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca1d04-e823-4d51-88a8-d945276e22f7 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:04.834655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-9a7a643a-8cd5-4df0-a51d-ff9afcdcc898 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:04.838939 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9a7a643a-8cd5-4df0-a51d-ff9afcdcc898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:04.860833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab5e6a-c722-41fc-81c3-1cdef0198503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:04.861497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab5e6a-c722-41fc-81c3-1cdef0198503 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:04.861774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab5e6a-c722-41fc-81c3-1cdef0198503 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:04.862044 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab5e6a-c722-41fc-81c3-1cdef0198503 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:04.862688 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab5e6a-c722-41fc-81c3-1cdef0198503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:04.862991 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab5e6a-c722-41fc-81c3-1cdef0198503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:04.864488 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab5e6a-c722-41fc-81c3-1cdef0198503 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:04.877794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 301/605] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:04.883487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab5e6a-c722-41fc-81c3-1cdef0198503 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:04.913325 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:04.934866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 305/606] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:15:05.008425 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab5e6a-c722-41fc-81c3-1cdef0198503 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:05.044570 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadbbbd-b486-4063-9b65-9217ef459efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:05.045274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadbbbd-b486-4063-9b65-9217ef459efe None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:05.045561 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadbbbd-b486-4063-9b65-9217ef459efe None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:05.045830 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadbbbd-b486-4063-9b65-9217ef459efe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:05.052961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fadbbbd-b486-4063-9b65-9217ef459efe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:05.054439 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fadbbbd-b486-4063-9b65-9217ef459efe None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:05.066357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-0fadbbbd-b486-4063-9b65-9217ef459efe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:05.066357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:05.066357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:05.066357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:05.066357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:05.066357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:05.066357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:05.066357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:05.066357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:05.066357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:05.066357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:05.066357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:05.066357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:05.066357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:05.066357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:05.067286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:05.067286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:05.067286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:05.067286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:05.067286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:05.067286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:05.067286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:05.067286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:05.067286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:05.067286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:05.067286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:05.067286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:05.067286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:05.067286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:05.067286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:05.067286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:05.067286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:05.068171 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:05.068171 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:05.068171 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:05.068171 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:05.068171 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:05.068171 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:05.068171 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:05.068171 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:05.068171 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 302/607] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:05.073387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a643a-8cd5-4df0-a51d-ff9afcdcc898 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:05.075891 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:05.178698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a643a-8cd5-4df0-a51d-ff9afcdcc898 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:05.218053 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bd5a1-5e93-4bff-8064-e0044a1c88fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:05.218672 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bd5a1-5e93-4bff-8064-e0044a1c88fd None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:05.218953 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bd5a1-5e93-4bff-8064-e0044a1c88fd None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:05.219227 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bd5a1-5e93-4bff-8064-e0044a1c88fd None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:05.219925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bd5a1-5e93-4bff-8064-e0044a1c88fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:05.220229 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bd5a1-5e93-4bff-8064-e0044a1c88fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:05.221713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bd5a1-5e93-4bff-8064-e0044a1c88fd None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:05.234900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 306/608] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:05.242949 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadbbbd-b486-4063-9b65-9217ef459efe None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:05.312414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bd5a1-5e93-4bff-8064-e0044a1c88fd None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:05.365438 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:05.379075 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:05.399863 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadbbbd-b486-4063-9b65-9217ef459efe None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:05.425203 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bd5a1-5e93-4bff-8064-e0044a1c88fd None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:05.453371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec94bd-a05a-48ae-bd21-1f68ec03b1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:05.454352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec94bd-a05a-48ae-bd21-1f68ec03b1f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:05.454828 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec94bd-a05a-48ae-bd21-1f68ec03b1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:05.455274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec94bd-a05a-48ae-bd21-1f68ec03b1f6 None admin] PATH_INFO: `/v3/projects/975f49bcc95643fe876cc03d0d731423/users/b0ec118e5a114429b3e1c91041f7caf6/roles/5351e6d174334a8eaf71e8d2b3c079a7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:05.461566 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ab270-6c77-4d3a-a0ad-0ec06c0a0d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:05.462267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ab270-6c77-4d3a-a0ad-0ec06c0a0d87 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:05.462631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ab270-6c77-4d3a-a0ad-0ec06c0a0d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:05.462906 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ab270-6c77-4d3a-a0ad-0ec06c0a0d87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:05.473403 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec94bd-a05a-48ae-bd21-1f68ec03b1f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=975f49bcc95643fe876cc03d0d731423, user_id=b0ec118e5a114429b3e1c91041f7caf6, role_id=5351e6d174334a8eaf71e8d2b3c079a7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:05.474087 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ab270-6c77-4d3a-a0ad-0ec06c0a0d87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:15:05.475401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec94bd-a05a-48ae-bd21-1f68ec03b1f6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:05.480655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-d93ab270-6c77-4d3a-a0ad-0ec06c0a0d87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:05.480655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:05.480655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:05.480655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:05.480655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:05.480655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:05.480655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:05.480655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:05.480655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:05.480655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:05.480655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:05.480655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:05.480655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:15:05.480655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:15:05.480655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:15:05.480655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:15:05.481640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:15:05.481640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:15:05.481640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:15:05.481640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:15:05.481640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:05.481640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:05.481640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:05.481640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:05.481640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:05.481640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:05.481640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:05.481640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:05.481640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:05.481640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:05.481640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:05.481640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:05.482450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:05.482450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:05.482450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:05.482450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:05.482450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:15:05.482450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:15:05.482450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:15:05.482450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:15:05.482450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:15:05.482450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:15:05.482450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:05.482450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:05.482450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 307/609] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:15:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:05.492506 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ab270-6c77-4d3a-a0ad-0ec06c0a0d87 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:05.549819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 303/610] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:15:05 2022] PUT /identity/v3/projects/975f49bcc95643fe876cc03d0d731423/users/b0ec118e5a114429b3e1c91041f7caf6/roles/5351e6d174334a8eaf71e8d2b3c079a7 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:15:05.632226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ab270-6c77-4d3a-a0ad-0ec06c0a0d87 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:05.654546 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30130929-a637-4321-bc52-f92cd77def8f None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:05.654867 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30130929-a637-4321-bc52-f92cd77def8f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:05.655113 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30130929-a637-4321-bc52-f92cd77def8f None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:05.656715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 304/611] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:15:05.663362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ced5c6-1e0f-422a-bc27-2080e5b27bbf None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:05.663362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ced5c6-1e0f-422a-bc27-2080e5b27bbf None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:05.663362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ced5c6-1e0f-422a-bc27-2080e5b27bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:05.669380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:05.682380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f3ced5c6-1e0f-422a-bc27-2080e5b27bbf None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:05.683655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f3ced5c6-1e0f-422a-bc27-2080e5b27bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:05.686425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d539c5-0fda-4e58-91e9-59e3b19048b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:05.687965 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d539c5-0fda-4e58-91e9-59e3b19048b0 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:05.693010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d539c5-0fda-4e58-91e9-59e3b19048b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:05.693010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d539c5-0fda-4e58-91e9-59e3b19048b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:05.693010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d539c5-0fda-4e58-91e9-59e3b19048b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:05.693010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d539c5-0fda-4e58-91e9-59e3b19048b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:05.693010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d539c5-0fda-4e58-91e9-59e3b19048b0 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:05.711420 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 308/612] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 5 14:15:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:05.719225 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d539c5-0fda-4e58-91e9-59e3b19048b0 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:05.836743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 305/613] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:15:05.842051 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d539c5-0fda-4e58-91e9-59e3b19048b0 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:05.877256 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1109657-31d2-4563-8e3e-c23918dc7003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:05.878207 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1109657-31d2-4563-8e3e-c23918dc7003 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:05.878665 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1109657-31d2-4563-8e3e-c23918dc7003 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:05.879139 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1109657-31d2-4563-8e3e-c23918dc7003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:05.890442 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1109657-31d2-4563-8e3e-c23918dc7003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:05.892087 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1109657-31d2-4563-8e3e-c23918dc7003 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:05.906945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-c1109657-31d2-4563-8e3e-c23918dc7003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:05.906945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:05.906945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:05.906945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:05.906945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:05.906945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:05.906945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:05.906945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:05.906945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:05.906945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:05.906945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:05.906945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:05.906945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:05.906945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:05.906945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:05.906945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:05.908061 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:05.908061 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:05.908061 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:05.908061 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:05.908061 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:05.908061 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:05.908061 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:05.908061 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:05.908061 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:05.908061 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:05.908061 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:05.908061 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:05.908061 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:05.908061 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:05.908061 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:05.908061 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:05.908061 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:05.909183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:05.909183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:05.909183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:05.911113 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 309/614] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:05.917617 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ced5c6-1e0f-422a-bc27-2080e5b27bbf None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:06.013388 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:06.064943 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ced5c6-1e0f-422a-bc27-2080e5b27bbf None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:06.104990 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637a9bb-7a3e-4730-8a4e-991c8482594f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:06.105684 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637a9bb-7a3e-4730-8a4e-991c8482594f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:06.105970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637a9bb-7a3e-4730-8a4e-991c8482594f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:06.106246 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637a9bb-7a3e-4730-8a4e-991c8482594f None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:06.106897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637a9bb-7a3e-4730-8a4e-991c8482594f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:06.107204 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637a9bb-7a3e-4730-8a4e-991c8482594f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:06.108619 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637a9bb-7a3e-4730-8a4e-991c8482594f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:06.124168 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 306/615] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:06.129465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1109657-31d2-4563-8e3e-c23918dc7003 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:06.174935 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:06.230492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637a9bb-7a3e-4730-8a4e-991c8482594f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:06.286608 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1109657-31d2-4563-8e3e-c23918dc7003 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:06.354702 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c752de-edb6-4791-9a00-3fd8c061aa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:06.355340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c752de-edb6-4791-9a00-3fd8c061aa62 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:06.357945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c752de-edb6-4791-9a00-3fd8c061aa62 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:06.358314 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c752de-edb6-4791-9a00-3fd8c061aa62 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:06.371810 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c752de-edb6-4791-9a00-3fd8c061aa62 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:06.378085 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c752de-edb6-4791-9a00-3fd8c061aa62 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:06.395423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-52c752de-edb6-4791-9a00-3fd8c061aa62 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 14:15:06.395423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:06.395423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:06.395423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:06.395423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:06.395423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:06.395423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:06.395423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:06.395423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:06.395423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:06.395423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:06.395423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:06.395423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:06.395423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:06.395423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:06.395423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:06.400334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:06.400334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:06.400334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:06.400334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:06.400334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:06.400334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:06.400334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:06.400334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:06.400334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:06.400334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:06.400334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:06.400334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:06.400334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:06.400334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:06.400334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:06.400334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:06.400334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:06.400334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:06.401300 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:06.401300 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:06.401300 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:06.401300 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:06.401300 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:06.401300 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:06.401300 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:06.401300 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:06.401300 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 14:15:06.401300 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:06.401300 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 310/616] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:15:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:06.405407 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c752de-edb6-4791-9a00-3fd8c061aa62 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:06.449030 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637a9bb-7a3e-4730-8a4e-991c8482594f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:06.497530 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:06.509799 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:06.516450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c752de-edb6-4791-9a00-3fd8c061aa62 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:06.537797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af421076-d80f-4a8c-b4d6-e02309b55dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:06.538440 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af421076-d80f-4a8c-b4d6-e02309b55dcd None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:06.538717 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af421076-d80f-4a8c-b4d6-e02309b55dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:06.538996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af421076-d80f-4a8c-b4d6-e02309b55dcd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:06.554927 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96488ded-2fd9-4f94-804b-1b1fb181568d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:06.555892 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96488ded-2fd9-4f94-804b-1b1fb181568d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:06.557159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96488ded-2fd9-4f94-804b-1b1fb181568d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:06.557693 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96488ded-2fd9-4f94-804b-1b1fb181568d None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:06.558705 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96488ded-2fd9-4f94-804b-1b1fb181568d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:06.559212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96488ded-2fd9-4f94-804b-1b1fb181568d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:06.561017 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96488ded-2fd9-4f94-804b-1b1fb181568d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:06.569993 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af421076-d80f-4a8c-b4d6-e02309b55dcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:15:06.575371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-af421076-d80f-4a8c-b4d6-e02309b55dcd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:06.575371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:06.575371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:06.575371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:06.575371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:06.575371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:06.575371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:06.575371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:06.575371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:06.575371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:06.575371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:06.575371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:06.575371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:15:06.575371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:15:06.575371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:15:06.575371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:15:06.576332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:15:06.576332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:15:06.576332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:15:06.576332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:15:06.576332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:06.576332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:06.576332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:06.576332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:06.576332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:06.576332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:06.576332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:06.576332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:06.576332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:06.576332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:06.576332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:06.576332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:06.577352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:06.577352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:06.577352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:06.577352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:06.577352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:15:06.577352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:15:06.577352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:15:06.577352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:15:06.577352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:15:06.577352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:15:06.577352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:06.577352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:06.587810 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 307/618] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:15:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:06.587810 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af421076-d80f-4a8c-b4d6-e02309b55dcd None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:06.588385 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 311/618] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Sep 5 14:15:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:06.590956 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96488ded-2fd9-4f94-804b-1b1fb181568d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:06.699137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96488ded-2fd9-4f94-804b-1b1fb181568d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:06.736074 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed0beb-c801-4baf-ba71-0ac28422a21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:06.737105 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed0beb-c801-4baf-ba71-0ac28422a21e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:06.737611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed0beb-c801-4baf-ba71-0ac28422a21e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:06.738086 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed0beb-c801-4baf-ba71-0ac28422a21e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:06.748979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed0beb-c801-4baf-ba71-0ac28422a21e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:06.750748 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed0beb-c801-4baf-ba71-0ac28422a21e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:06.766890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-89ed0beb-c801-4baf-ba71-0ac28422a21e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:06.766890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:06.766890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:06.766890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:06.766890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:06.766890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:06.766890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:06.766890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:06.766890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:06.766890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:06.766890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:06.766890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:06.766890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:06.766890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:06.766890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:06.766890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:06.767870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:06.767870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:06.767870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:06.767870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:06.767870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:06.767870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:06.767870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:06.767870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:06.767870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:06.767870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:06.767870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:06.767870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:06.767870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:06.767870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:06.767870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:06.767870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:06.767870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:06.768762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:06.768762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:06.768762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:06.775292 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 312/619] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:06.776783 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed0beb-c801-4baf-ba71-0ac28422a21e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:06.786236 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:06.843201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af421076-d80f-4a8c-b4d6-e02309b55dcd None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:06.885640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed0beb-c801-4baf-ba71-0ac28422a21e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:06.922272 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c1cf3-8b32-44aa-8cd6-f4fe24fbc857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:06.923278 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c1cf3-8b32-44aa-8cd6-f4fe24fbc857 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:06.923759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c1cf3-8b32-44aa-8cd6-f4fe24fbc857 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:06.924283 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c1cf3-8b32-44aa-8cd6-f4fe24fbc857 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:06.925144 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c1cf3-8b32-44aa-8cd6-f4fe24fbc857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:06.925647 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c1cf3-8b32-44aa-8cd6-f4fe24fbc857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:06.927496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c1cf3-8b32-44aa-8cd6-f4fe24fbc857 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:06.931696 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260a6d0-05be-45b2-a47b-00712facd5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:06.932328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260a6d0-05be-45b2-a47b-00712facd5ea None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:06.932787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260a6d0-05be-45b2-a47b-00712facd5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:06.933081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260a6d0-05be-45b2-a47b-00712facd5ea None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:06.933746 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260a6d0-05be-45b2-a47b-00712facd5ea None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:06.934047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260a6d0-05be-45b2-a47b-00712facd5ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:06.935420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260a6d0-05be-45b2-a47b-00712facd5ea None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:06.947453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 313/620] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:06.949000 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c1cf3-8b32-44aa-8cd6-f4fe24fbc857 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:06.956320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 308/621] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 5 14:15:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:06.961583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260a6d0-05be-45b2-a47b-00712facd5ea None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:07.019254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:07.057865 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c1cf3-8b32-44aa-8cd6-f4fe24fbc857 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:07.065412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:07.102612 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ff7c5-c166-4efc-a029-0e6d48634318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:07.104428 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ff7c5-c166-4efc-a029-0e6d48634318 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:07.104428 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ff7c5-c166-4efc-a029-0e6d48634318 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:07.104428 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ff7c5-c166-4efc-a029-0e6d48634318 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:07.113075 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ff7c5-c166-4efc-a029-0e6d48634318 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:07.114682 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ff7c5-c166-4efc-a029-0e6d48634318 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:07.128599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-db8ff7c5-c166-4efc-a029-0e6d48634318 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:07.128599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:07.128599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:07.128599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:07.128599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:07.128599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:07.128599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:07.128599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:07.128599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:07.128599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:07.128599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:07.128599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:07.128599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:07.128599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:07.128599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:07.129571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:07.129571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:07.129571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:07.129571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:07.129571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:07.129571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:07.129571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:07.129571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:07.129571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:07.129571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:07.129571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:07.129571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:07.129571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:07.129571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:07.129571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:07.129571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:07.129571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:07.130453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:07.130453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:07.130453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:07.130453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:07.130453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:07.130453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:07.130453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:07.130453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:07.133135 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 314/622] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:07.135368 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0443e1-1507-4bac-96d7-4a4483809a82 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:07.136777 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0443e1-1507-4bac-96d7-4a4483809a82 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:07.137098 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0443e1-1507-4bac-96d7-4a4483809a82 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:07.138610 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 315/623] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:07.139308 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0443e1-1507-4bac-96d7-4a4483809a82 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:07.173076 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260a6d0-05be-45b2-a47b-00712facd5ea None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:07.215793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e713bf-93e7-47fd-8503-7b0aa4bf4f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:07.216348 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e713bf-93e7-47fd-8503-7b0aa4bf4f46 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:07.216625 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e713bf-93e7-47fd-8503-7b0aa4bf4f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:07.216896 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e713bf-93e7-47fd-8503-7b0aa4bf4f46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:07.227843 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e713bf-93e7-47fd-8503-7b0aa4bf4f46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:07.229372 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e713bf-93e7-47fd-8503-7b0aa4bf4f46 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:07.245741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-a4e713bf-93e7-47fd-8503-7b0aa4bf4f46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:07.245741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:07.245741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:07.245741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:07.245741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:07.245741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:07.245741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:07.245741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:07.245741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:07.245741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:07.245741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:07.245741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:07.245741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:07.245741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:07.245741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:07.245741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:07.246916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:07.246916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:07.246916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:07.246916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:07.246916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:07.246916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:07.246916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:07.246916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:07.246916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:07.246916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:07.246916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:07.246916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:07.246916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:07.246916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:07.246916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:07.246916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:07.246916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:07.247863 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:07.247863 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:07.247863 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:07.247863 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 309/624] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:07.248292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96434c-7c1e-42a6-ac5a-5746dc16f913 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:07.248577 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96434c-7c1e-42a6-ac5a-5746dc16f913 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:07.248840 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96434c-7c1e-42a6-ac5a-5746dc16f913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:07.267051 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5f96434c-7c1e-42a6-ac5a-5746dc16f913 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:07.268269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5f96434c-7c1e-42a6-ac5a-5746dc16f913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:07.272446 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0443e1-1507-4bac-96d7-4a4483809a82 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:07.298709 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:07.309202 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b09df7-8459-4039-a543-a47581be20b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:07.318483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b09df7-8459-4039-a543-a47581be20b3 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:07.318483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b09df7-8459-4039-a543-a47581be20b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:07.318483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b09df7-8459-4039-a543-a47581be20b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:07.318483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b09df7-8459-4039-a543-a47581be20b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:07.318483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b09df7-8459-4039-a543-a47581be20b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:07.318483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b09df7-8459-4039-a543-a47581be20b3 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:07.331078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 316/625] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:07.331078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c5b41-f30e-4692-b521-17488b6e3dfe None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:07.331078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c5b41-f30e-4692-b521-17488b6e3dfe None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:07.331078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c5b41-f30e-4692-b521-17488b6e3dfe None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:07.331078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 317/626] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:07.333899 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c5b41-f30e-4692-b521-17488b6e3dfe None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:07.349464 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 310/627] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:15:07.349464 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96434c-7c1e-42a6-ac5a-5746dc16f913 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:07.383960 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:07.468258 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96434c-7c1e-42a6-ac5a-5746dc16f913 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:07.475299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c5b41-f30e-4692-b521-17488b6e3dfe None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:07.504714 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fb3a5-1b7e-4926-894f-117777306cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:07.505407 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fb3a5-1b7e-4926-894f-117777306cab None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:07.505682 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fb3a5-1b7e-4926-894f-117777306cab None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:07.505955 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fb3a5-1b7e-4926-894f-117777306cab None admin] PATH_INFO: `/v3/projects/975f49bcc95643fe876cc03d0d731423/users/1ed60e9eecb94ef39c2f4a5e5f50d670/roles/5351e6d174334a8eaf71e8d2b3c079a7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:07.522292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4fb3a5-1b7e-4926-894f-117777306cab None admin] RBAC: Authorizing `identity:create_grant(project_id=975f49bcc95643fe876cc03d0d731423, user_id=1ed60e9eecb94ef39c2f4a5e5f50d670, role_id=5351e6d174334a8eaf71e8d2b3c079a7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:07.523759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4fb3a5-1b7e-4926-894f-117777306cab None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:07.529188 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b95195-49c3-4902-96c6-f378eef05820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:07.529871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b95195-49c3-4902-96c6-f378eef05820 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:07.530216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b95195-49c3-4902-96c6-f378eef05820 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:07.530550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b95195-49c3-4902-96c6-f378eef05820 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:07.531257 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b95195-49c3-4902-96c6-f378eef05820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:07.531619 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b95195-49c3-4902-96c6-f378eef05820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:07.533090 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b95195-49c3-4902-96c6-f378eef05820 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:07.545511 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 318/628] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:07.546549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d11f8d-9cd9-4a80-a071-048d4c782fef None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:07.546896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d11f8d-9cd9-4a80-a071-048d4c782fef None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:07.547253 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d11f8d-9cd9-4a80-a071-048d4c782fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:07.565420 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d8d11f8d-9cd9-4a80-a071-048d4c782fef None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:07.566649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d8d11f8d-9cd9-4a80-a071-048d4c782fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:07.598067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 311/629] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:15:07 2022] PUT /identity/v3/projects/975f49bcc95643fe876cc03d0d731423/users/1ed60e9eecb94ef39c2f4a5e5f50d670/roles/5351e6d174334a8eaf71e8d2b3c079a7 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:15:07.599992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fb3a5-1b7e-4926-894f-117777306cab None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:07.615179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:07.661208 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 319/630] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:15:07.662519 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d11f8d-9cd9-4a80-a071-048d4c782fef None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:07.729687 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fb3a5-1b7e-4926-894f-117777306cab None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:07.741475 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:07.779519 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d11f8d-9cd9-4a80-a071-048d4c782fef None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:07.799062 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6246bfe-87c5-421e-b23c-3fed79100475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:07.799687 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6246bfe-87c5-421e-b23c-3fed79100475 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:07.799968 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6246bfe-87c5-421e-b23c-3fed79100475 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:07.800238 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6246bfe-87c5-421e-b23c-3fed79100475 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:07.809947 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6246bfe-87c5-421e-b23c-3fed79100475 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:07.811383 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6246bfe-87c5-421e-b23c-3fed79100475 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:07.821156 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8d9e2-672e-4c22-b6d7-5f041f7a4109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:07.822226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8d9e2-672e-4c22-b6d7-5f041f7a4109 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:07.822750 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8d9e2-672e-4c22-b6d7-5f041f7a4109 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:07.823225 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8d9e2-672e-4c22-b6d7-5f041f7a4109 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:07.823441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-e6246bfe-87c5-421e-b23c-3fed79100475 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 14:15:07.823441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:07.823441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:07.823441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:07.823441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:07.823441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:07.823441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:07.823441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:07.823441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:07.823441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:07.823441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:07.823441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:07.823441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:07.823441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:07.823441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:07.823441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:07.824322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:07.824322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:07.824322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:07.824322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:07.824322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:07.824322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:07.824322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:07.824322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:07.824322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:07.824322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:07.824322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:07.824322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:07.824322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:07.824322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:07.824322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:07.824322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:07.824322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:07.824322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:07.825905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:07.825905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:07.825905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:07.825905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:07.825905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:07.825905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:07.825905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:07.825905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:07.825905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 14:15:07.825905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:07.825905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 312/631] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 5 14:15:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:07.830425 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6246bfe-87c5-421e-b23c-3fed79100475 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:07.839565 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8d9e2-672e-4c22-b6d7-5f041f7a4109 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:15:07.844890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-e3d8d9e2-672e-4c22-b6d7-5f041f7a4109 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:07.844890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:07.844890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:07.844890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:07.844890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:07.844890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:07.844890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:07.844890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:07.844890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:07.844890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:07.844890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:07.844890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:07.844890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:15:07.844890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:15:07.844890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:15:07.844890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:15:07.845856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:15:07.845856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:15:07.845856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:15:07.845856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:15:07.845856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:07.845856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:07.845856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:07.845856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:07.845856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:07.845856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:07.845856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:07.845856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:07.845856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:07.845856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:07.845856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:07.845856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:07.846684 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:07.846684 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:07.846684 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:07.846684 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:07.846684 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:15:07.846684 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:15:07.846684 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:15:07.846684 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:15:07.846684 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:15:07.846684 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:15:07.846684 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:07.846684 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:07.849407 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 320/632] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:15:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:07.855607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8d9e2-672e-4c22-b6d7-5f041f7a4109 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:07.904296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:07.944726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6246bfe-87c5-421e-b23c-3fed79100475 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:07.983736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdebf98-ca79-4d90-a100-d1374d0c2720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:07.986877 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdebf98-ca79-4d90-a100-d1374d0c2720 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:07.987141 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdebf98-ca79-4d90-a100-d1374d0c2720 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:07.987407 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdebf98-ca79-4d90-a100-d1374d0c2720 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:07.988137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdebf98-ca79-4d90-a100-d1374d0c2720 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:07.988437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdebf98-ca79-4d90-a100-d1374d0c2720 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:07.989887 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdebf98-ca79-4d90-a100-d1374d0c2720 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:07.992687 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:08.011333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8d9e2-672e-4c22-b6d7-5f041f7a4109 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:08.022403 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 313/633] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 5 14:15:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:08.023185 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdebf98-ca79-4d90-a100-d1374d0c2720 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:08.063527 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab29a40-5745-4e7d-a930-ce2721e3a575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:08.064159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab29a40-5745-4e7d-a930-ce2721e3a575 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:08.064434 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab29a40-5745-4e7d-a930-ce2721e3a575 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:08.064703 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab29a40-5745-4e7d-a930-ce2721e3a575 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:08.065699 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab29a40-5745-4e7d-a930-ce2721e3a575 None admin] RBAC: Adding query filter params (name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:08.066884 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab29a40-5745-4e7d-a930-ce2721e3a575 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:08.068291 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab29a40-5745-4e7d-a930-ce2721e3a575 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:08.079050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 321/634] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 5 14:15:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:08.080362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab29a40-5745-4e7d-a930-ce2721e3a575 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:08.135811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdebf98-ca79-4d90-a100-d1374d0c2720 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:08.174200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94c6ce-900a-48d6-9d30-be00d6516d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:08.175178 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94c6ce-900a-48d6-9d30-be00d6516d90 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:08.175463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94c6ce-900a-48d6-9d30-be00d6516d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:08.175736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94c6ce-900a-48d6-9d30-be00d6516d90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:08.186190 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94c6ce-900a-48d6-9d30-be00d6516d90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:15:08.186921 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:08.191064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-bd94c6ce-900a-48d6-9d30-be00d6516d90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:08.191064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:08.191064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:08.191064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:08.191064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:08.191064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:08.191064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:08.191064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:08.191064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:08.191064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:08.191064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:08.191064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:08.191064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:15:08.191064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:15:08.191064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:15:08.191064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:15:08.191984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:15:08.191984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:15:08.191984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:15:08.191984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:15:08.191984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:08.191984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:08.191984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:08.191984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:08.191984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:08.191984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:08.191984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:08.191984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:08.191984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:08.191984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:08.191984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:08.191984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:08.192812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:08.192812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:08.192812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:08.192812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:08.192812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:15:08.192812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:15:08.192812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:15:08.192812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:15:08.192812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:15:08.192812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:15:08.192812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:08.192812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:08.193478 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab29a40-5745-4e7d-a930-ce2721e3a575 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:08.193550 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 314/635] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:15:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:08.194211 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7062d-f77e-4b34-8e43-f21adc766e3f None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:08.194211 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7062d-f77e-4b34-8e43-f21adc766e3f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:08.194378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7062d-f77e-4b34-8e43-f21adc766e3f None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:08.203186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 315/636] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:08.203186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7062d-f77e-4b34-8e43-f21adc766e3f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:08.245212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c76d1c-996e-4f50-9e4b-7dd98fd9ce76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:08.245752 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c76d1c-996e-4f50-9e4b-7dd98fd9ce76 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:08.246026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c76d1c-996e-4f50-9e4b-7dd98fd9ce76 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:08.246295 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c76d1c-996e-4f50-9e4b-7dd98fd9ce76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:08.265738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:08.320120 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7062d-f77e-4b34-8e43-f21adc766e3f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:08.320763 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c76d1c-996e-4f50-9e4b-7dd98fd9ce76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:08.322646 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c76d1c-996e-4f50-9e4b-7dd98fd9ce76 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:08.355368 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5557ab-b9f1-4606-8fcb-6ad1b2969d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:08.356019 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5557ab-b9f1-4606-8fcb-6ad1b2969d9f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:08.356302 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5557ab-b9f1-4606-8fcb-6ad1b2969d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:08.356573 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5557ab-b9f1-4606-8fcb-6ad1b2969d9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:08.367622 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5557ab-b9f1-4606-8fcb-6ad1b2969d9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:08.369273 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5557ab-b9f1-4606-8fcb-6ad1b2969d9f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:08.383831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-3e5557ab-b9f1-4606-8fcb-6ad1b2969d9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:08.383831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:08.383831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:08.383831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:08.383831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:08.383831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:08.383831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:08.383831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:08.383831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:08.383831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:08.383831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:08.383831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:08.383831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:08.383831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:08.383831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:08.383831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:08.385693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:08.385693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:08.385693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:08.385693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:08.385693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:08.385693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:08.385693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:08.385693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:08.385693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:08.385693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:08.385693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:08.385693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:08.385693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:08.385693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:08.385693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:08.385693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:08.385693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:08.386605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:08.386605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:08.386605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:08.386605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 316/637] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:08.386605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5557ab-b9f1-4606-8fcb-6ad1b2969d9f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:08.432257 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:08.442072 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 322/638] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:15:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:15:08.442072 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eb16d-4f5d-47bd-80cd-a03102912ce5 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:08.442072 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eb16d-4f5d-47bd-80cd-a03102912ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:08.442072 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eb16d-4f5d-47bd-80cd-a03102912ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:08.457845 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-427eb16d-4f5d-47bd-80cd-a03102912ce5 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:08.459040 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-427eb16d-4f5d-47bd-80cd-a03102912ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:08.498513 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5557ab-b9f1-4606-8fcb-6ad1b2969d9f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:08.501617 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:08.530124 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 323/639] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:15:08.530872 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427eb16d-4f5d-47bd-80cd-a03102912ce5 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:08.544481 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ab97e-9556-48df-b68c-e7a13463bb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:08.545431 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ab97e-9556-48df-b68c-e7a13463bb65 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:08.546124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ab97e-9556-48df-b68c-e7a13463bb65 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:08.547016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ab97e-9556-48df-b68c-e7a13463bb65 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:08.548184 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ab97e-9556-48df-b68c-e7a13463bb65 None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:08.548715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ab97e-9556-48df-b68c-e7a13463bb65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:08.551224 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ab97e-9556-48df-b68c-e7a13463bb65 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:08.564110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 317/640] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 5 14:15:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:08.565592 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ab97e-9556-48df-b68c-e7a13463bb65 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:08.636668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427eb16d-4f5d-47bd-80cd-a03102912ce5 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:08.665749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:08.676323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b20624-51c3-4492-a456-a239a45a6d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:08.677480 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b20624-51c3-4492-a456-a239a45a6d43 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:08.678273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b20624-51c3-4492-a456-a239a45a6d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:08.678706 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b20624-51c3-4492-a456-a239a45a6d43 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:08.681727 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b20624-51c3-4492-a456-a239a45a6d43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:08.681727 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b20624-51c3-4492-a456-a239a45a6d43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:08.682194 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b20624-51c3-4492-a456-a239a45a6d43 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:08.696336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ab97e-9556-48df-b68c-e7a13463bb65 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:08.700408 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 324/641] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:08.700904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b20624-51c3-4492-a456-a239a45a6d43 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:08.742249 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f0799-f90f-4cac-ba7f-032c1244c929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:08.743192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f0799-f90f-4cac-ba7f-032c1244c929 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:08.744288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f0799-f90f-4cac-ba7f-032c1244c929 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:08.744701 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f0799-f90f-4cac-ba7f-032c1244c929 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:08.759264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f0799-f90f-4cac-ba7f-032c1244c929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:08.761485 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f0799-f90f-4cac-ba7f-032c1244c929 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:08.780321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-e29f0799-f90f-4cac-ba7f-032c1244c929 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:08.780321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:08.780321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:08.780321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:08.780321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:08.780321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:08.780321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:08.780321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:08.780321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:08.780321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:08.780321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:08.780321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:08.780321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:08.780321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:08.780321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:08.780321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:08.781345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:08.781345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:08.781345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:08.781345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:08.781345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:08.781345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:08.781345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:08.781345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:08.781345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:08.781345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:08.781345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:08.781345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:08.781345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:08.781345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:08.781345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:08.781345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:08.781345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:08.782205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:08.782205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:08.782205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:08.785428 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 318/642] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:08.786126 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f0799-f90f-4cac-ba7f-032c1244c929 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:08.809443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:08.819012 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b20624-51c3-4492-a456-a239a45a6d43 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:08.856709 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c7aa0-e1e2-41f7-bb74-b570b02284df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:08.857377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c7aa0-e1e2-41f7-bb74-b570b02284df None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:08.857659 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c7aa0-e1e2-41f7-bb74-b570b02284df None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:08.857930 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c7aa0-e1e2-41f7-bb74-b570b02284df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:08.869222 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c7aa0-e1e2-41f7-bb74-b570b02284df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:08.870701 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c7aa0-e1e2-41f7-bb74-b570b02284df None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:08.891299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-cf4c7aa0-e1e2-41f7-bb74-b570b02284df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:08.891299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:08.891299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:08.891299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:08.891299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:08.891299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:08.891299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:08.891299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:08.891299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:08.891299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:08.891299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:08.891299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:08.891299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:08.891299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:08.891299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:08.891299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:08.892387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:08.892387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:08.892387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:08.892387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:08.892387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:08.892387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:08.892387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:08.892387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:08.892387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:08.892387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:08.892387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:08.892387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:08.892387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:08.892387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:08.892387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:08.892387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:08.892387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:08.893304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:08.893304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:08.893304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:08.893304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 325/643] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:08.897784 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c7aa0-e1e2-41f7-bb74-b570b02284df None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:08.914567 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f0799-f90f-4cac-ba7f-032c1244c929 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:08.948268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:08.954005 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8060e5-a472-4a22-9198-3e76cdb1171a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:08.954416 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8060e5-a472-4a22-9198-3e76cdb1171a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:08.954647 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8060e5-a472-4a22-9198-3e76cdb1171a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:08.954879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8060e5-a472-4a22-9198-3e76cdb1171a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:08.962572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8060e5-a472-4a22-9198-3e76cdb1171a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:08.964041 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8060e5-a472-4a22-9198-3e76cdb1171a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:08.975553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-3d8060e5-a472-4a22-9198-3e76cdb1171a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 14:15:08.975553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:08.975553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:08.975553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:08.975553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:08.975553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:08.975553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:08.975553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:08.975553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:08.975553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:08.975553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:08.975553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:08.975553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:08.975553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:08.975553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:08.975553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:08.976514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:08.976514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:08.976514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:08.976514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:08.976514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:08.976514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:08.976514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:08.976514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:08.976514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:08.976514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:08.976514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:08.976514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:08.976514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:08.976514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:08.976514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:08.976514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:08.976514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:08.976514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:08.977551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:08.977551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:08.977551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:08.977551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:08.977551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:08.977551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:08.977551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:08.977551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:08.977551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 14:15:08.977551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:08.977551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 319/644] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:15:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:08.977551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8060e5-a472-4a22-9198-3e76cdb1171a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:09.017901 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c7aa0-e1e2-41f7-bb74-b570b02284df None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:09.054875 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf1092-49e9-47b7-844f-20d53a5d5bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:09.054875 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf1092-49e9-47b7-844f-20d53a5d5bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:09.055239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf1092-49e9-47b7-844f-20d53a5d5bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:09.055598 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf1092-49e9-47b7-844f-20d53a5d5bb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:09.056429 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf1092-49e9-47b7-844f-20d53a5d5bb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:09.056802 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf1092-49e9-47b7-844f-20d53a5d5bb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:09.058285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf1092-49e9-47b7-844f-20d53a5d5bb0 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:09.064663 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:09.071486 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 326/645] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:09.072825 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf1092-49e9-47b7-844f-20d53a5d5bb0 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:09.093084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8060e5-a472-4a22-9198-3e76cdb1171a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:09.128605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fd677-e791-4d30-9809-0c3ea93a6338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:09.129263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fd677-e791-4d30-9809-0c3ea93a6338 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:09.129550 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fd677-e791-4d30-9809-0c3ea93a6338 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:09.129829 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fd677-e791-4d30-9809-0c3ea93a6338 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:09.141846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fd677-e791-4d30-9809-0c3ea93a6338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:15:09.147531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-271fd677-e791-4d30-9809-0c3ea93a6338 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:09.147531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:09.147531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:09.147531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:09.147531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:09.147531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:09.147531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:09.147531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:09.147531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:09.147531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:09.147531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:09.147531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:09.147531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:15:09.147531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:15:09.147531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:15:09.147531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:15:09.148462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:15:09.148462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:15:09.148462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:15:09.148462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:15:09.148462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:09.148462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:09.148462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:09.148462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:09.148462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:09.148462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:09.148462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:09.148462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:09.148462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:09.148462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:09.148462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:09.148462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:09.149349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:09.149349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:09.149349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:09.149349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:09.149349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:15:09.149349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:15:09.149349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:15:09.149349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:15:09.149349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:15:09.149349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:15:09.149349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:09.149349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:09.149349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 320/646] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:15:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:09.150665 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fd677-e791-4d30-9809-0c3ea93a6338 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:09.182600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:09.185348 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf1092-49e9-47b7-844f-20d53a5d5bb0 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:09.220372 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed5442-7cbd-4229-9677-aae69091ae27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:09.220982 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed5442-7cbd-4229-9677-aae69091ae27 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:09.221287 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed5442-7cbd-4229-9677-aae69091ae27 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:09.221558 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed5442-7cbd-4229-9677-aae69091ae27 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:09.222204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed5442-7cbd-4229-9677-aae69091ae27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:09.222518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed5442-7cbd-4229-9677-aae69091ae27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:09.223864 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed5442-7cbd-4229-9677-aae69091ae27 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:09.241668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 327/647] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:09.241668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed5442-7cbd-4229-9677-aae69091ae27 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:09.276481 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fd677-e791-4d30-9809-0c3ea93a6338 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:09.314449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f1f8b-7d62-4b8c-96cf-8fa97ba9e472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:09.315226 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f1f8b-7d62-4b8c-96cf-8fa97ba9e472 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:09.315581 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f1f8b-7d62-4b8c-96cf-8fa97ba9e472 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:09.315917 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f1f8b-7d62-4b8c-96cf-8fa97ba9e472 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:09.316707 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f1f8b-7d62-4b8c-96cf-8fa97ba9e472 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:09.317098 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f1f8b-7d62-4b8c-96cf-8fa97ba9e472 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:09.318595 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f1f8b-7d62-4b8c-96cf-8fa97ba9e472 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:09.327285 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:09.338388 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 321/648] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Sep 5 14:15:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:09.344181 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f1f8b-7d62-4b8c-96cf-8fa97ba9e472 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:09.355455 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed5442-7cbd-4229-9677-aae69091ae27 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:09.391382 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c340e-67ee-472c-ab7a-7033d7a3ffd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:09.392023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c340e-67ee-472c-ab7a-7033d7a3ffd0 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:09.392302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c340e-67ee-472c-ab7a-7033d7a3ffd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:09.392575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c340e-67ee-472c-ab7a-7033d7a3ffd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:09.399273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c340e-67ee-472c-ab7a-7033d7a3ffd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:09.401272 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c340e-67ee-472c-ab7a-7033d7a3ffd0 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:09.412781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-ab6c340e-67ee-472c-ab7a-7033d7a3ffd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:09.412781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:09.412781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:09.412781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:09.412781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:09.412781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:09.412781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:09.412781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:09.412781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:09.412781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:09.412781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:09.412781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:09.412781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:09.412781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:09.412781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:09.413903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:09.413903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:09.413903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:09.413903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:09.413903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:09.413903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:09.413903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:09.413903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:09.413903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:09.413903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:09.413903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:09.413903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:09.413903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:09.413903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:09.413903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:09.413903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:09.413903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:09.415026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:09.415026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:09.415026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:09.415026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:09.415026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:09.415026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:09.415026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:09.415026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:09.415026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 328/649] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:09.416289 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c340e-67ee-472c-ab7a-7033d7a3ffd0 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:09.438530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:09.457538 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f1f8b-7d62-4b8c-96cf-8fa97ba9e472 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:09.494855 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852819d-d756-46c1-8c78-f4dc32c7a30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:09.495459 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852819d-d756-46c1-8c78-f4dc32c7a30f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:09.495734 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852819d-d756-46c1-8c78-f4dc32c7a30f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:09.496005 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852819d-d756-46c1-8c78-f4dc32c7a30f None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:09.496659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852819d-d756-46c1-8c78-f4dc32c7a30f None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:09.496960 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852819d-d756-46c1-8c78-f4dc32c7a30f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:09.498786 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852819d-d756-46c1-8c78-f4dc32c7a30f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:09.511116 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 322/650] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 5 14:15:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:09.511116 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852819d-d756-46c1-8c78-f4dc32c7a30f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:09.529813 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c340e-67ee-472c-ab7a-7033d7a3ffd0 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:09.567879 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e5b8d-4cc8-4b47-a769-9edb6648292f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:09.568587 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e5b8d-4cc8-4b47-a769-9edb6648292f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:09.568942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e5b8d-4cc8-4b47-a769-9edb6648292f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:09.569304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e5b8d-4cc8-4b47-a769-9edb6648292f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:09.573973 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:09.576644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e5b8d-4cc8-4b47-a769-9edb6648292f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:09.578202 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e5b8d-4cc8-4b47-a769-9edb6648292f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:09.590246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-6f6e5b8d-4cc8-4b47-a769-9edb6648292f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 05 14:15:09.590246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:09.590246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:09.590246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:09.590246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:09.590246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:09.590246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:09.590246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:09.590246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:09.590246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:09.590246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:09.590246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:09.590246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:09.590246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:09.590246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:09.590246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:09.592068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:09.592068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:09.592068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:09.592068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:09.592068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:09.592068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:09.592068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:09.592068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:09.592068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:09.592068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:09.592068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:09.592068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:09.592068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:09.592068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:09.592068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:09.592068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:09.592068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:09.592068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:09.597854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:09.597854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:09.597854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:09.597854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:09.597854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:09.597854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:09.597854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:09.597854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:09.597854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 05 14:15:09.597854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:09.597854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 329/651] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:15:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:09.597854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e5b8d-4cc8-4b47-a769-9edb6648292f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:09.631738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852819d-d756-46c1-8c78-f4dc32c7a30f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:09.670179 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb827a4-b296-4f0a-b83f-7593ac9c07a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:09.670892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb827a4-b296-4f0a-b83f-7593ac9c07a5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:09.671233 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb827a4-b296-4f0a-b83f-7593ac9c07a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:09.671612 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb827a4-b296-4f0a-b83f-7593ac9c07a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:09.682085 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:09.703629 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e5b8d-4cc8-4b47-a769-9edb6648292f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:09.742024 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3639148-b18a-41d2-bd8a-fb9597355041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:09.742636 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3639148-b18a-41d2-bd8a-fb9597355041 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:09.742742 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb827a4-b296-4f0a-b83f-7593ac9c07a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:09.742915 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3639148-b18a-41d2-bd8a-fb9597355041 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:09.743186 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3639148-b18a-41d2-bd8a-fb9597355041 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:09.744127 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3639148-b18a-41d2-bd8a-fb9597355041 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:09.744579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3639148-b18a-41d2-bd8a-fb9597355041 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:09.744692 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb827a4-b296-4f0a-b83f-7593ac9c07a5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:09.746055 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3639148-b18a-41d2-bd8a-fb9597355041 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:09.760320 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 330/652] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:09.761333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3639148-b18a-41d2-bd8a-fb9597355041 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:09.805128 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:09.848070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 323/653] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:15:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:15:09.848903 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb827a4-b296-4f0a-b83f-7593ac9c07a5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:09.861076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3639148-b18a-41d2-bd8a-fb9597355041 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:09.895081 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f14f08-8265-4b06-aea4-85615c60b7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:09.895704 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f14f08-8265-4b06-aea4-85615c60b7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:09.895982 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f14f08-8265-4b06-aea4-85615c60b7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:09.896252 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f14f08-8265-4b06-aea4-85615c60b7b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:09.905120 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:09.907622 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f14f08-8265-4b06-aea4-85615c60b7b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:09.909096 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f14f08-8265-4b06-aea4-85615c60b7b6 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:09.923358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-90f14f08-8265-4b06-aea4-85615c60b7b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:09.923358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:09.923358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:09.923358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:09.923358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:09.923358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:09.923358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:09.923358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:09.923358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:09.923358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:09.923358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:09.923358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:09.923358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:09.923358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:09.923358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:09.923358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:09.924561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:09.924561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:09.924561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:09.924561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:09.924561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:09.924561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:09.924561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:09.924561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:09.924561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:09.924561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:09.924561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:09.924561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:09.924561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:09.924561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:09.924561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:09.924561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:09.924561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:09.925494 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:09.925494 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:09.925494 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:09.925494 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 331/654] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:09.926327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753d1d1-0e7d-4081-91ae-aaedb0379e24 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:09.926636 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753d1d1-0e7d-4081-91ae-aaedb0379e24 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:09.926861 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753d1d1-0e7d-4081-91ae-aaedb0379e24 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:09.928088 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 332/655] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:09.928769 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753d1d1-0e7d-4081-91ae-aaedb0379e24 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:09.952676 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb827a4-b296-4f0a-b83f-7593ac9c07a5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:09.987206 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49675a-aca8-4d43-ae85-a13b880a6128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:09.987820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49675a-aca8-4d43-ae85-a13b880a6128 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:09.988071 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49675a-aca8-4d43-ae85-a13b880a6128 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:09.988344 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49675a-aca8-4d43-ae85-a13b880a6128 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:09.989084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49675a-aca8-4d43-ae85-a13b880a6128 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:09.989401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49675a-aca8-4d43-ae85-a13b880a6128 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:09.990839 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49675a-aca8-4d43-ae85-a13b880a6128 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:10.008239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 324/656] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Sep 5 14:15:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:10.009027 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49675a-aca8-4d43-ae85-a13b880a6128 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:10.026570 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:10.035976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753d1d1-0e7d-4081-91ae-aaedb0379e24 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:10.069502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f82f2-ad41-44ef-9eba-34cf2f0f71c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:10.070029 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f82f2-ad41-44ef-9eba-34cf2f0f71c8 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:10.070308 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f82f2-ad41-44ef-9eba-34cf2f0f71c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:10.070577 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f82f2-ad41-44ef-9eba-34cf2f0f71c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:10.071290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f82f2-ad41-44ef-9eba-34cf2f0f71c8 None admin] RBAC: Adding query filter params (role.id=5351e6d174334a8eaf71e8d2b3c079a7, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=d5515accf3b64006bc41422265a641bc) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:10.071631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f82f2-ad41-44ef-9eba-34cf2f0f71c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:10.073365 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f82f2-ad41-44ef-9eba-34cf2f0f71c8 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:10.079052 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 333/657] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:15:09 2022] GET /identity/v3/role_assignments?user.id=d5515accf3b64006bc41422265a641bc&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=5351e6d174334a8eaf71e8d2b3c079a7 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:10.079818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f82f2-ad41-44ef-9eba-34cf2f0f71c8 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:10.113932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49675a-aca8-4d43-ae85-a13b880a6128 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:10.149070 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:10.154232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028de47-e684-498a-b50e-3d6f5cce966b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:10.154889 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028de47-e684-498a-b50e-3d6f5cce966b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:10.155171 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028de47-e684-498a-b50e-3d6f5cce966b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:10.155446 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028de47-e684-498a-b50e-3d6f5cce966b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:10.166685 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028de47-e684-498a-b50e-3d6f5cce966b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:10.168146 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028de47-e684-498a-b50e-3d6f5cce966b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:10.185201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-5028de47-e684-498a-b50e-3d6f5cce966b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:10.185201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:10.185201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:10.185201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:10.185201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:10.185201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:10.185201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:10.185201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:10.185201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:10.185201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:10.185201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:10.185201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:10.185201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:10.185201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:10.185201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:10.185201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:10.186243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:10.186243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:10.186243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:10.186243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:10.186243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:10.186243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:10.186243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:10.186243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:10.186243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:10.186243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:10.186243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:10.186243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:10.186243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:10.186243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:10.186243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:10.186243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:10.186243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:10.187119 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:10.187119 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:10.187119 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:10.187119 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 325/658] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:10.187779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c90a0-ed54-4c19-b265-f8fbb5f736a8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:10.187877 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c90a0-ed54-4c19-b265-f8fbb5f736a8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:10.188089 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c90a0-ed54-4c19-b265-f8fbb5f736a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:10.207528 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a30c90a0-ed54-4c19-b265-f8fbb5f736a8 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:10.208760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a30c90a0-ed54-4c19-b265-f8fbb5f736a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:10.210011 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f82f2-ad41-44ef-9eba-34cf2f0f71c8 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:10.263515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d0533-6669-4903-8bc8-c54757a98224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:10.264129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d0533-6669-4903-8bc8-c54757a98224 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:10.264774 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d0533-6669-4903-8bc8-c54757a98224 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:10.265071 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d0533-6669-4903-8bc8-c54757a98224 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:10.265736 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d0533-6669-4903-8bc8-c54757a98224 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:10.266042 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d0533-6669-4903-8bc8-c54757a98224 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:10.267462 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d0533-6669-4903-8bc8-c54757a98224 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:10.280135 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 334/659] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:10.280967 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d0533-6669-4903-8bc8-c54757a98224 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:10.290191 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:10.297517 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 326/660] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:15:10.298395 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c90a0-ed54-4c19-b265-f8fbb5f736a8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:10.404098 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d0533-6669-4903-8bc8-c54757a98224 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:10.422404 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:10.436570 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c90a0-ed54-4c19-b265-f8fbb5f736a8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:10.441781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af94c9-003a-408f-b17d-cd04b8ce6037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:10.442515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af94c9-003a-408f-b17d-cd04b8ce6037 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:10.442859 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af94c9-003a-408f-b17d-cd04b8ce6037 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:10.443201 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af94c9-003a-408f-b17d-cd04b8ce6037 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:10.485611 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22294d23-3836-4e8f-a3da-adcf3511e61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:10.487052 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22294d23-3836-4e8f-a3da-adcf3511e61c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:10.487330 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22294d23-3836-4e8f-a3da-adcf3511e61c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:10.487602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22294d23-3836-4e8f-a3da-adcf3511e61c None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:10.488247 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22294d23-3836-4e8f-a3da-adcf3511e61c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:10.488551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22294d23-3836-4e8f-a3da-adcf3511e61c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:10.489945 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22294d23-3836-4e8f-a3da-adcf3511e61c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:10.505833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 327/661] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:10.506976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22294d23-3836-4e8f-a3da-adcf3511e61c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:10.523145 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af94c9-003a-408f-b17d-cd04b8ce6037 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:10.524817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af94c9-003a-408f-b17d-cd04b8ce6037 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:10.583153 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:10.630225 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 335/662] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:15:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:15:10.630458 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22294d23-3836-4e8f-a3da-adcf3511e61c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:10.631451 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af94c9-003a-408f-b17d-cd04b8ce6037 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:10.653619 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:10.670269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7495cdd-cf97-46a6-87ce-50a5e69a62ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:10.670857 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7495cdd-cf97-46a6-87ce-50a5e69a62ae None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:10.671136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7495cdd-cf97-46a6-87ce-50a5e69a62ae None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:10.671408 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7495cdd-cf97-46a6-87ce-50a5e69a62ae None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:10.679687 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7495cdd-cf97-46a6-87ce-50a5e69a62ae None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:10.681222 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7495cdd-cf97-46a6-87ce-50a5e69a62ae None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:10.693900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-e7495cdd-cf97-46a6-87ce-50a5e69a62ae None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 14:15:10.693900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:10.693900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:10.693900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:10.693900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:10.693900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:10.693900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:10.693900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:10.693900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:10.693900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:10.693900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:10.693900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:10.693900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:10.693900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:10.693900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:10.693900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:10.695100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:10.695100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:10.695100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:10.695100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:10.695100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:10.695100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:10.695100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:10.695100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:10.695100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:10.695100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:10.695100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:10.695100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:10.695100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:10.695100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:10.695100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:10.695100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:10.695100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:10.695100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:10.696277 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:10.696277 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:10.696277 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:10.696277 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:10.696277 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:10.696277 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:10.696277 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:10.696277 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:10.696277 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 14:15:10.696277 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:10.700041 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 328/663] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:15:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:10.700821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7495cdd-cf97-46a6-87ce-50a5e69a62ae None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:10.748411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af94c9-003a-408f-b17d-cd04b8ce6037 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:10.784086 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906ff26-f751-4f21-8835-2d12a7a3b13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:10.784719 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906ff26-f751-4f21-8835-2d12a7a3b13f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:10.784998 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906ff26-f751-4f21-8835-2d12a7a3b13f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:10.785302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906ff26-f751-4f21-8835-2d12a7a3b13f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:10.793249 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906ff26-f751-4f21-8835-2d12a7a3b13f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:10.794723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906ff26-f751-4f21-8835-2d12a7a3b13f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:10.807254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-1906ff26-f751-4f21-8835-2d12a7a3b13f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:10.807254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:10.807254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:10.807254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:10.807254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:10.807254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:10.807254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:10.807254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:10.807254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:10.807254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:10.807254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:10.807254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:10.807254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:10.807254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:10.807254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:10.808152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:10.808152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:10.808152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:10.808152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:10.808152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:10.808152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:10.808152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:10.808152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:10.808152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:10.808152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:10.808152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:10.808152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:10.808152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:10.808152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:10.808152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:10.808152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:10.808152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:10.809035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:10.809035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:10.809035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:10.809035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:10.809035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:10.809035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:10.809035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:10.809035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:10.809488 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7495cdd-cf97-46a6-87ce-50a5e69a62ae None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:10.813123 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 336/664] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:10.813983 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906ff26-f751-4f21-8835-2d12a7a3b13f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:10.827031 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:10.844557 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22181d6-75c5-41cb-aaf6-166e26ac978f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:10.848838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22181d6-75c5-41cb-aaf6-166e26ac978f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:10.848838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22181d6-75c5-41cb-aaf6-166e26ac978f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:10.848838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22181d6-75c5-41cb-aaf6-166e26ac978f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:10.856888 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22181d6-75c5-41cb-aaf6-166e26ac978f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:15:10.862056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-f22181d6-75c5-41cb-aaf6-166e26ac978f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:10.862056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:10.862056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:10.862056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:10.862056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:10.862056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:10.862056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:10.862056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:10.862056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:10.862056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:10.862056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:10.862056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:10.862056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:15:10.862056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:15:10.862056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:15:10.862056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:15:10.862974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:15:10.862974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:15:10.862974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:15:10.862974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:15:10.862974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:10.862974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:10.862974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:10.862974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:10.862974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:10.862974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:10.862974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:10.862974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:10.862974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:10.862974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:10.862974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:10.862974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:10.863815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:10.863815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:10.863815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:10.863815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:10.863815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:15:10.863815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:15:10.863815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:15:10.863815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:15:10.863815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:15:10.863815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:15:10.863815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:10.863815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:10.863815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 329/665] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:15:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:10.864506 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22181d6-75c5-41cb-aaf6-166e26ac978f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:10.904846 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:10.928142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906ff26-f751-4f21-8835-2d12a7a3b13f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:10.966143 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7d3e3-9165-4f74-b020-0bdc0734c7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:10.966799 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7d3e3-9165-4f74-b020-0bdc0734c7ad None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:10.967087 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7d3e3-9165-4f74-b020-0bdc0734c7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:10.967362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7d3e3-9165-4f74-b020-0bdc0734c7ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:10.971004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22181d6-75c5-41cb-aaf6-166e26ac978f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:10.978459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7d3e3-9165-4f74-b020-0bdc0734c7ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:10.980027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7d3e3-9165-4f74-b020-0bdc0734c7ad None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:10.994663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-40c7d3e3-9165-4f74-b020-0bdc0734c7ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:10.994663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:10.994663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:10.994663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:10.994663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:10.994663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:10.994663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:10.994663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:10.994663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:10.994663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:10.994663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:10.994663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:10.994663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:10.994663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:10.994663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:10.994663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:10.995600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:10.995600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:10.995600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:10.995600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:10.995600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:10.995600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:10.995600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:10.995600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:10.995600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:10.995600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:10.995600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:10.995600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:10.995600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:10.995600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:10.995600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:10.995600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:10.995600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:10.996486 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:10.996486 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:10.996486 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:10.996486 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 337/666] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:10.996486 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7d3e3-9165-4f74-b020-0bdc0734c7ad None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:11.013222 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343a089-a90f-4bb2-874c-3c91886d94c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:11.013819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343a089-a90f-4bb2-874c-3c91886d94c2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:11.014126 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343a089-a90f-4bb2-874c-3c91886d94c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:11.014370 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343a089-a90f-4bb2-874c-3c91886d94c2 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:11.015084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343a089-a90f-4bb2-874c-3c91886d94c2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:11.015389 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343a089-a90f-4bb2-874c-3c91886d94c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:11.016834 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343a089-a90f-4bb2-874c-3c91886d94c2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:11.036099 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 330/667] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Sep 5 14:15:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:11.041950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343a089-a90f-4bb2-874c-3c91886d94c2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:11.078415 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:11.110861 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7d3e3-9165-4f74-b020-0bdc0734c7ad None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:11.141763 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:11.149833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c0347-fdbe-40b5-a108-553915d8ae2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:11.150610 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c0347-fdbe-40b5-a108-553915d8ae2e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:11.150874 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c0347-fdbe-40b5-a108-553915d8ae2e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:11.151203 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c0347-fdbe-40b5-a108-553915d8ae2e None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:11.151963 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c0347-fdbe-40b5-a108-553915d8ae2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:11.152366 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c0347-fdbe-40b5-a108-553915d8ae2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:11.153918 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c0347-fdbe-40b5-a108-553915d8ae2e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:11.162265 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343a089-a90f-4bb2-874c-3c91886d94c2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:11.167013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 338/668] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:11.167855 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c0347-fdbe-40b5-a108-553915d8ae2e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:11.210081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc3d29-fb05-4599-a49d-37451644ca63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:11.211007 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc3d29-fb05-4599-a49d-37451644ca63 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:11.211436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc3d29-fb05-4599-a49d-37451644ca63 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:11.211852 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc3d29-fb05-4599-a49d-37451644ca63 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:11.213303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc3d29-fb05-4599-a49d-37451644ca63 None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:11.213853 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc3d29-fb05-4599-a49d-37451644ca63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:11.215425 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc3d29-fb05-4599-a49d-37451644ca63 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:11.229770 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 331/669] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 5 14:15:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:11.230899 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc3d29-fb05-4599-a49d-37451644ca63 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:11.284959 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c0347-fdbe-40b5-a108-553915d8ae2e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:11.323469 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687c454-4fc2-4b49-9de2-ee542db49938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:11.324070 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687c454-4fc2-4b49-9de2-ee542db49938 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:11.324370 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687c454-4fc2-4b49-9de2-ee542db49938 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:11.324641 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687c454-4fc2-4b49-9de2-ee542db49938 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:11.325301 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687c454-4fc2-4b49-9de2-ee542db49938 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:11.325600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687c454-4fc2-4b49-9de2-ee542db49938 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:11.326967 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687c454-4fc2-4b49-9de2-ee542db49938 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:11.336004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:11.338202 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 339/670] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:11.338882 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687c454-4fc2-4b49-9de2-ee542db49938 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:11.343854 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc3d29-fb05-4599-a49d-37451644ca63 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:11.380243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3b977-43b2-4b8d-8894-450d824cb959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:11.381007 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3b977-43b2-4b8d-8894-450d824cb959 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:11.381416 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3b977-43b2-4b8d-8894-450d824cb959 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:11.381784 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3b977-43b2-4b8d-8894-450d824cb959 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:11.397212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:11.450560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687c454-4fc2-4b49-9de2-ee542db49938 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:11.454414 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3b977-43b2-4b8d-8894-450d824cb959 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:11.455878 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3b977-43b2-4b8d-8894-450d824cb959 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:11.484994 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7c6cc-78b3-468f-ab0a-a8b142cdfc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:11.485570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7c6cc-78b3-468f-ab0a-a8b142cdfc64 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:11.485847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7c6cc-78b3-468f-ab0a-a8b142cdfc64 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:11.486115 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7c6cc-78b3-468f-ab0a-a8b142cdfc64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:11.486823 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7c6cc-78b3-468f-ab0a-a8b142cdfc64 None admin] RBAC: Adding query filter params (role.id=5351e6d174334a8eaf71e8d2b3c079a7, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=d7e1db2b6f70497ab535e0e9e86ec4ae) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:11.487129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7c6cc-78b3-468f-ab0a-a8b142cdfc64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:11.488550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7c6cc-78b3-468f-ab0a-a8b142cdfc64 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:11.505106 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 340/671] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:15:11 2022] GET /identity/v3/role_assignments?user.id=d7e1db2b6f70497ab535e0e9e86ec4ae&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=5351e6d174334a8eaf71e8d2b3c079a7 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:11.505106 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7c6cc-78b3-468f-ab0a-a8b142cdfc64 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:11.584559 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:11.590194 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 332/672] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:15:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:15:11.591277 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3b977-43b2-4b8d-8894-450d824cb959 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:11.643091 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7c6cc-78b3-468f-ab0a-a8b142cdfc64 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:11.661454 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:11.693172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a26b50-292f-4f15-ba40-6ffb7aeca341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:11.694262 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a26b50-292f-4f15-ba40-6ffb7aeca341 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:11.695388 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a26b50-292f-4f15-ba40-6ffb7aeca341 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:11.695662 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a26b50-292f-4f15-ba40-6ffb7aeca341 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:11.709719 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a26b50-292f-4f15-ba40-6ffb7aeca341 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:11.711060 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a26b50-292f-4f15-ba40-6ffb7aeca341 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:11.716736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3b977-43b2-4b8d-8894-450d824cb959 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:11.727522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-b4a26b50-292f-4f15-ba40-6ffb7aeca341 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:11.727522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:11.727522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:11.727522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:11.727522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:11.727522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:11.727522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:11.727522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:11.727522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:11.727522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:11.727522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:11.727522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:11.727522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:11.727522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:11.727522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:11.727522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:11.729178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:11.729178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:11.729178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:11.729178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:11.729178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:11.729178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:11.729178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:11.729178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:11.729178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:11.729178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:11.729178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:11.729178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:11.729178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:11.729178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:11.729178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:11.729178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:11.729178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:11.730186 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:11.730186 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:11.730186 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:11.730186 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 341/673] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:11.730186 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a26b50-292f-4f15-ba40-6ffb7aeca341 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:11.763519 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e958c1-f32c-4a08-a2c6-aefd2db4d07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:11.764449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e958c1-f32c-4a08-a2c6-aefd2db4d07a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:11.764733 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e958c1-f32c-4a08-a2c6-aefd2db4d07a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:11.765328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e958c1-f32c-4a08-a2c6-aefd2db4d07a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:11.774426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e958c1-f32c-4a08-a2c6-aefd2db4d07a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:11.776827 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e958c1-f32c-4a08-a2c6-aefd2db4d07a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:11.792303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-73e958c1-f32c-4a08-a2c6-aefd2db4d07a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:11.792303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:11.792303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:11.792303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:11.792303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:11.792303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:11.792303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:11.792303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:11.792303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:11.792303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:11.792303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:11.792303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:11.792303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:11.792303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:11.792303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:11.793976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:11.793976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:11.793976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:11.793976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:11.793976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:11.793976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:11.793976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:11.793976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:11.793976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:11.793976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:11.793976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:11.793976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:11.793976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:11.793976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:11.793976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:11.793976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:11.793976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:11.795715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:11.795715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:11.795715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:11.795715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:11.795715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:11.795715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:11.795715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:11.795715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:11.795715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 333/674] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:11.795715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e958c1-f32c-4a08-a2c6-aefd2db4d07a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:11.860558 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a26b50-292f-4f15-ba40-6ffb7aeca341 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:11.877463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:11.904145 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfd418-c6b9-48cb-9426-811c4bd53d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:11.904783 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfd418-c6b9-48cb-9426-811c4bd53d5a None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:11.912961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfd418-c6b9-48cb-9426-811c4bd53d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:11.912961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfd418-c6b9-48cb-9426-811c4bd53d5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:11.917282 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfd418-c6b9-48cb-9426-811c4bd53d5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:11.918892 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfd418-c6b9-48cb-9426-811c4bd53d5a None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:11.928423 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e958c1-f32c-4a08-a2c6-aefd2db4d07a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:11.935419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-30cfd418-c6b9-48cb-9426-811c4bd53d5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:11.935419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:11.935419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:11.935419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:11.935419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:11.935419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:11.935419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:11.935419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:11.935419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:11.935419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:11.935419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:11.935419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:11.935419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:11.935419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:11.935419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:11.935419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:11.936518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:11.936518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:11.936518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:11.936518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:11.936518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:11.936518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:11.936518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:11.936518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:11.936518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:11.936518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:11.936518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:11.936518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:11.936518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:11.936518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:11.936518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:11.936518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:11.936518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:11.937529 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:11.937529 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:11.937529 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:11.939309 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 342/675] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:11.940240 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfd418-c6b9-48cb-9426-811c4bd53d5a None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:11.961531 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:11.972543 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dc641-2a4a-43bc-8a6b-e9c4a8481c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:11.974405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dc641-2a4a-43bc-8a6b-e9c4a8481c80 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:11.974405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dc641-2a4a-43bc-8a6b-e9c4a8481c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:11.974405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929dc641-2a4a-43bc-8a6b-e9c4a8481c80 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:11.974405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929dc641-2a4a-43bc-8a6b-e9c4a8481c80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:11.974779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929dc641-2a4a-43bc-8a6b-e9c4a8481c80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:11.976286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929dc641-2a4a-43bc-8a6b-e9c4a8481c80 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:11.994605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 334/676] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:11.994605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dc641-2a4a-43bc-8a6b-e9c4a8481c80 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:12.067347 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfd418-c6b9-48cb-9426-811c4bd53d5a None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:12.112946 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9b727-2ff7-4233-8272-8338935b4f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:12.113627 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9b727-2ff7-4233-8272-8338935b4f44 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:12.113863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9b727-2ff7-4233-8272-8338935b4f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:12.114169 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9b727-2ff7-4233-8272-8338935b4f44 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:12.114869 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9b727-2ff7-4233-8272-8338935b4f44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:12.115177 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9b727-2ff7-4233-8272-8338935b4f44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:12.116609 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9b727-2ff7-4233-8272-8338935b4f44 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:12.130578 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 343/677] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:12.131716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9b727-2ff7-4233-8272-8338935b4f44 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:12.142453 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929dc641-2a4a-43bc-8a6b-e9c4a8481c80 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:12.163214 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:12.185100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0657813-8cb1-474a-a4ec-bbd7e659af4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:12.186377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0657813-8cb1-474a-a4ec-bbd7e659af4c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:12.187152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0657813-8cb1-474a-a4ec-bbd7e659af4c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:12.187645 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0657813-8cb1-474a-a4ec-bbd7e659af4c None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:12.188865 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0657813-8cb1-474a-a4ec-bbd7e659af4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:12.189405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0657813-8cb1-474a-a4ec-bbd7e659af4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:12.191152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0657813-8cb1-474a-a4ec-bbd7e659af4c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:12.212258 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 335/678] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:12.212258 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0657813-8cb1-474a-a4ec-bbd7e659af4c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:12.229771 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:12.271032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9b727-2ff7-4233-8272-8338935b4f44 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:12.313585 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c1c50-6aa6-49e8-b129-42e64b1c2df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:12.314468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c1c50-6aa6-49e8-b129-42e64b1c2df4 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:12.314748 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c1c50-6aa6-49e8-b129-42e64b1c2df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:12.315085 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c1c50-6aa6-49e8-b129-42e64b1c2df4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:12.323337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c1c50-6aa6-49e8-b129-42e64b1c2df4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:12.324727 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c1c50-6aa6-49e8-b129-42e64b1c2df4 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:12.335726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-580c1c50-6aa6-49e8-b129-42e64b1c2df4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 14:15:12.335726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:12.335726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:12.335726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:12.335726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:12.335726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:12.335726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:12.335726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:12.335726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:12.335726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:12.335726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:12.335726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:12.335726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:12.335726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:12.335726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:12.335726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:12.336666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:12.336666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:12.336666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:12.336666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:12.336666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:12.336666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:12.336666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:12.336666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:12.336666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:12.336666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:12.336666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:12.336666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:12.336666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:12.336666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:12.336666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:12.336666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:12.336666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:12.336666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:12.337718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:12.337718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:12.337718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:12.337718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:12.337718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:12.337718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:12.337718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:12.337718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:12.337718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 14:15:12.337718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:12.337718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 344/679] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:15:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:12.338355 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3859373-2995-46c3-947e-a7a3caf0ea19 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:12.338914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3859373-2995-46c3-947e-a7a3caf0ea19 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:12.338914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3859373-2995-46c3-947e-a7a3caf0ea19 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:12.340234 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 345/680] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:12.345259 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3859373-2995-46c3-947e-a7a3caf0ea19 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:12.351139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0657813-8cb1-474a-a4ec-bbd7e659af4c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:12.387258 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baed05d-6161-4839-91d6-3584b5affca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:12.387859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baed05d-6161-4839-91d6-3584b5affca5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:12.388134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baed05d-6161-4839-91d6-3584b5affca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:12.388400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baed05d-6161-4839-91d6-3584b5affca5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:12.389136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baed05d-6161-4839-91d6-3584b5affca5 None admin] RBAC: Adding query filter params (role.id=5351e6d174334a8eaf71e8d2b3c079a7, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=1a7e9f0daa1c48eca87d92ced265afdb) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:12.389443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baed05d-6161-4839-91d6-3584b5affca5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:12.391269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baed05d-6161-4839-91d6-3584b5affca5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:12.398312 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 336/681] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:15:12 2022] GET /identity/v3/role_assignments?user.id=1a7e9f0daa1c48eca87d92ced265afdb&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=5351e6d174334a8eaf71e8d2b3c079a7 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:12.401915 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baed05d-6161-4839-91d6-3584b5affca5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:12.466404 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3859373-2995-46c3-947e-a7a3caf0ea19 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:12.476227 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:12.507204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19742e60-9471-47e1-8d28-99966d675246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:12.508282 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19742e60-9471-47e1-8d28-99966d675246 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:12.509648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19742e60-9471-47e1-8d28-99966d675246 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:12.510141 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19742e60-9471-47e1-8d28-99966d675246 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:12.514492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:12.519795 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19742e60-9471-47e1-8d28-99966d675246 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:12.523861 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19742e60-9471-47e1-8d28-99966d675246 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:12.534592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-19742e60-9471-47e1-8d28-99966d675246 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:12.534592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:12.534592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:12.534592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:12.534592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:12.534592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:12.534592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:12.534592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:12.534592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:12.534592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:12.534592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:12.534592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:12.534592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:12.534592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:12.534592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:12.535712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:12.535712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:12.535712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:12.535712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:12.535712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:12.535712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:12.535712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:12.535712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:12.535712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:12.535712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:12.535712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:12.535712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:12.535712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:12.535712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:12.535712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:12.535712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:12.535712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:12.536579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:12.536579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:12.536579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:12.536579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:12.536579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:12.536579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:12.536579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:12.536579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:12.538753 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 346/682] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:12.540313 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce728573-f7dc-4a43-a721-ccbff5a78e6b None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:12.540855 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce728573-f7dc-4a43-a721-ccbff5a78e6b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:12.541534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce728573-f7dc-4a43-a721-ccbff5a78e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:12.557401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baed05d-6161-4839-91d6-3584b5affca5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:12.562754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-ce728573-f7dc-4a43-a721-ccbff5a78e6b None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:12.563942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ce728573-f7dc-4a43-a721-ccbff5a78e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:12.597217 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d8db8-a2c4-4168-8f51-015b0659ef38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:12.597759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d8db8-a2c4-4168-8f51-015b0659ef38 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:12.598033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d8db8-a2c4-4168-8f51-015b0659ef38 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:12.598299 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d8db8-a2c4-4168-8f51-015b0659ef38 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:12.599034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d8db8-a2c4-4168-8f51-015b0659ef38 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:12.599529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d8db8-a2c4-4168-8f51-015b0659ef38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:12.601016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d8db8-a2c4-4168-8f51-015b0659ef38 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:12.623902 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 337/683] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Sep 5 14:15:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:12.624599 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d8db8-a2c4-4168-8f51-015b0659ef38 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:12.657220 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 347/684] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:15:12.658851 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce728573-f7dc-4a43-a721-ccbff5a78e6b None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:12.751399 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:12.754515 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d8db8-a2c4-4168-8f51-015b0659ef38 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:12.794422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7250db5-9dc6-453e-92c5-53aa76d800db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:12.795207 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7250db5-9dc6-453e-92c5-53aa76d800db None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:12.795595 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7250db5-9dc6-453e-92c5-53aa76d800db None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:12.795994 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7250db5-9dc6-453e-92c5-53aa76d800db None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:12.796802 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7250db5-9dc6-453e-92c5-53aa76d800db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:12.797242 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7250db5-9dc6-453e-92c5-53aa76d800db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:12.798501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce728573-f7dc-4a43-a721-ccbff5a78e6b None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:12.805539 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7250db5-9dc6-453e-92c5-53aa76d800db None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:12.823772 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 338/685] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:12.833225 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:12.841224 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7250db5-9dc6-453e-92c5-53aa76d800db None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:12.843586 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4dee4-0ef6-4b1c-aebb-0efbb6342b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:12.845251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4dee4-0ef6-4b1c-aebb-0efbb6342b70 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:12.845251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4dee4-0ef6-4b1c-aebb-0efbb6342b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:12.845251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4dee4-0ef6-4b1c-aebb-0efbb6342b70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:12.926433 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4dee4-0ef6-4b1c-aebb-0efbb6342b70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:12.928118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4dee4-0ef6-4b1c-aebb-0efbb6342b70 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:13.005434 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7250db5-9dc6-453e-92c5-53aa76d800db None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:13.042570 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbba30-7be0-4c3e-bde5-b6742c39cf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:13.043177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbba30-7be0-4c3e-bde5-b6742c39cf50 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:13.043453 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbba30-7be0-4c3e-bde5-b6742c39cf50 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:13.043722 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbba30-7be0-4c3e-bde5-b6742c39cf50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:13.044498 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbba30-7be0-4c3e-bde5-b6742c39cf50 None admin] RBAC: Adding query filter params (role.id=5351e6d174334a8eaf71e8d2b3c079a7, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=b0ec118e5a114429b3e1c91041f7caf6) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:13.044859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbba30-7be0-4c3e-bde5-b6742c39cf50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:13.046428 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbba30-7be0-4c3e-bde5-b6742c39cf50 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:13.052990 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 339/686] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:15:12 2022] GET /identity/v3/role_assignments?user.id=b0ec118e5a114429b3e1c91041f7caf6&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=5351e6d174334a8eaf71e8d2b3c079a7 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:13.053842 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbba30-7be0-4c3e-bde5-b6742c39cf50 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:13.071768 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 348/687] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:15:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:15:13.080429 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4dee4-0ef6-4b1c-aebb-0efbb6342b70 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:13.113495 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:13.123169 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:13.255458 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbba30-7be0-4c3e-bde5-b6742c39cf50 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:13.290996 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4dee4-0ef6-4b1c-aebb-0efbb6342b70 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:13.307866 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed25e38-6326-4b1a-a39b-7ffa2bc114c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:13.308510 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed25e38-6326-4b1a-a39b-7ffa2bc114c3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:13.308785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed25e38-6326-4b1a-a39b-7ffa2bc114c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:13.309071 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed25e38-6326-4b1a-a39b-7ffa2bc114c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:13.322266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed25e38-6326-4b1a-a39b-7ffa2bc114c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:15:13.328401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-3ed25e38-6326-4b1a-a39b-7ffa2bc114c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:15:13.328401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:13.328401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:13.328401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:13.328401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:13.328401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:13.328401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:13.328401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:13.328401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:13.328401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:13.328401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:13.328401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:13.328401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:15:13.328401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:15:13.328401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:15:13.328401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:15:13.329378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:15:13.329378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:15:13.329378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:15:13.329378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:15:13.329378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:13.329378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:13.329378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:13.329378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:13.329378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:13.329378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:13.329378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:13.329378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:13.329378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:13.329378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:13.329378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:13.329378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:13.330633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:13.330633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:13.330633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:13.330633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:13.330633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:15:13.330633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:15:13.330633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:15:13.330633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:15:13.330633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:15:13.330633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:15:13.330633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:15:13.330633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:13.330633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 340/688] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:15:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:13.335167 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935faf8d-d320-4554-95c9-eed17437c522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:13.335328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed25e38-6326-4b1a-a39b-7ffa2bc114c3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:13.335998 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935faf8d-d320-4554-95c9-eed17437c522 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:13.336375 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935faf8d-d320-4554-95c9-eed17437c522 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:13.336746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935faf8d-d320-4554-95c9-eed17437c522 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:13.348382 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935faf8d-d320-4554-95c9-eed17437c522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:13.350058 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935faf8d-d320-4554-95c9-eed17437c522 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:13.365631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-935faf8d-d320-4554-95c9-eed17437c522 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:13.365631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:13.365631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:13.365631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:13.365631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:13.365631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:13.365631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:13.365631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:13.365631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:13.365631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:13.365631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:13.365631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:13.365631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:13.365631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:13.365631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:13.365631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:13.368036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:13.368036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:13.368036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:13.368036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:13.368036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:13.368036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:13.368036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:13.368036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:13.368036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:13.368036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:13.368036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:13.368036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:13.368036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:13.368036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:13.368036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:13.368036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:13.368036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:13.370263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:13.370263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:13.370263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:13.373090 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 349/689] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:13.373090 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935faf8d-d320-4554-95c9-eed17437c522 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:13.432052 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:13.449630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed25e38-6326-4b1a-a39b-7ffa2bc114c3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:13.459287 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:13.482609 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935faf8d-d320-4554-95c9-eed17437c522 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:13.489113 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2acbfc-c695-4890-abb6-3fbbb3a588e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:13.489767 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2acbfc-c695-4890-abb6-3fbbb3a588e9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:13.489985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2acbfc-c695-4890-abb6-3fbbb3a588e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:13.490252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2acbfc-c695-4890-abb6-3fbbb3a588e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:13.490922 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2acbfc-c695-4890-abb6-3fbbb3a588e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:13.491206 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2acbfc-c695-4890-abb6-3fbbb3a588e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:13.492564 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2acbfc-c695-4890-abb6-3fbbb3a588e9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:13.501598 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 341/690] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:15:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:13.507047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2acbfc-c695-4890-abb6-3fbbb3a588e9 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:13.519220 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8fa11-b86a-490f-bb14-74db74e0d344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:13.519835 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8fa11-b86a-490f-bb14-74db74e0d344 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:13.520121 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8fa11-b86a-490f-bb14-74db74e0d344 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:13.520399 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8fa11-b86a-490f-bb14-74db74e0d344 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:13.521065 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8fa11-b86a-490f-bb14-74db74e0d344 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:13.521393 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8fa11-b86a-490f-bb14-74db74e0d344 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:13.523821 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8fa11-b86a-490f-bb14-74db74e0d344 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:13.536976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 350/691] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:13.542583 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8fa11-b86a-490f-bb14-74db74e0d344 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:13.613295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2acbfc-c695-4890-abb6-3fbbb3a588e9 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:13.646494 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8fa11-b86a-490f-bb14-74db74e0d344 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:13.648841 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36511297-f0da-4668-bc2a-d5a71c74dbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:13.649589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36511297-f0da-4668-bc2a-d5a71c74dbdf None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:13.649912 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36511297-f0da-4668-bc2a-d5a71c74dbdf None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:13.650185 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36511297-f0da-4668-bc2a-d5a71c74dbdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:13.661570 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36511297-f0da-4668-bc2a-d5a71c74dbdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:13.663023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36511297-f0da-4668-bc2a-d5a71c74dbdf None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:13.670751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:13.679931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-36511297-f0da-4668-bc2a-d5a71c74dbdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:13.679931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:13.679931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:13.679931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:13.679931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:13.679931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:13.679931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:13.679931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:13.679931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:13.679931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:13.679931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:13.679931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:13.679931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:13.679931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:13.679931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:13.679931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:13.688738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:13.688738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:13.688738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:13.688738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:13.688738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:13.688738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:13.688738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:13.688738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:13.688738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:13.688738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:13.688738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:13.688738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:13.688738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:13.688738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:13.688738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:13.688738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:13.688738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:13.689861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:13.689861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:13.689861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:13.689861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 342/692] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:13.689861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26a3bd-dba2-4112-950c-c99b70f8cf4d None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:13.689861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26a3bd-dba2-4112-950c-c99b70f8cf4d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:13.689861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26a3bd-dba2-4112-950c-c99b70f8cf4d None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:13.689861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 343/693] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:13.691237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffdc691-9808-4960-8f85-5db2445d033d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:13.691514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26a3bd-dba2-4112-950c-c99b70f8cf4d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:13.692176 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdc691-9808-4960-8f85-5db2445d033d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:13.692526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdc691-9808-4960-8f85-5db2445d033d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:13.692880 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdc691-9808-4960-8f85-5db2445d033d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:13.700724 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffdc691-9808-4960-8f85-5db2445d033d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:13.702342 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffdc691-9808-4960-8f85-5db2445d033d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:13.708383 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:13.718349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-6ffdc691-9808-4960-8f85-5db2445d033d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:13.718349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:13.718349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:13.718349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:13.718349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:13.718349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:13.718349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:13.718349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:13.718349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:13.718349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:13.718349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:13.718349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:13.718349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:13.718349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:13.718349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:13.719245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:13.719245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:13.719245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:13.719245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:13.719245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:13.719245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:13.719245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:13.719245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:13.719245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:13.719245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:13.719245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:13.719245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:13.719245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:13.719245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:13.719245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:13.719245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:13.719245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:13.720144 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:13.720144 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:13.720144 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:13.720144 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:13.720144 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:13.720144 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:13.720144 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:13.720144 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:13.720144 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 351/694] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:13.726113 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5cdf5-045c-499b-9e1e-19f62b7ccccb None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:13.726467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5cdf5-045c-499b-9e1e-19f62b7ccccb None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:13.732081 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5cdf5-045c-499b-9e1e-19f62b7ccccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:13.747778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-e6f5cdf5-045c-499b-9e1e-19f62b7ccccb None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:13.749612 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e6f5cdf5-045c-499b-9e1e-19f62b7ccccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:13.805345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26a3bd-dba2-4112-950c-c99b70f8cf4d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:13.824799 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 352/695] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:15:13.825925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5cdf5-045c-499b-9e1e-19f62b7ccccb None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:13.842429 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce85f6-6f38-4c16-a173-67877e7cd7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:13.843441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce85f6-6f38-4c16-a173-67877e7cd7c7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:13.843892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce85f6-6f38-4c16-a173-67877e7cd7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:13.844336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce85f6-6f38-4c16-a173-67877e7cd7c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:13.845208 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce85f6-6f38-4c16-a173-67877e7cd7c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:13.845746 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce85f6-6f38-4c16-a173-67877e7cd7c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:13.847367 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce85f6-6f38-4c16-a173-67877e7cd7c7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:13.860465 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 344/696] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:13.865956 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce85f6-6f38-4c16-a173-67877e7cd7c7 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:13.928120 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:13.937162 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5cdf5-045c-499b-9e1e-19f62b7ccccb None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:13.965429 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:13.972345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce85f6-6f38-4c16-a173-67877e7cd7c7 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:13.973796 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94469a47-6457-4956-a552-62e4fbb73f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:13.975116 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94469a47-6457-4956-a552-62e4fbb73f2d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:13.975492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94469a47-6457-4956-a552-62e4fbb73f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:13.975770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94469a47-6457-4956-a552-62e4fbb73f2d None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:13.976521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94469a47-6457-4956-a552-62e4fbb73f2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:13.976936 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94469a47-6457-4956-a552-62e4fbb73f2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:13.978484 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94469a47-6457-4956-a552-62e4fbb73f2d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:13.994435 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 353/697] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:14.000555 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94469a47-6457-4956-a552-62e4fbb73f2d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:14.008432 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d3b26-4575-4c67-bde0-55fdf7b325a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:14.009154 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d3b26-4575-4c67-bde0-55fdf7b325a8 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:14.009426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d3b26-4575-4c67-bde0-55fdf7b325a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:14.009696 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d3b26-4575-4c67-bde0-55fdf7b325a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:14.017995 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d3b26-4575-4c67-bde0-55fdf7b325a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:14.019446 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d3b26-4575-4c67-bde0-55fdf7b325a8 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:14.031529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-f29d3b26-4575-4c67-bde0-55fdf7b325a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 14:15:14.031529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:14.031529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:14.031529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:14.031529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:14.031529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:14.031529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:14.031529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:14.031529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:14.031529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:14.031529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:14.031529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:14.031529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:14.031529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:14.031529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:14.031529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:14.032460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:14.032460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:14.032460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:14.032460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:14.032460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:14.032460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:14.032460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:14.032460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:14.032460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:14.032460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:14.032460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:14.032460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:14.032460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:14.032460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:14.032460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:14.032460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:14.032460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:14.032460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:14.033978 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:14.033978 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:14.033978 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:14.033978 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:14.033978 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:14.033978 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:14.033978 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:14.033978 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:14.033978 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 14:15:14.033978 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:14.033978 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 345/698] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 5 14:15:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:14.038320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d3b26-4575-4c67-bde0-55fdf7b325a8 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:14.106365 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94469a47-6457-4956-a552-62e4fbb73f2d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:14.141857 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d3b26-4575-4c67-bde0-55fdf7b325a8 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:14.143158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67968f9b-d0a1-434a-8416-a59642b1a8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:14.143876 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67968f9b-d0a1-434a-8416-a59642b1a8ac None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:14.144252 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67968f9b-d0a1-434a-8416-a59642b1a8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:14.144535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67968f9b-d0a1-434a-8416-a59642b1a8ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:14.145297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67968f9b-d0a1-434a-8416-a59642b1a8ac None admin] RBAC: Adding query filter params (role.id=5351e6d174334a8eaf71e8d2b3c079a7, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=1ed60e9eecb94ef39c2f4a5e5f50d670) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:14.145611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67968f9b-d0a1-434a-8416-a59642b1a8ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:14.147052 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67968f9b-d0a1-434a-8416-a59642b1a8ac None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:14.153984 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 354/699] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:15:13 2022] GET /identity/v3/role_assignments?user.id=1ed60e9eecb94ef39c2f4a5e5f50d670&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=5351e6d174334a8eaf71e8d2b3c079a7 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:14.160859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:14.182157 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecadee3-bc77-4992-a1e6-c08ea9075914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:14.182549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67968f9b-d0a1-434a-8416-a59642b1a8ac None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:14.182770 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecadee3-bc77-4992-a1e6-c08ea9075914 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:14.183049 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecadee3-bc77-4992-a1e6-c08ea9075914 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:14.183322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecadee3-bc77-4992-a1e6-c08ea9075914 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:14.184054 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecadee3-bc77-4992-a1e6-c08ea9075914 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:14.184375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecadee3-bc77-4992-a1e6-c08ea9075914 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:14.188152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecadee3-bc77-4992-a1e6-c08ea9075914 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:14.206901 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 346/700] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 5 14:15:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:14.211947 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecadee3-bc77-4992-a1e6-c08ea9075914 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:14.293574 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:14.329146 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecadee3-bc77-4992-a1e6-c08ea9075914 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:14.372742 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32308b8d-519f-47dc-9f8a-5cac10fd6c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:14.373396 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32308b8d-519f-47dc-9f8a-5cac10fd6c7a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:14.373674 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32308b8d-519f-47dc-9f8a-5cac10fd6c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:14.373942 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32308b8d-519f-47dc-9f8a-5cac10fd6c7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:14.411378 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67968f9b-d0a1-434a-8416-a59642b1a8ac None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:14.438552 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:14.456497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fb7be-7760-4a7a-9e28-e958c0a63d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:14.457327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fb7be-7760-4a7a-9e28-e958c0a63d40 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:14.457608 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fb7be-7760-4a7a-9e28-e958c0a63d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:14.458032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fb7be-7760-4a7a-9e28-e958c0a63d40 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:14.458945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87fb7be-7760-4a7a-9e28-e958c0a63d40 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:14.460710 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87fb7be-7760-4a7a-9e28-e958c0a63d40 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:14.474963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32308b8d-519f-47dc-9f8a-5cac10fd6c7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:14.476515 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32308b8d-519f-47dc-9f8a-5cac10fd6c7a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:14.478361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-c87fb7be-7760-4a7a-9e28-e958c0a63d40 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 14:15:14.478361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:14.478361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:15:14.478361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:15:14.478361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:15:14.478361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:15:14.478361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:15:14.478361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:14.478361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 14:15:14.478361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:14.478361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:14.478361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:14.478361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:14.478361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:14.478361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:14.478361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:14.478361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:14.479476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:14.479476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:14.479476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:14.479476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:14.479476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:14.479476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:14.479476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:15:14.479476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:15:14.479476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:15:14.479476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:15:14.479476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:14.479476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:14.479476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:14.479476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:14.479476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:14.479476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:14.480419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:14.480419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:14.480419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:14.480419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:14.480419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:14.480419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:14.480419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:14.480419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:14.480419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:14.480419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:14.480419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:15:14.480419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:14.480419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 14:15:14.480419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:14.481579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 355/701] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Sep 5 14:15:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:14.485340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fb7be-7760-4a7a-9e28-e958c0a63d40 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:14.602018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 347/702] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:15:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 14:15:14.608258 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32308b8d-519f-47dc-9f8a-5cac10fd6c7a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:14.608658 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fb7be-7760-4a7a-9e28-e958c0a63d40 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:14.638628 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:14.652026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4705e-5469-4494-bac8-b30140d852ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:14.652641 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4705e-5469-4494-bac8-b30140d852ef None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:14.652918 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4705e-5469-4494-bac8-b30140d852ef None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:14.655750 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4705e-5469-4494-bac8-b30140d852ef None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:14.655750 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4705e-5469-4494-bac8-b30140d852ef None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:14.655750 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4705e-5469-4494-bac8-b30140d852ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:14.655750 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4705e-5469-4494-bac8-b30140d852ef None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:14.662585 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 356/703] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Sep 5 14:15:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:14.667707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4705e-5469-4494-bac8-b30140d852ef None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:14.699577 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:14.736238 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32308b8d-519f-47dc-9f8a-5cac10fd6c7a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:14.775924 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253af419-f43c-4a05-aaed-d44b60464d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:14.776636 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253af419-f43c-4a05-aaed-d44b60464d18 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:14.778913 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253af419-f43c-4a05-aaed-d44b60464d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:14.778913 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253af419-f43c-4a05-aaed-d44b60464d18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:14.795009 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253af419-f43c-4a05-aaed-d44b60464d18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:14.797176 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253af419-f43c-4a05-aaed-d44b60464d18 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:14.817869 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4705e-5469-4494-bac8-b30140d852ef None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:14.834760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-253af419-f43c-4a05-aaed-d44b60464d18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:14.834760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:14.834760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:14.834760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:14.834760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:14.834760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:14.834760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:14.834760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:14.834760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:14.834760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:14.834760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:14.834760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:14.834760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:14.834760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:14.834760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:14.834760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:14.835761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:14.835761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:14.835761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:14.835761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:14.835761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:14.835761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:14.835761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:14.835761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:14.835761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:14.835761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:14.835761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:14.835761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:14.835761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:14.835761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:14.835761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:14.835761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:14.835761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:14.836628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:14.836628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:14.836628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:14.839721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 348/704] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:14.845125 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253af419-f43c-4a05-aaed-d44b60464d18 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:14.892511 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5096b15-28ef-49d1-b074-4e76b156ae4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:14.893041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5096b15-28ef-49d1-b074-4e76b156ae4f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:14.893341 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5096b15-28ef-49d1-b074-4e76b156ae4f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:14.893617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5096b15-28ef-49d1-b074-4e76b156ae4f None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:14.894248 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5096b15-28ef-49d1-b074-4e76b156ae4f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:14.894551 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5096b15-28ef-49d1-b074-4e76b156ae4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:14.900195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5096b15-28ef-49d1-b074-4e76b156ae4f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:14.915343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 357/705] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Sep 5 14:15:14 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:14.949383 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd2098-3438-46fc-89c9-389e5afa9380 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:14.949690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd2098-3438-46fc-89c9-389e5afa9380 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:14.949934 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd2098-3438-46fc-89c9-389e5afa9380 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:14.951686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 358/706] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:14.958318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8354957-db3f-4e73-9e89-7a265f9dd816 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:14.958623 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8354957-db3f-4e73-9e89-7a265f9dd816 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:14.958885 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8354957-db3f-4e73-9e89-7a265f9dd816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:15.007555 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253af419-f43c-4a05-aaed-d44b60464d18 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:15.009428 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b8354957-db3f-4e73-9e89-7a265f9dd816 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:15.010749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b8354957-db3f-4e73-9e89-7a265f9dd816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:15.041753 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:15.054469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b5a32-63b6-4e92-b090-4fd54a7acc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:15.055094 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b5a32-63b6-4e92-b090-4fd54a7acc93 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:15.059206 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b5a32-63b6-4e92-b090-4fd54a7acc93 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:15.059206 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b5a32-63b6-4e92-b090-4fd54a7acc93 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:15.060458 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b5a32-63b6-4e92-b090-4fd54a7acc93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:15.060771 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b5a32-63b6-4e92-b090-4fd54a7acc93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:15.064889 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b5a32-63b6-4e92-b090-4fd54a7acc93 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:15.092737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 349/707] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:15.098586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b5a32-63b6-4e92-b090-4fd54a7acc93 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:15.108878 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:15.149260 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 359/708] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:15:15.232038 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b5a32-63b6-4e92-b090-4fd54a7acc93 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:15.268291 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c24ccd-20ed-4da7-bef3-189b019992c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:15.268917 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c24ccd-20ed-4da7-bef3-189b019992c5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:15.269226 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c24ccd-20ed-4da7-bef3-189b019992c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:15.269497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c24ccd-20ed-4da7-bef3-189b019992c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:15.276853 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c24ccd-20ed-4da7-bef3-189b019992c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:15.278328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c24ccd-20ed-4da7-bef3-189b019992c5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:15.289747 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-69c24ccd-20ed-4da7-bef3-189b019992c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:15.289747 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:15.289747 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:15.289747 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:15.289747 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:15.289747 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:15.289747 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:15.289747 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:15.289747 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:15.289747 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:15.289747 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:15.289747 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:15.289747 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:15.289747 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:15.289747 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:15.291232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:15.291232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:15.291232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:15.291232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:15.291232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:15.291232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:15.291232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:15.291232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:15.291232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:15.291232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:15.291232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:15.291232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:15.291232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:15.291232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:15.291232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:15.291232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:15.291232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:15.292854 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:15.292854 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:15.292854 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:15.292854 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:15.292854 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:15.292854 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:15.292854 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:15.292854 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:15.292854 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 350/709] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:15.297351 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8354957-db3f-4e73-9e89-7a265f9dd816 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:15.442824 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8354957-db3f-4e73-9e89-7a265f9dd816 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:15.490299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec734023-69b9-4ffd-9a94-a0cdb19c704d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:15.490922 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec734023-69b9-4ffd-9a94-a0cdb19c704d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:15.491198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec734023-69b9-4ffd-9a94-a0cdb19c704d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:15.491465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec734023-69b9-4ffd-9a94-a0cdb19c704d None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:15.492212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec734023-69b9-4ffd-9a94-a0cdb19c704d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:15.492522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec734023-69b9-4ffd-9a94-a0cdb19c704d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:15.494114 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec734023-69b9-4ffd-9a94-a0cdb19c704d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:15.506735 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 360/710] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:15.513165 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c24ccd-20ed-4da7-bef3-189b019992c5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:15.585804 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:15.593919 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec734023-69b9-4ffd-9a94-a0cdb19c704d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:15.642063 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c24ccd-20ed-4da7-bef3-189b019992c5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:15.671386 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:15.678951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046f4cc-7096-471b-bad0-455677a61525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:15.682402 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046f4cc-7096-471b-bad0-455677a61525 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:15.682402 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046f4cc-7096-471b-bad0-455677a61525 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:15.682402 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046f4cc-7096-471b-bad0-455677a61525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:15.682402 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046f4cc-7096-471b-bad0-455677a61525 None admin] RBAC: Adding query filter params (role.id=f22e6e660eab44c5be25e3dee1e3042c, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=d5515accf3b64006bc41422265a641bc) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:15.682402 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046f4cc-7096-471b-bad0-455677a61525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:15.683013 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046f4cc-7096-471b-bad0-455677a61525 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:15.689095 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 351/711] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:15:15 2022] GET /identity/v3/role_assignments?user.id=d5515accf3b64006bc41422265a641bc&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=f22e6e660eab44c5be25e3dee1e3042c => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:15.787738 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec734023-69b9-4ffd-9a94-a0cdb19c704d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:15.831980 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14715f62-03f9-4059-8f11-dc250f24ed79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:15.833000 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14715f62-03f9-4059-8f11-dc250f24ed79 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:15.833508 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14715f62-03f9-4059-8f11-dc250f24ed79 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:15.833973 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14715f62-03f9-4059-8f11-dc250f24ed79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:15.846137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14715f62-03f9-4059-8f11-dc250f24ed79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:15.847871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14715f62-03f9-4059-8f11-dc250f24ed79 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:15.863560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-14715f62-03f9-4059-8f11-dc250f24ed79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:15.863560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:15.863560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:15.863560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:15.863560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:15.863560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:15.863560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:15.863560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:15.863560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:15.863560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:15.863560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:15.863560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:15.863560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:15.863560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:15.863560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:15.863560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:15.864549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:15.864549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:15.864549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:15.864549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:15.864549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:15.864549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:15.864549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:15.864549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:15.864549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:15.864549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:15.864549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:15.864549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:15.864549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:15.864549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:15.864549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:15.864549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:15.864549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:15.865464 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:15.865464 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:15.865464 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:15.867707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 361/712] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:15.874758 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046f4cc-7096-471b-bad0-455677a61525 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:15.876664 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638be60-0c01-49c0-b991-06a62376f9c9 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:15.877211 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638be60-0c01-49c0-b991-06a62376f9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:15.877689 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638be60-0c01-49c0-b991-06a62376f9c9 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:15.880493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 362/713] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:15:15.885175 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245b6b0-343c-4389-b1c8-b701317cbc4d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:15.885733 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245b6b0-343c-4389-b1c8-b701317cbc4d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:15.886209 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245b6b0-343c-4389-b1c8-b701317cbc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:15.905482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d245b6b0-343c-4389-b1c8-b701317cbc4d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:15.906972 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d245b6b0-343c-4389-b1c8-b701317cbc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:15.985301 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 363/714] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:15:16.062706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046f4cc-7096-471b-bad0-455677a61525 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:16.086919 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:16.116500 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d94b01-f1d7-4a31-b9a5-0e1784ec786b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:16.117183 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d94b01-f1d7-4a31-b9a5-0e1784ec786b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:16.117465 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d94b01-f1d7-4a31-b9a5-0e1784ec786b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:16.117733 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d94b01-f1d7-4a31-b9a5-0e1784ec786b None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:16.118461 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d94b01-f1d7-4a31-b9a5-0e1784ec786b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:16.118759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d94b01-f1d7-4a31-b9a5-0e1784ec786b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:16.120125 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d94b01-f1d7-4a31-b9a5-0e1784ec786b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:16.138116 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 352/715] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:16.143473 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245b6b0-343c-4389-b1c8-b701317cbc4d None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:16.172126 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:16.302577 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d94b01-f1d7-4a31-b9a5-0e1784ec786b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:16.322784 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245b6b0-343c-4389-b1c8-b701317cbc4d None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:16.363445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcd0da-dd8f-4e08-bcc7-9cfabc35a0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:16.364545 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcd0da-dd8f-4e08-bcc7-9cfabc35a0b8 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:16.365117 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcd0da-dd8f-4e08-bcc7-9cfabc35a0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:16.365644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcd0da-dd8f-4e08-bcc7-9cfabc35a0b8 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:16.366521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bcd0da-dd8f-4e08-bcc7-9cfabc35a0b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:16.368166 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bcd0da-dd8f-4e08-bcc7-9cfabc35a0b8 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:16.456768 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 364/716] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 5 14:15:16 2022] POST /identity/v3/users => generated 254 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:15:16.465723 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d94b01-f1d7-4a31-b9a5-0e1784ec786b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:16.515831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4e672-2c2c-4ed1-be7f-0247959e182e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:16.517313 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4e672-2c2c-4ed1-be7f-0247959e182e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:16.517797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4e672-2c2c-4ed1-be7f-0247959e182e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:16.518296 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4e672-2c2c-4ed1-be7f-0247959e182e None admin] PATH_INFO: `/v3/services/network` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:16.519138 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4e672-2c2c-4ed1-be7f-0247959e182e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:16.520873 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4e672-2c2c-4ed1-be7f-0247959e182e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:16.537111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-bcd4e672-2c2c-4ed1-be7f-0247959e182e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 14:15:16.537111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:16.537111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:15:16.537111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:15:16.537111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:15:16.537111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:15:16.537111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:15:16.537111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:16.537111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 14:15:16.537111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:16.537111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:16.537111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:16.537111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:16.537111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:16.537111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:16.537111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:16.537111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:16.538177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:16.538177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:16.538177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:16.538177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:16.538177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:16.538177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:16.538177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:15:16.538177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:15:16.538177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:15:16.538177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:15:16.538177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:16.538177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:16.538177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:16.538177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:16.538177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:16.538177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:16.539008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:16.539008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:16.539008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:16.539008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:16.539008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:16.539008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:16.539008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:16.539008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:16.539008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:16.539008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:16.539008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:15:16.539008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:16.539008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 14:15:16.539008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:16.545881 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 353/717] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:16 2022] GET /identity/v3/services/network => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:16.552091 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcd0da-dd8f-4e08-bcc7-9cfabc35a0b8 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:16.641942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:16.672840 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bcd0da-dd8f-4e08-bcc7-9cfabc35a0b8 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:16.712477 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f64b8-2f5b-4c7c-b2b1-8ea618e2be7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:16.713179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f64b8-2f5b-4c7c-b2b1-8ea618e2be7e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:16.713464 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f64b8-2f5b-4c7c-b2b1-8ea618e2be7e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:16.713738 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f64b8-2f5b-4c7c-b2b1-8ea618e2be7e None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:16.714380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f64b8-2f5b-4c7c-b2b1-8ea618e2be7e None admin] RBAC: Adding query filter params (name=network) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:16.714686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f64b8-2f5b-4c7c-b2b1-8ea618e2be7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:16.716084 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f64b8-2f5b-4c7c-b2b1-8ea618e2be7e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:16.721131 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 365/718] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 5 14:15:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:16.726273 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4e672-2c2c-4ed1-be7f-0247959e182e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:16.765764 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:16.838825 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4e672-2c2c-4ed1-be7f-0247959e182e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:16.876185 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d0211-14f2-4da3-9f48-023f727dd91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:16.876802 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d0211-14f2-4da3-9f48-023f727dd91b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:16.877125 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d0211-14f2-4da3-9f48-023f727dd91b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:16.877412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d0211-14f2-4da3-9f48-023f727dd91b None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:16.878045 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d0211-14f2-4da3-9f48-023f727dd91b None admin] RBAC: Adding query filter params (type=network) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:16.878350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d0211-14f2-4da3-9f48-023f727dd91b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:16.879810 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d0211-14f2-4da3-9f48-023f727dd91b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:16.887284 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 354/719] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 5 14:15:16 2022] GET /identity/v3/services?type=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:16.920917 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62059a-3266-48be-aa88-c023b191d05b None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:16.921242 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62059a-3266-48be-aa88-c023b191d05b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:16.921435 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62059a-3266-48be-aa88-c023b191d05b None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:16.922800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 366/720] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:16.929566 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57da9e6-104c-448d-9792-42392cc6cb05 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:16.929863 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57da9e6-104c-448d-9792-42392cc6cb05 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:16.930126 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57da9e6-104c-448d-9792-42392cc6cb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:17.075200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d57da9e6-104c-448d-9792-42392cc6cb05 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:17.076421 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d57da9e6-104c-448d-9792-42392cc6cb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:17.161230 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 355/721] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:15:17.341409 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9e397-0261-491a-abdd-b0bed9ff31e1 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:17.341939 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9e397-0261-491a-abdd-b0bed9ff31e1 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:17.341939 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9e397-0261-491a-abdd-b0bed9ff31e1 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:17.343525 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 367/722] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:17.354971 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7990ec-aa68-47d2-8ccd-0a72c9670039 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:17.355261 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7990ec-aa68-47d2-8ccd-0a72c9670039 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:17.358259 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7990ec-aa68-47d2-8ccd-0a72c9670039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:17.383477 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6b7990ec-aa68-47d2-8ccd-0a72c9670039 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:17.384810 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6b7990ec-aa68-47d2-8ccd-0a72c9670039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:17.411370 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:17.468594 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 356/723] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 14:15:17.478394 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9e397-0261-491a-abdd-b0bed9ff31e1 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:17.615933 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9e397-0261-491a-abdd-b0bed9ff31e1 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:17.666876 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cae4e-5e6a-45c3-a2f0-aba6e71468c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:17.667509 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cae4e-5e6a-45c3-a2f0-aba6e71468c2 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:17.667784 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cae4e-5e6a-45c3-a2f0-aba6e71468c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:17.668051 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cae4e-5e6a-45c3-a2f0-aba6e71468c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:17.670848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:17.683552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7cae4e-5e6a-45c3-a2f0-aba6e71468c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:15:17.688353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-4b7cae4e-5e6a-45c3-a2f0-aba6e71468c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:15:17.688353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:17.688353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:17.688353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:17.688353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:17.688353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:17.688353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:17.688353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:17.688353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:17.688353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:17.688353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:17.688353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:17.688353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:15:17.688353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:15:17.688353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:15:17.688353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:15:17.689322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:15:17.689322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:15:17.689322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:15:17.689322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:15:17.689322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:17.689322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:17.689322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:17.689322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:17.689322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:17.689322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:17.689322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:17.689322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:17.689322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:17.689322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:17.689322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:17.689322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:17.690886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:17.690886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:17.690886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:17.690886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:17.690886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:15:17.690886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:15:17.690886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:15:17.690886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:15:17.690886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:15:17.690886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:15:17.690886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:15:17.690886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:17.690886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 368/724] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:15:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:17.695464 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7990ec-aa68-47d2-8ccd-0a72c9670039 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:17.827600 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7990ec-aa68-47d2-8ccd-0a72c9670039 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:17.868750 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab9d5b-ecf7-4f23-9361-8070343faf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:17.869341 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab9d5b-ecf7-4f23-9361-8070343faf9f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:17.869625 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab9d5b-ecf7-4f23-9361-8070343faf9f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:17.869903 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab9d5b-ecf7-4f23-9361-8070343faf9f None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:17.870635 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab9d5b-ecf7-4f23-9361-8070343faf9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:17.870946 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab9d5b-ecf7-4f23-9361-8070343faf9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:17.872319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab9d5b-ecf7-4f23-9361-8070343faf9f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:17.881303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 357/725] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:15:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:17.886975 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cae4e-5e6a-45c3-a2f0-aba6e71468c2 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:17.912665 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab9d5b-ecf7-4f23-9361-8070343faf9f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:17.952710 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:18.070312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cae4e-5e6a-45c3-a2f0-aba6e71468c2 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:18.083116 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab9d5b-ecf7-4f23-9361-8070343faf9f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:18.107371 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ed1a7-7c87-4ccf-b49f-fb4250a80883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:18.108002 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ed1a7-7c87-4ccf-b49f-fb4250a80883 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:18.108278 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ed1a7-7c87-4ccf-b49f-fb4250a80883 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:18.108549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ed1a7-7c87-4ccf-b49f-fb4250a80883 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:18.120017 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ed1a7-7c87-4ccf-b49f-fb4250a80883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:18.121443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ed1a7-7c87-4ccf-b49f-fb4250a80883 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:18.125452 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df0d0e-41f5-4a68-86f4-12b76585b6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:18.126060 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df0d0e-41f5-4a68-86f4-12b76585b6d4 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:18.126335 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df0d0e-41f5-4a68-86f4-12b76585b6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:18.126601 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df0d0e-41f5-4a68-86f4-12b76585b6d4 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:18.127253 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df0d0e-41f5-4a68-86f4-12b76585b6d4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:18.129006 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df0d0e-41f5-4a68-86f4-12b76585b6d4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:18.136379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-b23ed1a7-7c87-4ccf-b49f-fb4250a80883 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:18.136379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:18.136379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:18.136379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:18.136379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:18.136379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:18.136379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:18.136379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:18.136379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:18.136379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:18.136379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:18.136379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:18.136379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:18.136379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:18.136379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:18.136379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:18.137530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:18.137530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:18.137530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:18.137530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:18.137530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:18.137530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:18.137530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:18.137530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:18.137530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:18.137530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:18.137530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:18.137530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:18.137530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:18.137530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:18.137530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:18.137530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:18.137530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:18.138624 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:18.138624 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:18.138624 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:18.138624 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 369/726] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:18.139159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d6170-f14e-4748-bc88-4d696e38d324 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:18.139159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d6170-f14e-4748-bc88-4d696e38d324 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:18.139369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d6170-f14e-4748-bc88-4d696e38d324 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:18.144454 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 370/727] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:18.145224 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d6170-f14e-4748-bc88-4d696e38d324 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:18.209291 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:18.210022 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 358/728] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 5 14:15:17 2022] POST /identity/v3/services => generated 251 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:15:18.211993 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bb965-ed33-42cd-b8cf-c7b8e0cd1287 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:18.212674 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bb965-ed33-42cd-b8cf-c7b8e0cd1287 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:18.217350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bb965-ed33-42cd-b8cf-c7b8e0cd1287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:18.251281 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e24bb965-ed33-42cd-b8cf-c7b8e0cd1287 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:18.261424 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e24bb965-ed33-42cd-b8cf-c7b8e0cd1287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:18.277675 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d6170-f14e-4748-bc88-4d696e38d324 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:18.368032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325a0a4-ba2e-4182-99dd-b9492ead7373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:18.370146 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325a0a4-ba2e-4182-99dd-b9492ead7373 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:18.370373 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325a0a4-ba2e-4182-99dd-b9492ead7373 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:18.370647 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325a0a4-ba2e-4182-99dd-b9492ead7373 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:18.371307 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325a0a4-ba2e-4182-99dd-b9492ead7373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:18.371611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325a0a4-ba2e-4182-99dd-b9492ead7373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:18.373113 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325a0a4-ba2e-4182-99dd-b9492ead7373 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:18.403907 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 371/729] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:18.408139 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325a0a4-ba2e-4182-99dd-b9492ead7373 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:18.422143 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 359/730] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:15:18.554264 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325a0a4-ba2e-4182-99dd-b9492ead7373 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:18.557153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:18.596443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849aecd-c4f3-4885-b7bb-bce2a511d269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:18.597467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849aecd-c4f3-4885-b7bb-bce2a511d269 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:18.597942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849aecd-c4f3-4885-b7bb-bce2a511d269 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:18.598405 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849aecd-c4f3-4885-b7bb-bce2a511d269 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:18.610727 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849aecd-c4f3-4885-b7bb-bce2a511d269 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:18.612457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849aecd-c4f3-4885-b7bb-bce2a511d269 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:18.627216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-8849aecd-c4f3-4885-b7bb-bce2a511d269 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 14:15:18.627216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:18.627216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:18.627216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:18.627216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:18.627216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:18.627216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:18.627216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:18.627216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:18.627216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:18.627216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:18.627216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:18.627216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:18.627216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:18.627216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:18.627216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:18.628153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:18.628153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:18.628153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:18.628153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:18.628153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:18.628153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:18.628153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:18.628153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:18.628153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:18.628153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:18.628153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:18.628153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:18.628153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:18.628153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:18.628153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:18.628153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:18.628153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:18.628153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:18.629106 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:18.629106 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:18.629106 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:18.629106 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:18.629106 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:18.629106 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:18.629106 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:18.629106 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:18.629106 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 14:15:18.629106 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:18.631276 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 372/731] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:15:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:18.637111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bb965-ed33-42cd-b8cf-c7b8e0cd1287 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:18.663315 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:18.779204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849aecd-c4f3-4885-b7bb-bce2a511d269 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:18.790821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bb965-ed33-42cd-b8cf-c7b8e0cd1287 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:18.854474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be584fe2-672a-4795-9db6-e895610836e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:18.855186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be584fe2-672a-4795-9db6-e895610836e0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:18.855468 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be584fe2-672a-4795-9db6-e895610836e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:18.855741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be584fe2-672a-4795-9db6-e895610836e0 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:18.856474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be584fe2-672a-4795-9db6-e895610836e0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:18.856778 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be584fe2-672a-4795-9db6-e895610836e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:18.858349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be584fe2-672a-4795-9db6-e895610836e0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:18.896972 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 360/732] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Sep 5 14:15:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:18.898939 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849aecd-c4f3-4885-b7bb-bce2a511d269 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:18.902547 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be584fe2-672a-4795-9db6-e895610836e0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:18.940102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835c908-26ad-420f-9d4f-9e2c01df9101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:18.940741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835c908-26ad-420f-9d4f-9e2c01df9101 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:18.941020 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835c908-26ad-420f-9d4f-9e2c01df9101 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:18.941322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835c908-26ad-420f-9d4f-9e2c01df9101 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:18.953801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835c908-26ad-420f-9d4f-9e2c01df9101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:15:18.959697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-5835c908-26ad-420f-9d4f-9e2c01df9101 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:15:18.959697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:18.959697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:18.959697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:18.959697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:18.959697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:18.959697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:18.959697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:18.959697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:18.959697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:18.959697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:18.959697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:18.959697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:15:18.959697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:15:18.959697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:15:18.959697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:15:18.960633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:15:18.960633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:15:18.960633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:15:18.960633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:15:18.960633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:18.960633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:18.960633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:18.960633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:18.960633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:18.960633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:18.960633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:18.960633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:18.960633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:18.960633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:18.960633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:18.960633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:18.961483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:18.961483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:18.961483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:18.961483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:18.961483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:15:18.961483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:15:18.961483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:15:18.961483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:15:18.961483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:15:18.961483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:15:18.961483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:15:18.961483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:18.961483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 373/733] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:15:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:18.967958 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835c908-26ad-420f-9d4f-9e2c01df9101 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:18.999482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:19.074392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:19.106552 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be584fe2-672a-4795-9db6-e895610836e0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:19.121372 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835c908-26ad-420f-9d4f-9e2c01df9101 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:19.169573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62925700-67be-48ee-a47b-3de1fb7b7460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:19.169764 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474a03d-e36f-4868-8ff4-ea4f6b7ab4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:19.170092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62925700-67be-48ee-a47b-3de1fb7b7460 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:19.170219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474a03d-e36f-4868-8ff4-ea4f6b7ab4cf None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:19.170388 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62925700-67be-48ee-a47b-3de1fb7b7460 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:19.170481 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474a03d-e36f-4868-8ff4-ea4f6b7ab4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:19.170622 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62925700-67be-48ee-a47b-3de1fb7b7460 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:19.170711 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474a03d-e36f-4868-8ff4-ea4f6b7ab4cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:19.171283 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62925700-67be-48ee-a47b-3de1fb7b7460 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:19.171580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62925700-67be-48ee-a47b-3de1fb7b7460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:19.172946 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62925700-67be-48ee-a47b-3de1fb7b7460 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:19.182212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 374/734] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:15:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:19.187643 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62925700-67be-48ee-a47b-3de1fb7b7460 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:19.273872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474a03d-e36f-4868-8ff4-ea4f6b7ab4cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:19.276075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474a03d-e36f-4868-8ff4-ea4f6b7ab4cf None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:19.303421 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:19.320606 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62925700-67be-48ee-a47b-3de1fb7b7460 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:19.344237 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:19.358964 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d3b26-3554-4642-a640-f6c37577c96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:19.359587 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d3b26-3554-4642-a640-f6c37577c96c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:19.359861 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d3b26-3554-4642-a640-f6c37577c96c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:19.360127 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d3b26-3554-4642-a640-f6c37577c96c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:19.370767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d3b26-3554-4642-a640-f6c37577c96c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:19.372225 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d3b26-3554-4642-a640-f6c37577c96c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:19.378312 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 361/735] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:15:18 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 14:15:19.379638 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ca61f-1593-4add-82d9-6b3c92fcb971 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:19.380386 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ca61f-1593-4add-82d9-6b3c92fcb971 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:19.380659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ca61f-1593-4add-82d9-6b3c92fcb971 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:19.386268 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 362/736] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:19.386268 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e361fbb-0f2f-427a-937a-e6dd0cf9e610 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:19.386268 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e361fbb-0f2f-427a-937a-e6dd0cf9e610 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:19.386268 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e361fbb-0f2f-427a-937a-e6dd0cf9e610 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:19.386268 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 363/737] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:19.386268 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e361fbb-0f2f-427a-937a-e6dd0cf9e610 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:19.398182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-d90d3b26-3554-4642-a640-f6c37577c96c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:19.398182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:19.398182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:19.398182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:19.398182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:19.398182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:19.398182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:19.398182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:19.398182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:19.398182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:19.398182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:19.398182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:19.398182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:19.398182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:19.398182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:19.398182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:19.399950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:19.399950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:19.399950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:19.399950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:19.399950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:19.399950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:19.399950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:19.399950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:19.399950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:19.399950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:19.399950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:19.399950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:19.399950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:19.399950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:19.399950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:19.399950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:19.399950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:19.400863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:19.400863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:19.400863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:19.400863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 375/738] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:19.401496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be781d9-530f-4ec9-821c-eab4f025e2e6 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:19.401496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be781d9-530f-4ec9-821c-eab4f025e2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:19.401731 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be781d9-530f-4ec9-821c-eab4f025e2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:19.419257 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-7be781d9-530f-4ec9-821c-eab4f025e2e6 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:19.420478 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7be781d9-530f-4ec9-821c-eab4f025e2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:19.505092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 376/739] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:15:19.505092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e75c6-fa9b-4600-9da5-c9c706ee735d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:19.505092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e75c6-fa9b-4600-9da5-c9c706ee735d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:19.505092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e75c6-fa9b-4600-9da5-c9c706ee735d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:19.518945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-830e75c6-fa9b-4600-9da5-c9c706ee735d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:19.520162 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-830e75c6-fa9b-4600-9da5-c9c706ee735d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:19.558331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e361fbb-0f2f-427a-937a-e6dd0cf9e610 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:19.596055 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:19.599395 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30fa02-a43c-4da4-8f4e-be8f8975fd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:19.600180 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30fa02-a43c-4da4-8f4e-be8f8975fd75 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:19.600555 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30fa02-a43c-4da4-8f4e-be8f8975fd75 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:19.600963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30fa02-a43c-4da4-8f4e-be8f8975fd75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:19.604038 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 377/740] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 14:15:19.605267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e75c6-fa9b-4600-9da5-c9c706ee735d None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:19.626254 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30fa02-a43c-4da4-8f4e-be8f8975fd75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:19.627741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30fa02-a43c-4da4-8f4e-be8f8975fd75 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:19.661131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-1b30fa02-a43c-4da4-8f4e-be8f8975fd75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:19.661131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:19.661131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:19.661131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:19.661131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:19.661131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:19.661131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:19.661131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:19.661131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:19.661131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:19.661131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:19.661131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:19.661131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:19.661131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:19.661131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:19.661131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:19.662139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:19.662139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:19.662139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:19.662139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:19.662139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:19.662139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:19.662139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:19.662139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:19.662139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:19.662139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:19.662139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:19.662139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:19.662139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:19.662139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:19.662139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:19.662139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:19.662139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:19.663024 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:19.663024 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:19.663024 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:19.667184 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 364/741] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:19.673198 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30fa02-a43c-4da4-8f4e-be8f8975fd75 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:19.720105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:19.778314 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e75c6-fa9b-4600-9da5-c9c706ee735d None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:19.809732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30fa02-a43c-4da4-8f4e-be8f8975fd75 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:19.835570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17089b3e-ad70-4b79-9d48-efb659e10b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:19.836474 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17089b3e-ad70-4b79-9d48-efb659e10b29 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:19.837033 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17089b3e-ad70-4b79-9d48-efb659e10b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:19.837529 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17089b3e-ad70-4b79-9d48-efb659e10b29 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:19.838818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17089b3e-ad70-4b79-9d48-efb659e10b29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:19.839467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17089b3e-ad70-4b79-9d48-efb659e10b29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:19.841326 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17089b3e-ad70-4b79-9d48-efb659e10b29 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:19.854940 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94586774-31b4-41c9-8e92-f40af3a39ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:19.855543 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94586774-31b4-41c9-8e92-f40af3a39ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:19.855819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94586774-31b4-41c9-8e92-f40af3a39ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:19.856085 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94586774-31b4-41c9-8e92-f40af3a39ba4 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:19.856715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94586774-31b4-41c9-8e92-f40af3a39ba4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:19.857137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94586774-31b4-41c9-8e92-f40af3a39ba4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:19.861759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94586774-31b4-41c9-8e92-f40af3a39ba4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:19.861894 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 378/742] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:19.861976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17089b3e-ad70-4b79-9d48-efb659e10b29 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:19.875091 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 365/743] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:19.876317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94586774-31b4-41c9-8e92-f40af3a39ba4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:19.925371 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:19.964629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:19.972302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17089b3e-ad70-4b79-9d48-efb659e10b29 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:19.983425 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94586774-31b4-41c9-8e92-f40af3a39ba4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:20.015973 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb436061-7bf5-44b7-81e6-b70a2d2b1b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:20.016789 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb436061-7bf5-44b7-81e6-b70a2d2b1b75 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:20.017126 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb436061-7bf5-44b7-81e6-b70a2d2b1b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:20.017356 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb436061-7bf5-44b7-81e6-b70a2d2b1b75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:20.019450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d558435-e5d2-466d-b044-d677ae7017b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:20.020089 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d558435-e5d2-466d-b044-d677ae7017b6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:20.020370 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d558435-e5d2-466d-b044-d677ae7017b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:20.020643 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d558435-e5d2-466d-b044-d677ae7017b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:20.028636 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d558435-e5d2-466d-b044-d677ae7017b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:20.029462 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb436061-7bf5-44b7-81e6-b70a2d2b1b75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:15:20.030115 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d558435-e5d2-466d-b044-d677ae7017b6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:20.035039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-cb436061-7bf5-44b7-81e6-b70a2d2b1b75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:20.035039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:20.035039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:20.035039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:20.035039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:20.035039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:20.035039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:20.035039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:20.035039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:20.035039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:20.035039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:20.035039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:20.035039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:15:20.035039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:15:20.035039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:15:20.035039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:15:20.035961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:15:20.035961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:15:20.035961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:15:20.035961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:15:20.035961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:20.035961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:20.035961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:20.035961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:20.035961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:20.035961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:20.035961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:20.035961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:20.035961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:20.035961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:20.035961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:20.035961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:20.036793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:20.036793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:20.036793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:20.036793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:20.036793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:15:20.036793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:15:20.036793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:15:20.036793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:15:20.036793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:15:20.036793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:15:20.036793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:20.036793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:20.038534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 379/744] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:15:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:20.042001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-0d558435-e5d2-466d-b044-d677ae7017b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 14:15:20.042001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:20.042001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:20.042001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:20.042001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:20.042001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:20.042001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:20.042001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:20.042001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:20.042001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:20.042001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:20.042001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:20.042001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:20.042001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:20.042001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:20.042001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:20.042879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:20.042879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:20.042879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:20.042879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:20.042879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:20.042879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:20.042879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:20.042879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:20.042879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:20.042879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:20.042879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:20.042879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:20.042879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:20.042879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:20.042879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:20.042879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:20.042879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:20.042879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:20.049717 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:20.049717 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:20.049717 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:20.049717 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:20.049717 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:20.049717 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:20.049717 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:20.049717 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:20.049717 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 14:15:20.049717 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:20.049717 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 366/745] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 5 14:15:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:20.051505 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb436061-7bf5-44b7-81e6-b70a2d2b1b75 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:20.051613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d558435-e5d2-466d-b044-d677ae7017b6 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:20.153435 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d558435-e5d2-466d-b044-d677ae7017b6 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:20.154685 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb436061-7bf5-44b7-81e6-b70a2d2b1b75 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:20.172938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:20.190663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd411a43-5e3e-42e7-ac1f-351e29358a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:20.191222 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd411a43-5e3e-42e7-ac1f-351e29358a4b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:20.191505 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd411a43-5e3e-42e7-ac1f-351e29358a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:20.191785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd411a43-5e3e-42e7-ac1f-351e29358a4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:20.193300 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48e402-a3a4-4dea-9052-142e8567cf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:20.194101 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48e402-a3a4-4dea-9052-142e8567cf69 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:20.194564 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48e402-a3a4-4dea-9052-142e8567cf69 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:20.195037 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48e402-a3a4-4dea-9052-142e8567cf69 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:20.195856 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48e402-a3a4-4dea-9052-142e8567cf69 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:20.197483 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48e402-a3a4-4dea-9052-142e8567cf69 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:20.198748 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd411a43-5e3e-42e7-ac1f-351e29358a4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:20.200232 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd411a43-5e3e-42e7-ac1f-351e29358a4b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:20.212618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-fd411a43-5e3e-42e7-ac1f-351e29358a4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:20.212618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:20.212618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:20.212618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:20.212618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:20.212618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:20.212618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:20.212618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:20.212618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:20.212618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:20.212618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:20.212618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:20.212618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:20.212618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:20.212618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:20.213866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:20.213866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:20.213866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:20.213866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:20.213866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:20.213866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:20.213866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:20.213866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:20.213866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:20.213866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:20.213866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:20.213866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:20.213866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:20.213866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:20.213866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:20.213866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:20.213866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:20.215057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:20.215057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:20.215057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:20.215057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:20.215057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:20.215057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:20.215057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:20.215057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:20.215057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 380/746] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:20.215057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd411a43-5e3e-42e7-ac1f-351e29358a4b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:20.269352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 367/747] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 5 14:15:20 2022] POST /identity/v3/services => generated 240 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:15:20.270308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48e402-a3a4-4dea-9052-142e8567cf69 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:20.291373 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:20.336234 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd411a43-5e3e-42e7-ac1f-351e29358a4b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:20.392306 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1b3e2-4e62-4344-af6c-1b0cf02bb4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:20.392943 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1b3e2-4e62-4344-af6c-1b0cf02bb4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:20.393975 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1b3e2-4e62-4344-af6c-1b0cf02bb4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:20.394254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1b3e2-4e62-4344-af6c-1b0cf02bb4f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:20.394999 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1b3e2-4e62-4344-af6c-1b0cf02bb4f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:20.395426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1b3e2-4e62-4344-af6c-1b0cf02bb4f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:20.396648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1b3e2-4e62-4344-af6c-1b0cf02bb4f5 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:20.412567 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 381/748] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 5 14:15:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:20.413573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1b3e2-4e62-4344-af6c-1b0cf02bb4f5 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:20.436319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48e402-a3a4-4dea-9052-142e8567cf69 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:20.462564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:20.481105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16041084-4c77-48d9-96fc-2cf32a848d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:20.482027 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16041084-4c77-48d9-96fc-2cf32a848d2d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:20.482383 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16041084-4c77-48d9-96fc-2cf32a848d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:20.482758 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16041084-4c77-48d9-96fc-2cf32a848d2d None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:20.483533 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16041084-4c77-48d9-96fc-2cf32a848d2d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:20.483997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16041084-4c77-48d9-96fc-2cf32a848d2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:20.485471 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16041084-4c77-48d9-96fc-2cf32a848d2d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:20.510357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 368/749] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 5 14:15:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:20.511194 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16041084-4c77-48d9-96fc-2cf32a848d2d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:20.548554 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1b3e2-4e62-4344-af6c-1b0cf02bb4f5 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:20.573173 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:20.585844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ceb9ec-70d5-43fd-98b5-ceb9dfb70001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:20.586448 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ceb9ec-70d5-43fd-98b5-ceb9dfb70001 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:20.589751 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ceb9ec-70d5-43fd-98b5-ceb9dfb70001 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:20.589751 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ceb9ec-70d5-43fd-98b5-ceb9dfb70001 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:20.589751 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ceb9ec-70d5-43fd-98b5-ceb9dfb70001 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:20.589751 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ceb9ec-70d5-43fd-98b5-ceb9dfb70001 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:20.590116 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ceb9ec-70d5-43fd-98b5-ceb9dfb70001 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:20.602020 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 382/750] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:20.604129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef6b41-4dad-4e48-a721-9a1257bf89d1 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:20.604508 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef6b41-4dad-4e48-a721-9a1257bf89d1 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:20.604879 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef6b41-4dad-4e48-a721-9a1257bf89d1 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:20.606441 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 383/751] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:20.607040 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef6b41-4dad-4e48-a721-9a1257bf89d1 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:20.623415 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16041084-4c77-48d9-96fc-2cf32a848d2d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:20.660493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ab557-008f-407d-b6b4-ed1b73de62f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:20.661309 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ab557-008f-407d-b6b4-ed1b73de62f2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:20.661585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ab557-008f-407d-b6b4-ed1b73de62f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:20.661960 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ab557-008f-407d-b6b4-ed1b73de62f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:20.674709 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ab557-008f-407d-b6b4-ed1b73de62f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:20.676400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ab557-008f-407d-b6b4-ed1b73de62f2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:20.691819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-df1ab557-008f-407d-b6b4-ed1b73de62f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:20.691819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:20.691819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:20.691819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:20.691819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:20.691819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:20.691819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:20.691819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:20.691819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:20.691819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:20.691819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:20.691819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:20.691819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:20.691819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:20.691819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:20.691819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:20.692812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:20.692812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:20.692812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:20.692812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:20.692812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:20.692812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:20.692812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:20.692812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:20.692812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:20.692812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:20.692812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:20.692812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:20.692812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:20.692812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:20.692812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:20.692812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:20.692812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:20.693758 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:20.693758 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:20.693758 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:20.693758 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 369/752] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:20.694021 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ab557-008f-407d-b6b4-ed1b73de62f2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:20.714289 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:20.723668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef6b41-4dad-4e48-a721-9a1257bf89d1 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:20.760660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f7aac-7fde-4d1a-ba57-ffabc4ada95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:20.761326 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f7aac-7fde-4d1a-ba57-ffabc4ada95b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:20.761617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f7aac-7fde-4d1a-ba57-ffabc4ada95b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:20.761874 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f7aac-7fde-4d1a-ba57-ffabc4ada95b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:20.772080 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f7aac-7fde-4d1a-ba57-ffabc4ada95b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:20.773570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f7aac-7fde-4d1a-ba57-ffabc4ada95b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:20.788801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-852f7aac-7fde-4d1a-ba57-ffabc4ada95b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:20.788801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:20.788801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:20.788801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:20.788801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:20.788801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:20.788801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:20.788801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:20.788801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:20.788801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:20.788801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:20.788801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:20.788801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:20.788801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:20.788801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:20.788801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:20.789820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:20.789820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:20.789820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:20.789820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:20.789820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:20.789820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:20.789820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:20.789820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:20.789820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:20.789820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:20.789820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:20.789820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:20.789820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:20.789820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:20.789820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:20.789820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:20.789820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:20.791235 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:20.791235 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:20.791235 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:20.791235 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 384/753] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:20.792400 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e25c77-4708-462e-80f8-3966a9d229af None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:20.792885 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e25c77-4708-462e-80f8-3966a9d229af None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:20.793402 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e25c77-4708-462e-80f8-3966a9d229af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:20.811484 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-87e25c77-4708-462e-80f8-3966a9d229af None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:20.812677 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-87e25c77-4708-462e-80f8-3966a9d229af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:20.815770 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ab557-008f-407d-b6b4-ed1b73de62f2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:20.830437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:20.853457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d3e4c-9cd6-4589-a8f9-978cc1b8eb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:20.854276 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d3e4c-9cd6-4589-a8f9-978cc1b8eb47 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:20.854552 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d3e4c-9cd6-4589-a8f9-978cc1b8eb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:20.854823 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d3e4c-9cd6-4589-a8f9-978cc1b8eb47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:20.855899 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d3e4c-9cd6-4589-a8f9-978cc1b8eb47 None admin] RBAC: Adding query filter params (role.id=f22e6e660eab44c5be25e3dee1e3042c, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=1ed60e9eecb94ef39c2f4a5e5f50d670) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:20.855899 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d3e4c-9cd6-4589-a8f9-978cc1b8eb47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:20.857294 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d3e4c-9cd6-4589-a8f9-978cc1b8eb47 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:20.862744 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 370/754] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:15:20 2022] GET /identity/v3/role_assignments?user.id=1ed60e9eecb94ef39c2f4a5e5f50d670&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=f22e6e660eab44c5be25e3dee1e3042c => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:20.863344 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d3e4c-9cd6-4589-a8f9-978cc1b8eb47 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:20.901085 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 385/755] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:20.901085 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e25c77-4708-462e-80f8-3966a9d229af None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:20.997896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:21.036004 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e25c77-4708-462e-80f8-3966a9d229af None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:21.047881 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d3e4c-9cd6-4589-a8f9-978cc1b8eb47 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:21.081445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0d333-8286-4c0a-baf9-465fcade1dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:21.082852 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0d333-8286-4c0a-baf9-465fcade1dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:21.083332 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0d333-8286-4c0a-baf9-465fcade1dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:21.083798 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0d333-8286-4c0a-baf9-465fcade1dc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:21.084698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0d333-8286-4c0a-baf9-465fcade1dc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:21.085250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0d333-8286-4c0a-baf9-465fcade1dc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:21.087571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0d333-8286-4c0a-baf9-465fcade1dc4 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:21.100139 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 386/756] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:21.107431 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0d333-8286-4c0a-baf9-465fcade1dc4 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:21.122924 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4192f-07fa-4b14-831b-200581dad710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:21.123537 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4192f-07fa-4b14-831b-200581dad710 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:21.123816 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4192f-07fa-4b14-831b-200581dad710 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:21.124139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4192f-07fa-4b14-831b-200581dad710 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:21.124783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4192f-07fa-4b14-831b-200581dad710 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:21.125104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4192f-07fa-4b14-831b-200581dad710 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:21.126706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4192f-07fa-4b14-831b-200581dad710 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:21.148626 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 371/757] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:21.154492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4192f-07fa-4b14-831b-200581dad710 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:21.211682 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:21.217561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0d333-8286-4c0a-baf9-465fcade1dc4 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:21.262443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34167b25-62b9-433b-8fbc-bbc5291b3bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:21.263506 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34167b25-62b9-433b-8fbc-bbc5291b3bed None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:21.263999 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34167b25-62b9-433b-8fbc-bbc5291b3bed None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:21.264488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34167b25-62b9-433b-8fbc-bbc5291b3bed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:21.272211 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34167b25-62b9-433b-8fbc-bbc5291b3bed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:21.274093 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34167b25-62b9-433b-8fbc-bbc5291b3bed None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:21.282124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4192f-07fa-4b14-831b-200581dad710 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:21.287749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-34167b25-62b9-433b-8fbc-bbc5291b3bed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:21.287749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:21.287749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:21.287749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:21.287749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:21.287749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:21.287749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:21.287749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:21.287749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:21.287749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:21.287749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:21.287749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:21.287749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:21.287749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:21.287749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:21.288716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:21.288716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:21.288716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:21.288716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:21.288716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:21.288716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:21.288716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:21.288716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:21.288716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:21.288716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:21.288716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:21.288716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:21.288716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:21.288716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:21.288716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:21.288716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:21.288716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:21.289679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:21.289679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:21.289679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:21.289679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:21.289679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:21.289679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:21.289679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:21.289679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:21.293011 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 387/758] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:21.294072 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34167b25-62b9-433b-8fbc-bbc5291b3bed None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:21.294847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:21.324521 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7e4fc-0301-4a9a-a07d-f340371a5cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:21.325100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7e4fc-0301-4a9a-a07d-f340371a5cff None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:21.325683 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7e4fc-0301-4a9a-a07d-f340371a5cff None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:21.325960 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7e4fc-0301-4a9a-a07d-f340371a5cff None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:21.334176 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7e4fc-0301-4a9a-a07d-f340371a5cff None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:21.335616 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7e4fc-0301-4a9a-a07d-f340371a5cff None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:21.349505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-64c7e4fc-0301-4a9a-a07d-f340371a5cff None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 14:15:21.349505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:21.349505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:21.349505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:21.349505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:21.349505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:21.349505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:21.349505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:21.349505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:21.349505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:21.349505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:21.349505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:21.349505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:21.349505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:21.349505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:21.349505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:21.350489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:21.350489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:21.350489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:21.350489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:21.350489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:21.350489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:21.350489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:21.350489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:21.350489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:21.350489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:21.350489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:21.350489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:21.350489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:21.350489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:21.350489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:21.350489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:21.350489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:21.350489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:21.351454 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:21.351454 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:21.351454 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:21.351454 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:21.351454 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:21.351454 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:21.351454 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:21.351454 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:21.351454 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 14:15:21.351454 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:21.355475 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 372/759] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 5 14:15:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:21.356481 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7e4fc-0301-4a9a-a07d-f340371a5cff None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:21.417261 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34167b25-62b9-433b-8fbc-bbc5291b3bed None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:21.455748 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f5785-ca7b-4d89-9053-74d8b4ed2e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:21.456818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f5785-ca7b-4d89-9053-74d8b4ed2e67 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:21.457457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:21.458915 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f5785-ca7b-4d89-9053-74d8b4ed2e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:21.459427 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f5785-ca7b-4d89-9053-74d8b4ed2e67 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:21.460273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f5785-ca7b-4d89-9053-74d8b4ed2e67 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:21.461949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f5785-ca7b-4d89-9053-74d8b4ed2e67 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:21.463664 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7e4fc-0301-4a9a-a07d-f340371a5cff None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:21.471818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-5e9f5785-ca7b-4d89-9053-74d8b4ed2e67 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 14:15:21.471818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:21.471818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:15:21.471818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:15:21.471818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:15:21.471818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:15:21.471818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:15:21.471818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:21.471818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 14:15:21.471818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:21.471818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:21.471818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:21.471818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:21.471818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:21.471818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:21.471818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:21.471818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:21.479635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:21.479635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:21.479635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:21.479635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:21.479635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:21.479635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:21.479635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:15:21.479635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:15:21.479635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:15:21.479635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:15:21.479635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:21.479635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:21.479635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:21.479635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:21.479635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:21.479635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:21.480492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:21.480492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:21.480492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:21.480492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:21.480492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:21.480492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:21.480492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:21.480492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:21.480492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:21.480492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:21.480492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:15:21.480492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:21.480492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 14:15:21.480492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:21.481886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 388/760] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Sep 5 14:15:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:21.482982 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f5785-ca7b-4d89-9053-74d8b4ed2e67 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:21.500143 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a80b4-c622-48c3-b6dc-e73c1abfac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:21.500825 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a80b4-c622-48c3-b6dc-e73c1abfac23 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:21.501266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a80b4-c622-48c3-b6dc-e73c1abfac23 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:21.501430 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a80b4-c622-48c3-b6dc-e73c1abfac23 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:21.502141 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a80b4-c622-48c3-b6dc-e73c1abfac23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:21.502848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a80b4-c622-48c3-b6dc-e73c1abfac23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:21.504954 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a80b4-c622-48c3-b6dc-e73c1abfac23 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:21.523824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 373/761] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:21.524849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a80b4-c622-48c3-b6dc-e73c1abfac23 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:21.599800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f5785-ca7b-4d89-9053-74d8b4ed2e67 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:21.613449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:21.636587 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87c5fb-a3be-4a2a-a40c-8f424fa9035c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:21.637253 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a80b4-c622-48c3-b6dc-e73c1abfac23 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:21.637616 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87c5fb-a3be-4a2a-a40c-8f424fa9035c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:21.638041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87c5fb-a3be-4a2a-a40c-8f424fa9035c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:21.638456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87c5fb-a3be-4a2a-a40c-8f424fa9035c None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:21.640469 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87c5fb-a3be-4a2a-a40c-8f424fa9035c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:21.640469 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87c5fb-a3be-4a2a-a40c-8f424fa9035c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:21.641519 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87c5fb-a3be-4a2a-a40c-8f424fa9035c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:21.660459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 389/762] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Sep 5 14:15:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:21.664132 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87c5fb-a3be-4a2a-a40c-8f424fa9035c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:21.686373 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04b2d1-f689-4204-88e6-bd1988aa8a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:21.686979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04b2d1-f689-4204-88e6-bd1988aa8a89 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:21.687307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04b2d1-f689-4204-88e6-bd1988aa8a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:21.687578 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04b2d1-f689-4204-88e6-bd1988aa8a89 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:21.688236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04b2d1-f689-4204-88e6-bd1988aa8a89 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:21.688541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04b2d1-f689-4204-88e6-bd1988aa8a89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:21.690491 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04b2d1-f689-4204-88e6-bd1988aa8a89 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:21.696109 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 374/763] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Sep 5 14:15:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:21.698455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04b2d1-f689-4204-88e6-bd1988aa8a89 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:21.730524 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:21.798170 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87c5fb-a3be-4a2a-a40c-8f424fa9035c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:21.817947 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04b2d1-f689-4204-88e6-bd1988aa8a89 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:21.821508 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:21.844902 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9c4a3-6974-4d95-ac9e-dcb1f0eee9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:21.846230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9c4a3-6974-4d95-ac9e-dcb1f0eee9e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:21.846764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9c4a3-6974-4d95-ac9e-dcb1f0eee9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:21.847652 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9c4a3-6974-4d95-ac9e-dcb1f0eee9e9 None admin] PATH_INFO: `/v3/projects/975f49bcc95643fe876cc03d0d731423/users/d5515accf3b64006bc41422265a641bc/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:21.850878 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9c4a3-6974-4d95-ac9e-dcb1f0eee9e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=975f49bcc95643fe876cc03d0d731423, user_id=d5515accf3b64006bc41422265a641bc, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:21.853476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9c4a3-6974-4d95-ac9e-dcb1f0eee9e9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:21.855981 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223317e-b781-47a3-9459-b022f8f405dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:21.856749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223317e-b781-47a3-9459-b022f8f405dd None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:21.857033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223317e-b781-47a3-9459-b022f8f405dd None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:21.857346 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223317e-b781-47a3-9459-b022f8f405dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:21.928372 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223317e-b781-47a3-9459-b022f8f405dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:21.930023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223317e-b781-47a3-9459-b022f8f405dd None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:21.940835 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 390/764] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:15:21 2022] PUT /identity/v3/projects/975f49bcc95643fe876cc03d0d731423/users/d5515accf3b64006bc41422265a641bc/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:15:21.940835 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9c4a3-6974-4d95-ac9e-dcb1f0eee9e9 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:21.969391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:22.070536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 375/765] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:15:21 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 14:15:22.080412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223317e-b781-47a3-9459-b022f8f405dd None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:22.136961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9c4a3-6974-4d95-ac9e-dcb1f0eee9e9 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:22.179498 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974cb1a-55c0-4cec-afdb-d627c36a408e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:22.180124 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974cb1a-55c0-4cec-afdb-d627c36a408e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:22.180471 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974cb1a-55c0-4cec-afdb-d627c36a408e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:22.180951 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974cb1a-55c0-4cec-afdb-d627c36a408e None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:22.181775 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974cb1a-55c0-4cec-afdb-d627c36a408e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:22.182072 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974cb1a-55c0-4cec-afdb-d627c36a408e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:22.183457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974cb1a-55c0-4cec-afdb-d627c36a408e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:22.190016 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 391/766] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Sep 5 14:15:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:22.195679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974cb1a-55c0-4cec-afdb-d627c36a408e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:22.231026 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223317e-b781-47a3-9459-b022f8f405dd None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:22.257682 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:22.262966 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:22.288663 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bf769-c44a-4ccb-bf8e-5d338f148c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:22.289620 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bf769-c44a-4ccb-bf8e-5d338f148c1e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:22.290645 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bf769-c44a-4ccb-bf8e-5d338f148c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:22.291137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bf769-c44a-4ccb-bf8e-5d338f148c1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:22.309876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0bf769-c44a-4ccb-bf8e-5d338f148c1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:22.313658 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0bf769-c44a-4ccb-bf8e-5d338f148c1e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:22.348628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-7b0bf769-c44a-4ccb-bf8e-5d338f148c1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:22.348628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:22.348628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:22.348628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:22.348628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:22.348628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:22.348628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:22.348628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:22.348628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:22.348628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:22.348628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:22.348628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:22.348628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:22.348628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:22.348628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:22.348628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:22.349751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:22.349751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:22.349751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:22.349751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:22.349751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:22.349751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:22.349751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:22.349751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:22.349751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:22.349751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:22.349751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:22.349751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:22.349751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:22.349751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:22.349751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:22.349751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:22.349751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:22.350646 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:22.350646 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:22.350646 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:22.356445 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 376/767] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:22.359890 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bf769-c44a-4ccb-bf8e-5d338f148c1e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:22.366351 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974cb1a-55c0-4cec-afdb-d627c36a408e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:22.418805 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f8055-d86c-4e88-8225-7bb4e66ae2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:22.420133 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f8055-d86c-4e88-8225-7bb4e66ae2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:22.420564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f8055-d86c-4e88-8225-7bb4e66ae2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:22.420986 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f8055-d86c-4e88-8225-7bb4e66ae2a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:22.421874 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f8055-d86c-4e88-8225-7bb4e66ae2a6 None admin] RBAC: Adding query filter params (interface=public, service_id=8fa37c667f8f4906ae98f108ad78504a, region_id=RegionOne) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:22.422183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f8055-d86c-4e88-8225-7bb4e66ae2a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:22.423565 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f8055-d86c-4e88-8225-7bb4e66ae2a6 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:22.437100 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 392/768] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 5 14:15:22 2022] GET /identity/v3/endpoints?service_id=8fa37c667f8f4906ae98f108ad78504a&interface=public®ion_id=RegionOne => generated 194 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:22.437100 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655b54c-0f2c-4745-acc8-9184e9d45e42 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:22.437100 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655b54c-0f2c-4745-acc8-9184e9d45e42 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:22.437100 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655b54c-0f2c-4745-acc8-9184e9d45e42 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:22.438571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 393/769] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:22.440282 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655b54c-0f2c-4745-acc8-9184e9d45e42 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:22.503309 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bf769-c44a-4ccb-bf8e-5d338f148c1e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:22.539896 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbee7a2-ad2d-4bde-9ef8-55f854039fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:22.540551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee7a2-ad2d-4bde-9ef8-55f854039fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:22.540882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee7a2-ad2d-4bde-9ef8-55f854039fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:22.541206 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee7a2-ad2d-4bde-9ef8-55f854039fe2 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:22.541901 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbee7a2-ad2d-4bde-9ef8-55f854039fe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:22.542209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbee7a2-ad2d-4bde-9ef8-55f854039fe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:22.543591 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbee7a2-ad2d-4bde-9ef8-55f854039fe2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:22.557467 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 377/770] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:22.558769 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95763b10-d3fe-4cc7-bbfb-7dbb10911b38 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:22.559053 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95763b10-d3fe-4cc7-bbfb-7dbb10911b38 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:22.559377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95763b10-d3fe-4cc7-bbfb-7dbb10911b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:22.577135 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655b54c-0f2c-4745-acc8-9184e9d45e42 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:22.578586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-95763b10-d3fe-4cc7-bbfb-7dbb10911b38 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:22.579801 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-95763b10-d3fe-4cc7-bbfb-7dbb10911b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:22.589418 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:22.609465 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:22.623229 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd62cae-2cbc-4975-a020-c64c1eec3bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:22.624107 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd62cae-2cbc-4975-a020-c64c1eec3bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:22.624677 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd62cae-2cbc-4975-a020-c64c1eec3bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:22.625150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd62cae-2cbc-4975-a020-c64c1eec3bb3 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:22.626352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd62cae-2cbc-4975-a020-c64c1eec3bb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:22.628286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd62cae-2cbc-4975-a020-c64c1eec3bb3 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:22.640169 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 394/771] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 5 14:15:22 2022] GET /identity/v3/services => generated 772 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:22.641703 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd62cae-2cbc-4975-a020-c64c1eec3bb3 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:22.689084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 378/772] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:22.792888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd62cae-2cbc-4975-a020-c64c1eec3bb3 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:22.830108 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb894b4d-a4aa-4dfd-9dc6-5a962257e39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:22.831110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb894b4d-a4aa-4dfd-9dc6-5a962257e39b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:22.831601 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb894b4d-a4aa-4dfd-9dc6-5a962257e39b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:22.832065 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb894b4d-a4aa-4dfd-9dc6-5a962257e39b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:22.839705 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb894b4d-a4aa-4dfd-9dc6-5a962257e39b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:22.841424 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb894b4d-a4aa-4dfd-9dc6-5a962257e39b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:22.853602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-fb894b4d-a4aa-4dfd-9dc6-5a962257e39b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:22.853602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:22.853602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:22.853602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:22.853602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:22.853602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:22.853602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:22.853602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:22.853602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:22.853602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:22.853602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:22.853602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:22.853602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:22.853602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:22.853602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:22.854495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:22.854495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:22.854495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:22.854495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:22.854495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:22.854495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:22.854495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:22.854495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:22.854495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:22.854495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:22.854495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:22.854495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:22.854495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:22.854495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:22.854495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:22.854495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:22.854495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:22.855374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:22.855374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:22.855374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:22.855374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:22.855374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:22.855374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:22.855374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:22.855374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:22.857905 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 395/773] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:22.866953 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95763b10-d3fe-4cc7-bbfb-7dbb10911b38 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:22.980077 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95763b10-d3fe-4cc7-bbfb-7dbb10911b38 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:23.019825 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e6ecd-717a-48ee-bd51-c6947775f49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:23.020436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e6ecd-717a-48ee-bd51-c6947775f49d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:23.020714 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e6ecd-717a-48ee-bd51-c6947775f49d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:23.020987 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e6ecd-717a-48ee-bd51-c6947775f49d None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:23.021705 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e6ecd-717a-48ee-bd51-c6947775f49d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:23.022012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e6ecd-717a-48ee-bd51-c6947775f49d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:23.023446 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e6ecd-717a-48ee-bd51-c6947775f49d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:23.041673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 379/774] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:23.048063 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb894b4d-a4aa-4dfd-9dc6-5a962257e39b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:23.091605 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:23.096758 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53cc44-3e69-420d-897d-00416d8b5daa None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:23.097044 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53cc44-3e69-420d-897d-00416d8b5daa None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:23.097355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53cc44-3e69-420d-897d-00416d8b5daa None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:23.098857 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 380/775] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:23.099415 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53cc44-3e69-420d-897d-00416d8b5daa None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:23.145522 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:23.169517 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb894b4d-a4aa-4dfd-9dc6-5a962257e39b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:23.208642 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a441e2-409e-4b91-9da2-66d6002abd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:23.209763 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a441e2-409e-4b91-9da2-66d6002abd50 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:23.210364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a441e2-409e-4b91-9da2-66d6002abd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:23.210835 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a441e2-409e-4b91-9da2-66d6002abd50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:23.212313 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a441e2-409e-4b91-9da2-66d6002abd50 None admin] RBAC: Adding query filter params (role.id=5351e6d174334a8eaf71e8d2b3c079a7, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=635e47d0a5a34fdfb5c8967a96a87828) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:23.213011 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a441e2-409e-4b91-9da2-66d6002abd50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:23.214795 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a441e2-409e-4b91-9da2-66d6002abd50 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:23.228882 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 396/776] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:15:23 2022] GET /identity/v3/role_assignments?user.id=635e47d0a5a34fdfb5c8967a96a87828&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=5351e6d174334a8eaf71e8d2b3c079a7 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:23.230765 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c633b-7422-4577-a362-f998c8df851a None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:23.231248 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c633b-7422-4577-a362-f998c8df851a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:23.231716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c633b-7422-4577-a362-f998c8df851a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:23.240942 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53cc44-3e69-420d-897d-00416d8b5daa None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:23.252783 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-371c633b-7422-4577-a362-f998c8df851a None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:23.254366 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-371c633b-7422-4577-a362-f998c8df851a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:23.320030 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001eab1-3b80-4a15-8344-77729cafd741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:23.320761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001eab1-3b80-4a15-8344-77729cafd741 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:23.321448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001eab1-3b80-4a15-8344-77729cafd741 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:23.321557 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001eab1-3b80-4a15-8344-77729cafd741 None admin] PATH_INFO: `/v3/services/network` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:23.322148 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001eab1-3b80-4a15-8344-77729cafd741 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:23.323572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001eab1-3b80-4a15-8344-77729cafd741 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:23.333267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 397/777] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:23.339410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-a001eab1-3b80-4a15-8344-77729cafd741 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 14:15:23.339410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:23.339410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:15:23.339410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:15:23.339410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:15:23.339410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:15:23.339410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:15:23.339410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:23.339410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 14:15:23.339410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:23.339410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:23.339410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:23.339410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:23.339410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:23.339410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:23.339410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:23.339410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:23.340630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:23.340630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:23.340630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:23.340630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:23.340630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:23.340630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:23.340630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:15:23.340630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:15:23.340630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:15:23.340630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:15:23.340630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:23.340630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:23.340630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:23.340630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:23.340630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:23.340630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:23.341681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:23.341681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:23.341681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:23.341681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:23.341681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:23.341681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:23.341681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:23.341681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:23.341681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:23.341681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:23.341681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:15:23.341681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:23.341681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 14:15:23.341681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:23.341681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 381/778] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:23 2022] GET /identity/v3/services/network => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:23.348561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c633b-7422-4577-a362-f998c8df851a None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:23.407630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:23.515671 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c633b-7422-4577-a362-f998c8df851a None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:23.574300 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0268d24-fd48-45c3-acb5-0ae9f80bbd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:23.574920 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0268d24-fd48-45c3-acb5-0ae9f80bbd7b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:23.575198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0268d24-fd48-45c3-acb5-0ae9f80bbd7b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:23.575469 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0268d24-fd48-45c3-acb5-0ae9f80bbd7b None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:23.576105 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0268d24-fd48-45c3-acb5-0ae9f80bbd7b None admin] RBAC: Adding query filter params (name=network) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:23.576414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0268d24-fd48-45c3-acb5-0ae9f80bbd7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:23.581922 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0268d24-fd48-45c3-acb5-0ae9f80bbd7b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:23.587766 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 398/779] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 5 14:15:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:23.593252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001eab1-3b80-4a15-8344-77729cafd741 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:23.711844 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:23.728179 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001eab1-3b80-4a15-8344-77729cafd741 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:23.768805 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0268d24-fd48-45c3-acb5-0ae9f80bbd7b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:23.774827 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8a37a-ccf5-4870-8bcf-561c4033abe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:23.775452 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8a37a-ccf5-4870-8bcf-561c4033abe9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:23.775729 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8a37a-ccf5-4870-8bcf-561c4033abe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:23.776002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8a37a-ccf5-4870-8bcf-561c4033abe9 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:23.776733 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8a37a-ccf5-4870-8bcf-561c4033abe9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:23.777034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8a37a-ccf5-4870-8bcf-561c4033abe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:23.778417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8a37a-ccf5-4870-8bcf-561c4033abe9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:23.783707 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 382/780] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 5 14:15:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:23.790442 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8a37a-ccf5-4870-8bcf-561c4033abe9 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:23.975188 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8a37a-ccf5-4870-8bcf-561c4033abe9 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:24.061880 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69f7af-3531-4e37-b596-b95df58e71ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:24.062536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69f7af-3531-4e37-b596-b95df58e71ac None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:24.062886 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69f7af-3531-4e37-b596-b95df58e71ac None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:24.063163 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69f7af-3531-4e37-b596-b95df58e71ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:24.063868 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69f7af-3531-4e37-b596-b95df58e71ac None admin] RBAC: Adding query filter params (interface=public, service_id=96c813a2e2cc4d47b3f25d6737c8ff4f, region_id=RegionOne) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:24.064173 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69f7af-3531-4e37-b596-b95df58e71ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:24.065667 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69f7af-3531-4e37-b596-b95df58e71ac None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:24.084247 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 383/781] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 5 14:15:23 2022] GET /identity/v3/endpoints?service_id=96c813a2e2cc4d47b3f25d6737c8ff4f&interface=public®ion_id=RegionOne => generated 194 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:24.092205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69f7af-3531-4e37-b596-b95df58e71ac None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:24.097422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:24.103464 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0268d24-fd48-45c3-acb5-0ae9f80bbd7b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:24.125502 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:24.140779 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e37cf-9057-4189-ac5b-a6af2db9f54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:24.141681 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e37cf-9057-4189-ac5b-a6af2db9f54b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:24.142533 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e37cf-9057-4189-ac5b-a6af2db9f54b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:24.142801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e37cf-9057-4189-ac5b-a6af2db9f54b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:24.155074 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e37cf-9057-4189-ac5b-a6af2db9f54b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:15:24.159942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-984e37cf-9057-4189-ac5b-a6af2db9f54b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:15:24.159942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:24.159942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:24.159942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:24.159942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:24.159942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:24.159942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:24.159942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:24.159942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:24.159942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:24.159942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:24.159942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:24.159942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:15:24.159942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:15:24.159942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:15:24.159942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:15:24.160866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:15:24.160866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:15:24.160866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:15:24.160866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:15:24.160866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:24.160866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:24.160866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:24.160866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:24.160866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:24.160866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:24.160866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:24.160866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:24.160866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:24.160866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:24.160866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:24.160866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:24.162333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:24.162333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:24.162333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:24.162333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:24.162333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:15:24.162333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:15:24.162333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:15:24.162333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:15:24.162333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:15:24.162333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:15:24.162333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:15:24.162333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:24.162333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 399/782] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:15:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:24.170443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e37cf-9057-4189-ac5b-a6af2db9f54b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:24.286690 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69f7af-3531-4e37-b596-b95df58e71ac None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:24.333504 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e37cf-9057-4189-ac5b-a6af2db9f54b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:24.337742 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968312a7-2467-4161-89f7-03e073990404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:24.338426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968312a7-2467-4161-89f7-03e073990404 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:24.338770 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968312a7-2467-4161-89f7-03e073990404 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:24.339127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968312a7-2467-4161-89f7-03e073990404 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:24.339797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968312a7-2467-4161-89f7-03e073990404 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:24.341765 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968312a7-2467-4161-89f7-03e073990404 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:24.355323 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 384/783] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 5 14:15:24 2022] GET /identity/v3/services => generated 772 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:24.359169 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467097ca-163b-4ce5-a8f3-f357149758b6 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:24.370456 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467097ca-163b-4ce5-a8f3-f357149758b6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:24.370456 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467097ca-163b-4ce5-a8f3-f357149758b6 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:24.370456 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 385/784] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:24.373670 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c93e5-eed8-48cb-858d-565a1cbad9c8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:24.373670 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c93e5-eed8-48cb-858d-565a1cbad9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:24.373670 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c93e5-eed8-48cb-858d-565a1cbad9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:24.389948 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6b719-4508-48de-afaf-0bf3fe379222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:24.390580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6b719-4508-48de-afaf-0bf3fe379222 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:24.391206 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6b719-4508-48de-afaf-0bf3fe379222 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:24.391487 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6b719-4508-48de-afaf-0bf3fe379222 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:24.392158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6b719-4508-48de-afaf-0bf3fe379222 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:24.392528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6b719-4508-48de-afaf-0bf3fe379222 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:24.395029 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6b719-4508-48de-afaf-0bf3fe379222 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:24.405492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 400/785] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:15:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:24.411020 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6b719-4508-48de-afaf-0bf3fe379222 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:24.424786 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-cf2c93e5-eed8-48cb-858d-565a1cbad9c8 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:24.426380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cf2c93e5-eed8-48cb-858d-565a1cbad9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:24.442330 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:24.548217 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 386/786] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:24.579438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6b719-4508-48de-afaf-0bf3fe379222 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:24.614527 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7151fe-e3af-4616-bb59-6d442e5fc9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:24.615148 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7151fe-e3af-4616-bb59-6d442e5fc9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:24.615426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7151fe-e3af-4616-bb59-6d442e5fc9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:24.615697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7151fe-e3af-4616-bb59-6d442e5fc9a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:24.626946 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7151fe-e3af-4616-bb59-6d442e5fc9a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:24.628409 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7151fe-e3af-4616-bb59-6d442e5fc9a8 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:24.643581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-ad7151fe-e3af-4616-bb59-6d442e5fc9a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:24.643581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:24.643581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:24.643581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:24.643581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:24.643581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:24.643581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:24.643581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:24.643581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:24.643581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:24.643581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:24.643581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:24.643581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:24.643581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:24.643581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:24.643581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:24.645848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:24.645848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:24.645848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:24.645848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:24.645848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:24.645848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:24.645848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:24.645848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:24.645848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:24.645848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:24.645848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:24.645848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:24.645848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:24.645848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:24.645848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:24.645848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:24.645848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:24.648018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:24.648018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:24.648018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:24.648018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 401/787] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:24.651256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c93e5-eed8-48cb-858d-565a1cbad9c8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:24.693428 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:24.769197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c93e5-eed8-48cb-858d-565a1cbad9c8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:24.811112 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72ba88-c7ef-4e8b-970c-4f8bdb0bbf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:24.811703 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72ba88-c7ef-4e8b-970c-4f8bdb0bbf9a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:24.811982 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72ba88-c7ef-4e8b-970c-4f8bdb0bbf9a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:24.812253 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72ba88-c7ef-4e8b-970c-4f8bdb0bbf9a None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:24.812955 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72ba88-c7ef-4e8b-970c-4f8bdb0bbf9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:24.813294 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72ba88-c7ef-4e8b-970c-4f8bdb0bbf9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:24.814743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72ba88-c7ef-4e8b-970c-4f8bdb0bbf9a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:24.828291 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 387/788] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:24.833855 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7151fe-e3af-4616-bb59-6d442e5fc9a8 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:24.867678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72ba88-c7ef-4e8b-970c-4f8bdb0bbf9a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:24.933418 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:24.956690 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:24.985096 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72ba88-c7ef-4e8b-970c-4f8bdb0bbf9a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:25.023109 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64fe13-eb73-4804-8107-c901bd8f4fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:25.024086 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64fe13-eb73-4804-8107-c901bd8f4fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:25.024507 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64fe13-eb73-4804-8107-c901bd8f4fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:25.024797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64fe13-eb73-4804-8107-c901bd8f4fa1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:25.036166 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64fe13-eb73-4804-8107-c901bd8f4fa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:15:25.042087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-3a64fe13-eb73-4804-8107-c901bd8f4fa1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:15:25.042087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:25.042087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:25.042087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:25.042087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:25.042087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:25.042087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:25.042087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:25.042087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:25.042087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:25.042087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:25.042087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:25.042087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:15:25.042087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:15:25.042087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:15:25.042087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:15:25.043018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:15:25.043018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:15:25.043018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:15:25.043018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:15:25.043018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:25.043018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:25.043018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:25.043018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:25.043018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:25.043018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:25.043018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:25.043018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:25.043018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:25.043018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:25.043018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:25.043018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:25.043849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:25.043849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:25.043849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:25.043849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:25.043849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:15:25.043849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:15:25.043849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:15:25.043849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:15:25.043849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:15:25.043849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:15:25.043849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:15:25.043849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:25.043849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 388/789] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:15:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:25.050729 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64fe13-eb73-4804-8107-c901bd8f4fa1 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:25.058580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7151fe-e3af-4616-bb59-6d442e5fc9a8 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:25.163524 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64fe13-eb73-4804-8107-c901bd8f4fa1 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:25.182340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0330cc8-3fec-4895-96de-108fb77dafa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:25.182990 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0330cc8-3fec-4895-96de-108fb77dafa6 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:25.183475 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0330cc8-3fec-4895-96de-108fb77dafa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:25.183593 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0330cc8-3fec-4895-96de-108fb77dafa6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:25.193340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:25.201389 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0330cc8-3fec-4895-96de-108fb77dafa6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:25.204010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0330cc8-3fec-4895-96de-108fb77dafa6 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:25.205668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3e385-e01d-4f27-b4f2-96167821ef3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:25.206870 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3e385-e01d-4f27-b4f2-96167821ef3d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:25.208548 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3e385-e01d-4f27-b4f2-96167821ef3d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:25.209087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3e385-e01d-4f27-b4f2-96167821ef3d None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:25.209897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3e385-e01d-4f27-b4f2-96167821ef3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:25.211327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3e385-e01d-4f27-b4f2-96167821ef3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:25.214321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3e385-e01d-4f27-b4f2-96167821ef3d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:25.227544 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 389/790] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:15:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:25.232013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-c0330cc8-3fec-4895-96de-108fb77dafa6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 14:15:25.232013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:25.232013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:25.232013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:25.232013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:25.232013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:25.232013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:25.232013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:25.232013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:25.232013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:25.232013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:25.232013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:25.232013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:25.232013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:25.232013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:25.232013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:25.232944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:25.232944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:25.232944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:25.232944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:25.232944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:25.232944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:25.232944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:25.232944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:25.232944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:25.232944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:25.232944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:25.232944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:25.232944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:25.232944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:25.232944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:25.232944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:25.232944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:25.232944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:25.233914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:25.233914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:25.233914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:25.233914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:25.233914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:25.233914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:25.233914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:25.233914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:25.233914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 14:15:25.233914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:25.236519 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3e385-e01d-4f27-b4f2-96167821ef3d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:25.237189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 402/791] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:15:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:25.239095 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0330cc8-3fec-4895-96de-108fb77dafa6 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:25.354388 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3e385-e01d-4f27-b4f2-96167821ef3d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:25.375821 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0330cc8-3fec-4895-96de-108fb77dafa6 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:25.392210 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04947595-0689-463a-aefe-0cc883cf19b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:25.392905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04947595-0689-463a-aefe-0cc883cf19b3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:25.393227 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04947595-0689-463a-aefe-0cc883cf19b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:25.393551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04947595-0689-463a-aefe-0cc883cf19b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:25.405591 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04947595-0689-463a-aefe-0cc883cf19b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:25.407100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04947595-0689-463a-aefe-0cc883cf19b3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:25.408124 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:25.421407 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d451c-e49f-42b1-933b-408715edaccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:25.422263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-04947595-0689-463a-aefe-0cc883cf19b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:25.422263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:25.422263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:25.422263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:25.422263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:25.422263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:25.422263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:25.422263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:25.422263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:25.422263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:25.422263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:25.422263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:25.422263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:25.422263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:25.422263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:25.422263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:25.423316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:25.423316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:25.423316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:25.423316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:25.423316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:25.423316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:25.423316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:25.423316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:25.423316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:25.423316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:25.423316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:25.423316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:25.423316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:25.423316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:25.423316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:25.423316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:25.423316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:25.426294 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:25.426294 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:25.426294 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:25.426294 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 390/792] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:25.426294 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab4871-89ef-44b2-a994-9896d151dc12 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:25.426294 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab4871-89ef-44b2-a994-9896d151dc12 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:25.426294 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab4871-89ef-44b2-a994-9896d151dc12 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:25.438402 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 391/793] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:25.438402 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a19298-2067-479a-b76c-338ba5e848d3 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:25.438615 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d451c-e49f-42b1-933b-408715edaccb None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:25.438786 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a19298-2067-479a-b76c-338ba5e848d3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:25.438876 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d451c-e49f-42b1-933b-408715edaccb None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:25.438959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a19298-2067-479a-b76c-338ba5e848d3 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:25.439041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d451c-e49f-42b1-933b-408715edaccb None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:25.439041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d451c-e49f-42b1-933b-408715edaccb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:25.439041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d451c-e49f-42b1-933b-408715edaccb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:25.439041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d451c-e49f-42b1-933b-408715edaccb None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:25.439363 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 392/794] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:25.439363 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a19298-2067-479a-b76c-338ba5e848d3 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:25.450387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 403/795] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Sep 5 14:15:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:25.451682 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd46fc7-dc9e-4714-a963-95d7ae9510d0 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:25.452018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd46fc7-dc9e-4714-a963-95d7ae9510d0 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:25.452292 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd46fc7-dc9e-4714-a963-95d7ae9510d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:25.471317 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-dcd46fc7-dc9e-4714-a963-95d7ae9510d0 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:25.472496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-dcd46fc7-dc9e-4714-a963-95d7ae9510d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:25.486376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:25.542911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 404/796] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:25.545266 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3894b-1ff9-448f-9344-f11d7d59f7ea None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:25.545266 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3894b-1ff9-448f-9344-f11d7d59f7ea None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:25.545266 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3894b-1ff9-448f-9344-f11d7d59f7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:25.553649 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a19298-2067-479a-b76c-338ba5e848d3 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:25.566796 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-5cc3894b-1ff9-448f-9344-f11d7d59f7ea None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:25.568545 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5cc3894b-1ff9-448f-9344-f11d7d59f7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:25.593347 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3ca30-dc10-48de-bc34-c5993a8d8892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:25.594122 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3ca30-dc10-48de-bc34-c5993a8d8892 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:25.594431 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3ca30-dc10-48de-bc34-c5993a8d8892 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:25.594806 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3ca30-dc10-48de-bc34-c5993a8d8892 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:25.595507 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3ca30-dc10-48de-bc34-c5993a8d8892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:25.595908 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3ca30-dc10-48de-bc34-c5993a8d8892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:25.597388 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3ca30-dc10-48de-bc34-c5993a8d8892 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:25.613803 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 393/797] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:25.614833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3ca30-dc10-48de-bc34-c5993a8d8892 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:25.665089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 405/798] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:25.665089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3894b-1ff9-448f-9344-f11d7d59f7ea None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:25.744962 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:25.793279 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3ca30-dc10-48de-bc34-c5993a8d8892 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:25.795078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:25.835927 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4723028-fd6d-4032-a491-71c31239b2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:25.836797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4723028-fd6d-4032-a491-71c31239b2cf None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:25.837358 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4723028-fd6d-4032-a491-71c31239b2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:25.837644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4723028-fd6d-4032-a491-71c31239b2cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:25.847676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3894b-1ff9-448f-9344-f11d7d59f7ea None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:25.854207 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4723028-fd6d-4032-a491-71c31239b2cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:25.856436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4723028-fd6d-4032-a491-71c31239b2cf None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:25.876785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-b4723028-fd6d-4032-a491-71c31239b2cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:25.876785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:25.876785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:25.876785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:25.876785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:25.876785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:25.876785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:25.876785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:25.876785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:25.876785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:25.876785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:25.876785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:25.876785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:25.876785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:25.876785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:25.876785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:25.877773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:25.877773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:25.877773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:25.877773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:25.877773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:25.877773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:25.877773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:25.877773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:25.877773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:25.877773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:25.877773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:25.877773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:25.877773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:25.877773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:25.877773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:25.877773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:25.877773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:25.878660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:25.878660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:25.878660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:25.881351 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 394/799] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:25.883061 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4723028-fd6d-4032-a491-71c31239b2cf None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:25.888290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc2a60-6279-4ef3-a469-10e77d33193b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:25.889029 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc2a60-6279-4ef3-a469-10e77d33193b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:25.889336 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc2a60-6279-4ef3-a469-10e77d33193b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:25.889607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc2a60-6279-4ef3-a469-10e77d33193b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:25.897125 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc2a60-6279-4ef3-a469-10e77d33193b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:25.898596 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc2a60-6279-4ef3-a469-10e77d33193b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:25.910440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-e3dc2a60-6279-4ef3-a469-10e77d33193b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 14:15:25.910440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:25.910440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:25.910440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:25.910440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:25.910440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:25.910440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:25.910440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:25.910440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:25.910440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:25.910440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:25.910440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:25.910440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:25.910440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:25.910440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:25.910440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:25.911390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:25.911390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:25.911390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:25.911390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:25.911390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:25.911390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:25.911390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:25.911390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:25.911390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:25.911390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:25.911390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:25.911390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:25.911390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:25.911390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:25.911390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:25.911390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:25.911390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:25.911390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:25.912346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:25.912346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:25.912346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:25.912346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:25.912346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:25.912346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:25.912346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:25.912346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:25.912346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 14:15:25.912346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:25.912346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 406/800] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 5 14:15:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:25.912931 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc2a60-6279-4ef3-a469-10e77d33193b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:26.004838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4723028-fd6d-4032-a491-71c31239b2cf None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:26.033932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc2a60-6279-4ef3-a469-10e77d33193b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:26.035822 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:26.040565 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43d099-71e0-460d-9b72-47e347eab93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:26.041228 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43d099-71e0-460d-9b72-47e347eab93e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:26.041510 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43d099-71e0-460d-9b72-47e347eab93e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:26.041784 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43d099-71e0-460d-9b72-47e347eab93e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:26.042368 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43d099-71e0-460d-9b72-47e347eab93e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:26.043729 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43d099-71e0-460d-9b72-47e347eab93e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:26.052672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-cc43d099-71e0-460d-9b72-47e347eab93e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 14:15:26.052672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:26.052672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:15:26.052672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:15:26.052672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:15:26.052672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:15:26.052672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:15:26.052672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:26.052672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 14:15:26.052672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:26.052672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:26.052672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:26.052672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:26.052672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:26.052672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:26.052672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:26.052672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:26.053715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:26.053715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:26.053715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:26.053715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:26.053715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:26.053715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:26.053715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:15:26.053715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:15:26.053715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:15:26.053715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:15:26.053715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:26.053715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:26.053715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:26.053715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:26.053715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:26.053715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:26.061819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:26.061819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:26.061819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:26.061819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:26.061819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:26.061819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:26.061819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:26.061819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:26.061819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:26.061819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:26.061819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:15:26.061819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:26.061819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 14:15:26.061819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:26.061819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 395/801] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Sep 5 14:15:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:26.062624 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43d099-71e0-460d-9b72-47e347eab93e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:26.073252 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfecef9-9327-4868-a01f-18495bd9582e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:26.073863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfecef9-9327-4868-a01f-18495bd9582e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:26.074149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfecef9-9327-4868-a01f-18495bd9582e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:26.074411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfecef9-9327-4868-a01f-18495bd9582e None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:26.075055 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfecef9-9327-4868-a01f-18495bd9582e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:26.075360 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfecef9-9327-4868-a01f-18495bd9582e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:26.076737 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfecef9-9327-4868-a01f-18495bd9582e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:26.078874 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:26.089110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 407/802] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:26.089755 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfecef9-9327-4868-a01f-18495bd9582e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:26.170324 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43d099-71e0-460d-9b72-47e347eab93e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:26.197172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfecef9-9327-4868-a01f-18495bd9582e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:26.210160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904f48c-aea9-4422-b388-e207c969aa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:26.210771 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904f48c-aea9-4422-b388-e207c969aa68 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:26.211047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904f48c-aea9-4422-b388-e207c969aa68 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:26.211318 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904f48c-aea9-4422-b388-e207c969aa68 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:26.212574 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904f48c-aea9-4422-b388-e207c969aa68 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:26.212873 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904f48c-aea9-4422-b388-e207c969aa68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:26.214423 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904f48c-aea9-4422-b388-e207c969aa68 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:26.238780 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 396/803] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 5 14:15:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:26.238780 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904f48c-aea9-4422-b388-e207c969aa68 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:26.240710 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fafb20-77f7-4262-8a82-550bfc9eeff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:26.241667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fafb20-77f7-4262-8a82-550bfc9eeff7 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:26.242070 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fafb20-77f7-4262-8a82-550bfc9eeff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:26.242362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fafb20-77f7-4262-8a82-550bfc9eeff7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:26.254113 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fafb20-77f7-4262-8a82-550bfc9eeff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:15:26.259829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-79fafb20-77f7-4262-8a82-550bfc9eeff7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:26.259829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:26.259829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:26.259829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:26.259829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:26.259829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:26.259829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:26.259829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:26.259829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:26.259829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:26.259829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:26.259829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:26.259829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:15:26.259829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:15:26.259829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:15:26.259829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:15:26.260744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:15:26.260744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:15:26.260744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:15:26.260744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:15:26.260744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:26.260744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:26.260744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:26.260744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:26.260744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:26.260744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:26.260744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:26.260744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:26.260744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:26.260744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:26.260744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:26.260744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:26.266048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:26.266048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:26.266048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:26.266048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:26.266048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:15:26.266048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:15:26.266048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:15:26.266048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:15:26.266048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:15:26.266048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:15:26.266048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:26.266048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:26.266048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 408/804] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:15:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:26.266048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fafb20-77f7-4262-8a82-550bfc9eeff7 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:26.292357 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:26.325850 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:26.348684 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904f48c-aea9-4422-b388-e207c969aa68 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:26.372286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fafb20-77f7-4262-8a82-550bfc9eeff7 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:26.392987 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29e03e-ca66-4a73-be98-c49b005b365f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:26.395051 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29e03e-ca66-4a73-be98-c49b005b365f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:26.395848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29e03e-ca66-4a73-be98-c49b005b365f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:26.396582 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29e03e-ca66-4a73-be98-c49b005b365f None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:26.398206 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29e03e-ca66-4a73-be98-c49b005b365f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:26.399012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29e03e-ca66-4a73-be98-c49b005b365f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:26.402531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29e03e-ca66-4a73-be98-c49b005b365f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:26.412870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69046984-b4fa-4f55-b655-907be1b7c77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:26.413652 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69046984-b4fa-4f55-b655-907be1b7c77e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:26.413852 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69046984-b4fa-4f55-b655-907be1b7c77e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:26.413950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 397/805] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Sep 5 14:15:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:26.414117 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69046984-b4fa-4f55-b655-907be1b7c77e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:26.414716 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29e03e-ca66-4a73-be98-c49b005b365f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:26.422411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69046984-b4fa-4f55-b655-907be1b7c77e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:26.423862 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69046984-b4fa-4f55-b655-907be1b7c77e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:26.435793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-69046984-b4fa-4f55-b655-907be1b7c77e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:26.435793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:26.435793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:26.435793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:26.435793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:26.435793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:26.435793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:26.435793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:26.435793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:26.435793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:26.435793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:26.435793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:26.435793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:26.435793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:26.435793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:26.436688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:26.436688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:26.436688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:26.436688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:26.436688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:26.436688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:26.436688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:26.436688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:26.436688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:26.436688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:26.436688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:26.436688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:26.436688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:26.436688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:26.436688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:26.436688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:26.436688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:26.437639 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:26.437639 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:26.437639 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:26.437639 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:26.437639 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:26.437639 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:26.437639 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:26.437639 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:26.441654 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 409/806] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:26.442490 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69046984-b4fa-4f55-b655-907be1b7c77e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:26.523348 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29e03e-ca66-4a73-be98-c49b005b365f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:26.528088 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:26.546912 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69046984-b4fa-4f55-b655-907be1b7c77e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:26.560817 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cbe94-d0c2-4285-b4a6-0caa965f2379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:26.561652 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cbe94-d0c2-4285-b4a6-0caa965f2379 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:26.562073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cbe94-d0c2-4285-b4a6-0caa965f2379 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:26.562486 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cbe94-d0c2-4285-b4a6-0caa965f2379 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:26.573504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:26.586413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db385c3-c87b-4cca-a58f-b24a99591996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:26.587684 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db385c3-c87b-4cca-a58f-b24a99591996 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:26.591479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db385c3-c87b-4cca-a58f-b24a99591996 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:26.591479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db385c3-c87b-4cca-a58f-b24a99591996 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:26.591479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db385c3-c87b-4cca-a58f-b24a99591996 None admin] RBAC: Adding query filter params (name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:26.591479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db385c3-c87b-4cca-a58f-b24a99591996 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:26.591479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db385c3-c87b-4cca-a58f-b24a99591996 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:26.606096 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 410/807] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 5 14:15:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:26.606096 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db385c3-c87b-4cca-a58f-b24a99591996 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:26.639055 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cbe94-d0c2-4285-b4a6-0caa965f2379 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:26.640507 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cbe94-d0c2-4285-b4a6-0caa965f2379 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:26.704821 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db385c3-c87b-4cca-a58f-b24a99591996 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:26.737938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8702043-3137-4594-939e-3fc52039b512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:26.738536 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8702043-3137-4594-939e-3fc52039b512 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:26.738812 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8702043-3137-4594-939e-3fc52039b512 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:26.739082 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8702043-3137-4594-939e-3fc52039b512 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:26.739710 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8702043-3137-4594-939e-3fc52039b512 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:26.739841 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 398/808] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:15:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 14:15:26.740003 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8702043-3137-4594-939e-3fc52039b512 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:26.740566 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cbe94-d0c2-4285-b4a6-0caa965f2379 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:26.741497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8702043-3137-4594-939e-3fc52039b512 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:26.746513 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 411/809] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Sep 5 14:15:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:26.747287 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8702043-3137-4594-939e-3fc52039b512 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:26.761906 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:26.785482 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:26.843724 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cbe94-d0c2-4285-b4a6-0caa965f2379 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:26.848931 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8702043-3137-4594-939e-3fc52039b512 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:26.877367 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd9ec6-3583-487c-8fa0-ca8b7614b575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:26.877962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd9ec6-3583-487c-8fa0-ca8b7614b575 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:26.878235 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd9ec6-3583-487c-8fa0-ca8b7614b575 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:26.878504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd9ec6-3583-487c-8fa0-ca8b7614b575 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:26.879179 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd9ec6-3583-487c-8fa0-ca8b7614b575 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:26.879477 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd9ec6-3583-487c-8fa0-ca8b7614b575 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:26.880891 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd9ec6-3583-487c-8fa0-ca8b7614b575 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:26.882163 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439a606-ccde-4745-bcf8-38f9ddf3b24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:26.882787 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439a606-ccde-4745-bcf8-38f9ddf3b24d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:26.883045 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439a606-ccde-4745-bcf8-38f9ddf3b24d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:26.883317 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439a606-ccde-4745-bcf8-38f9ddf3b24d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:26.892897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 399/810] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:26.894074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad1152-5950-401b-904c-ec1cac84d7e7 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:26.894354 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439a606-ccde-4745-bcf8-38f9ddf3b24d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:26.894480 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad1152-5950-401b-904c-ec1cac84d7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:26.894663 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad1152-5950-401b-904c-ec1cac84d7e7 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:26.895974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 400/811] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:26.896075 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439a606-ccde-4745-bcf8-38f9ddf3b24d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:26.898090 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad1152-5950-401b-904c-ec1cac84d7e7 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:26.911103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-9439a606-ccde-4745-bcf8-38f9ddf3b24d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:26.911103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:26.911103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:26.911103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:26.911103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:26.911103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:26.911103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:26.911103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:26.911103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:26.911103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:26.911103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:26.911103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:26.911103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:26.911103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:26.911103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:26.911103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:26.912250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:26.912250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:26.912250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:26.912250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:26.912250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:26.912250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:26.912250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:26.912250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:26.912250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:26.912250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:26.912250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:26.912250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:26.912250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:26.912250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:26.912250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:26.912250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:26.912250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:26.913194 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:26.913194 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:26.913194 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:26.913194 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 412/812] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:26.913194 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439a606-ccde-4745-bcf8-38f9ddf3b24d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:26.970976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:27.000422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:27.004661 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad1152-5950-401b-904c-ec1cac84d7e7 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:27.011399 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439a606-ccde-4745-bcf8-38f9ddf3b24d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:27.039258 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6331bf-9847-4dbd-8c0c-04e9544d4053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:27.039857 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6331bf-9847-4dbd-8c0c-04e9544d4053 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:27.040118 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6331bf-9847-4dbd-8c0c-04e9544d4053 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:27.040385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6331bf-9847-4dbd-8c0c-04e9544d4053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:27.044363 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14dad4-8635-4a6b-880b-f1f0b859303f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:27.044958 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14dad4-8635-4a6b-880b-f1f0b859303f None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:27.045266 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14dad4-8635-4a6b-880b-f1f0b859303f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:27.045541 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14dad4-8635-4a6b-880b-f1f0b859303f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:27.046201 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14dad4-8635-4a6b-880b-f1f0b859303f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:27.047581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14dad4-8635-4a6b-880b-f1f0b859303f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:27.050113 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6331bf-9847-4dbd-8c0c-04e9544d4053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:27.051789 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6331bf-9847-4dbd-8c0c-04e9544d4053 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:27.066433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-4f6331bf-9847-4dbd-8c0c-04e9544d4053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:27.066433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:27.066433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:27.066433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:27.066433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:27.066433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:27.066433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:27.066433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:27.066433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:27.066433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:27.066433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:27.066433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:27.066433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:27.066433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:27.066433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:27.066433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:27.067391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:27.067391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:27.067391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:27.067391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:27.067391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:27.067391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:27.067391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:27.067391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:27.067391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:27.067391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:27.067391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:27.067391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:27.067391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:27.067391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:27.067391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:27.067391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:27.067391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:27.068333 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:27.068333 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:27.068333 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:27.068333 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 401/813] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:27.068333 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6331bf-9847-4dbd-8c0c-04e9544d4053 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:27.154609 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 413/814] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:15:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:15:27.156127 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c83965-2c26-45a2-bf85-3c29059f8c1b None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:27.156412 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c83965-2c26-45a2-bf85-3c29059f8c1b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:27.156686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c83965-2c26-45a2-bf85-3c29059f8c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:27.169805 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6331bf-9847-4dbd-8c0c-04e9544d4053 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:27.178873 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-38c83965-2c26-45a2-bf85-3c29059f8c1b None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:27.180257 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-38c83965-2c26-45a2-bf85-3c29059f8c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:27.224650 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dac1b-9c7b-4b10-a9e2-a6b7ce30b311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:27.225079 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dac1b-9c7b-4b10-a9e2-a6b7ce30b311 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:27.225356 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dac1b-9c7b-4b10-a9e2-a6b7ce30b311 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:27.225635 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dac1b-9c7b-4b10-a9e2-a6b7ce30b311 None admin] PATH_INFO: `/v3/projects/975f49bcc95643fe876cc03d0d731423/users/1ed60e9eecb94ef39c2f4a5e5f50d670/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:27.227688 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401dac1b-9c7b-4b10-a9e2-a6b7ce30b311 None admin] RBAC: Authorizing `identity:create_grant(project_id=975f49bcc95643fe876cc03d0d731423, user_id=1ed60e9eecb94ef39c2f4a5e5f50d670, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:27.230963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401dac1b-9c7b-4b10-a9e2-a6b7ce30b311 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:27.260674 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 414/815] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:27.261590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c83965-2c26-45a2-bf85-3c29059f8c1b None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:27.314865 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:27.315400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 402/816] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:15:27 2022] PUT /identity/v3/projects/975f49bcc95643fe876cc03d0d731423/users/1ed60e9eecb94ef39c2f4a5e5f50d670/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:15:27.316606 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dac1b-9c7b-4b10-a9e2-a6b7ce30b311 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:27.332759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:27.389583 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c83965-2c26-45a2-bf85-3c29059f8c1b None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:27.433416 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db0bf4-c058-49f4-a9ae-b568ea7825b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:27.434044 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db0bf4-c058-49f4-a9ae-b568ea7825b3 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:27.434380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db0bf4-c058-49f4-a9ae-b568ea7825b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:27.434659 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db0bf4-c058-49f4-a9ae-b568ea7825b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:27.435313 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db0bf4-c058-49f4-a9ae-b568ea7825b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:27.435619 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db0bf4-c058-49f4-a9ae-b568ea7825b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:27.437016 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db0bf4-c058-49f4-a9ae-b568ea7825b3 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:27.451845 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 415/817] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:27.457851 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db0bf4-c058-49f4-a9ae-b568ea7825b3 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:27.465743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401dac1b-9c7b-4b10-a9e2-a6b7ce30b311 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:27.547910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273a293-5688-4f27-b571-64a2ac8c0cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:27.548527 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273a293-5688-4f27-b571-64a2ac8c0cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:27.548804 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273a293-5688-4f27-b571-64a2ac8c0cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:27.549228 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273a293-5688-4f27-b571-64a2ac8c0cb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:27.549872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273a293-5688-4f27-b571-64a2ac8c0cb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:27.550174 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273a293-5688-4f27-b571-64a2ac8c0cb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:27.551794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273a293-5688-4f27-b571-64a2ac8c0cb4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:27.569886 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 403/818] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:27.570713 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273a293-5688-4f27-b571-64a2ac8c0cb4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:27.589990 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db0bf4-c058-49f4-a9ae-b568ea7825b3 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:27.597804 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:27.625766 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c063fde-ed3a-4dce-8761-ef4a7f692799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:27.626395 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c063fde-ed3a-4dce-8761-ef4a7f692799 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:27.626669 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c063fde-ed3a-4dce-8761-ef4a7f692799 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:27.626936 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c063fde-ed3a-4dce-8761-ef4a7f692799 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:27.635465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c063fde-ed3a-4dce-8761-ef4a7f692799 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:27.636914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c063fde-ed3a-4dce-8761-ef4a7f692799 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:27.646729 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:27.650028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-0c063fde-ed3a-4dce-8761-ef4a7f692799 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 14:15:27.650028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:27.650028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:27.650028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:27.650028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:27.650028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:27.650028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:27.650028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:27.650028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:27.650028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:27.650028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:27.650028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:27.650028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:27.650028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:27.650028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:27.650028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:27.651023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:27.651023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:27.651023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:27.651023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:27.651023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:27.651023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:27.651023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:27.651023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:27.651023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:27.651023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:27.651023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:27.651023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:27.651023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:27.651023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:27.651023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:27.651023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:27.651023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:27.651023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:27.652321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:27.652321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:27.652321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:27.652321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:27.652321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:27.652321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:27.652321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:27.652321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:27.652321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 14:15:27.652321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:27.652321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 416/819] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 5 14:15:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:27.652915 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c063fde-ed3a-4dce-8761-ef4a7f692799 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:27.692004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273a293-5688-4f27-b571-64a2ac8c0cb4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:27.734445 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd835a07-f9b0-4bac-99a5-6fccfd974f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:27.735082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd835a07-f9b0-4bac-99a5-6fccfd974f1a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:27.735365 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd835a07-f9b0-4bac-99a5-6fccfd974f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:27.735641 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd835a07-f9b0-4bac-99a5-6fccfd974f1a None admin] PATH_INFO: `/v3/services/network` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:27.736328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd835a07-f9b0-4bac-99a5-6fccfd974f1a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:27.737756 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd835a07-f9b0-4bac-99a5-6fccfd974f1a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:27.749250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-cd835a07-f9b0-4bac-99a5-6fccfd974f1a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 14:15:27.749250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:27.749250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:15:27.749250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:15:27.749250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:15:27.749250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:15:27.749250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:15:27.749250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:27.749250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 14:15:27.749250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:27.749250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:27.749250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:27.749250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:27.749250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:27.749250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:27.749250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:27.749250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:27.750264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:27.750264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:27.750264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:27.750264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:27.750264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:27.750264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:27.750264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:15:27.750264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:15:27.750264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:15:27.750264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:15:27.750264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:27.750264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:27.750264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:27.750264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:27.750264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:27.750264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:27.751838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:27.751838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:27.751838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:27.751838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:27.751838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:27.751838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:27.751838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:27.751838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:27.751838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:27.751838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:27.751838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:15:27.751838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:27.751838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 14:15:27.751838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:27.751838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 404/820] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:27 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:27.752633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd835a07-f9b0-4bac-99a5-6fccfd974f1a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:27.762951 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c063fde-ed3a-4dce-8761-ef4a7f692799 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:27.799728 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35e627-32b7-45bc-937b-14cae1ec5427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:27.800438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35e627-32b7-45bc-937b-14cae1ec5427 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:27.800713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35e627-32b7-45bc-937b-14cae1ec5427 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:27.801279 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35e627-32b7-45bc-937b-14cae1ec5427 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:27.808420 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35e627-32b7-45bc-937b-14cae1ec5427 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:27.809958 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35e627-32b7-45bc-937b-14cae1ec5427 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:27.821673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-cf35e627-32b7-45bc-937b-14cae1ec5427 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:27.821673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:27.821673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:27.821673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:27.821673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:27.821673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:27.821673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:27.821673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:27.821673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:27.821673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:27.821673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:27.821673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:27.821673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:27.821673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:27.821673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:27.824112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:27.824112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:27.824112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:27.824112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:27.824112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:27.824112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:27.824112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:27.824112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:27.824112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:27.824112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:27.824112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:27.824112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:27.824112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:27.824112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:27.824112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:27.824112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:27.824112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:27.826315 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:27.826315 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:27.826315 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:27.826315 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:27.826315 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:27.826315 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:27.826315 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:27.826315 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:27.826315 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 417/821] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:27.826315 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35e627-32b7-45bc-937b-14cae1ec5427 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:27.853908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:27.873453 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd835a07-f9b0-4bac-99a5-6fccfd974f1a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:27.910342 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:27.918387 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7136b-0014-4e09-8458-b21f807ae17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:27.919310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7136b-0014-4e09-8458-b21f807ae17c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:27.920134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7136b-0014-4e09-8458-b21f807ae17c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:27.920552 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7136b-0014-4e09-8458-b21f807ae17c None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:27.921909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7136b-0014-4e09-8458-b21f807ae17c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:27.922611 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7136b-0014-4e09-8458-b21f807ae17c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:27.924472 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7136b-0014-4e09-8458-b21f807ae17c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:27.944511 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35e627-32b7-45bc-937b-14cae1ec5427 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:27.954420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 405/822] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Sep 5 14:15:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:27.954420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7136b-0014-4e09-8458-b21f807ae17c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:27.984239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d3c3f-48a7-43d2-b474-473af28e63ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:27.984838 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d3c3f-48a7-43d2-b474-473af28e63ff None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:27.985157 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d3c3f-48a7-43d2-b474-473af28e63ff None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:27.985432 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d3c3f-48a7-43d2-b474-473af28e63ff None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:27.986139 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d3c3f-48a7-43d2-b474-473af28e63ff None admin] RBAC: Adding query filter params (name=network) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:27.986362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d3c3f-48a7-43d2-b474-473af28e63ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:27.987790 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d3c3f-48a7-43d2-b474-473af28e63ff None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:27.992825 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 418/823] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 5 14:15:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:27.994127 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d3c3f-48a7-43d2-b474-473af28e63ff None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:28.074981 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7136b-0014-4e09-8458-b21f807ae17c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:28.112132 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e93ec5-8563-4e0b-bd87-37af234a5b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:28.112729 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e93ec5-8563-4e0b-bd87-37af234a5b0e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:28.113083 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e93ec5-8563-4e0b-bd87-37af234a5b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:28.113353 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e93ec5-8563-4e0b-bd87-37af234a5b0e None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:28.114033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e93ec5-8563-4e0b-bd87-37af234a5b0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:28.114337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e93ec5-8563-4e0b-bd87-37af234a5b0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:28.115460 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:28.115839 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e93ec5-8563-4e0b-bd87-37af234a5b0e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:28.126283 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d3c3f-48a7-43d2-b474-473af28e63ff None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:28.128217 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 406/824] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:28.129598 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e93ec5-8563-4e0b-bd87-37af234a5b0e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:28.167744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ba89e-2db8-41ec-87f9-44fdecc4e33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:28.168375 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ba89e-2db8-41ec-87f9-44fdecc4e33d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:28.168650 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ba89e-2db8-41ec-87f9-44fdecc4e33d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:28.168916 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ba89e-2db8-41ec-87f9-44fdecc4e33d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:28.179793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ba89e-2db8-41ec-87f9-44fdecc4e33d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:28.181527 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ba89e-2db8-41ec-87f9-44fdecc4e33d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:28.192818 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:28.199436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-662ba89e-2db8-41ec-87f9-44fdecc4e33d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:28.199436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:28.199436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:28.199436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:28.199436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:28.199436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:28.199436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:28.199436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:28.199436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:28.199436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:28.199436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:28.199436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:28.199436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:28.199436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:28.199436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:28.199436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:28.200595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:28.200595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:28.200595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:28.200595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:28.200595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:28.200595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:28.200595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:28.200595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:28.200595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:28.200595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:28.200595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:28.200595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:28.200595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:28.200595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:28.200595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:28.200595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:28.200595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:28.207672 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:28.207672 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:28.207672 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:28.207672 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 419/825] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:28.207672 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ba89e-2db8-41ec-87f9-44fdecc4e33d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:28.252360 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e93ec5-8563-4e0b-bd87-37af234a5b0e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:28.289917 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50eed7c-df0d-4984-b6fa-88daf67df144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:28.291054 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50eed7c-df0d-4984-b6fa-88daf67df144 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:28.291484 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50eed7c-df0d-4984-b6fa-88daf67df144 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:28.291905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50eed7c-df0d-4984-b6fa-88daf67df144 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:28.292677 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50eed7c-df0d-4984-b6fa-88daf67df144 None admin] RBAC: Adding query filter params (type=network) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:28.293177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50eed7c-df0d-4984-b6fa-88daf67df144 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:28.294685 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50eed7c-df0d-4984-b6fa-88daf67df144 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:28.300351 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 407/826] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 5 14:15:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:28.301582 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50eed7c-df0d-4984-b6fa-88daf67df144 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:28.310832 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ba89e-2db8-41ec-87f9-44fdecc4e33d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:28.347393 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8acc9-cbb5-48c7-ad07-b011c6255ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:28.347914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8acc9-cbb5-48c7-ad07-b011c6255ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:28.348187 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8acc9-cbb5-48c7-ad07-b011c6255ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:28.348455 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8acc9-cbb5-48c7-ad07-b011c6255ed0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:28.349228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8acc9-cbb5-48c7-ad07-b011c6255ed0 None admin] RBAC: Adding query filter params (role.id=f22e6e660eab44c5be25e3dee1e3042c, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=d5515accf3b64006bc41422265a641bc) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:28.349533 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8acc9-cbb5-48c7-ad07-b011c6255ed0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:28.350962 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8acc9-cbb5-48c7-ad07-b011c6255ed0 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:28.358109 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 420/827] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:15:28 2022] GET /identity/v3/role_assignments?user.id=d5515accf3b64006bc41422265a641bc&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=f22e6e660eab44c5be25e3dee1e3042c => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:28.358906 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8acc9-cbb5-48c7-ad07-b011c6255ed0 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:28.368442 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:28.422275 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50eed7c-df0d-4984-b6fa-88daf67df144 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:28.438486 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:28.463900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d88bf-030d-40a2-b36e-d901f1204afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:28.464794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d88bf-030d-40a2-b36e-d901f1204afb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:28.465251 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d88bf-030d-40a2-b36e-d901f1204afb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:28.465704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d88bf-030d-40a2-b36e-d901f1204afb None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:28.466521 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d88bf-030d-40a2-b36e-d901f1204afb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:28.466976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d88bf-030d-40a2-b36e-d901f1204afb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:28.468669 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d88bf-030d-40a2-b36e-d901f1204afb None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:28.489349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 408/828] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:28.500985 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8acc9-cbb5-48c7-ad07-b011c6255ed0 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:28.504349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d88bf-030d-40a2-b36e-d901f1204afb None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:28.545940 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c005d5-dc14-470c-81b6-9ea2f8a4e0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:28.546562 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c005d5-dc14-470c-81b6-9ea2f8a4e0db None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:28.546834 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c005d5-dc14-470c-81b6-9ea2f8a4e0db None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:28.547102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c005d5-dc14-470c-81b6-9ea2f8a4e0db None admin] PATH_INFO: `/v3/endpoints` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:28.547780 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c005d5-dc14-470c-81b6-9ea2f8a4e0db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:28.549251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c005d5-dc14-470c-81b6-9ea2f8a4e0db None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:28.638248 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d88bf-030d-40a2-b36e-d901f1204afb None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:28.648675 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 421/829] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:15:28 2022] POST /identity/v3/endpoints => generated 337 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:15:28.697146 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b48fd4-3473-454e-b646-f15598875a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:28.698073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b48fd4-3473-454e-b646-f15598875a4e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:28.698496 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b48fd4-3473-454e-b646-f15598875a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:28.698939 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b48fd4-3473-454e-b646-f15598875a4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:28.707972 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b48fd4-3473-454e-b646-f15598875a4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:28.710023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b48fd4-3473-454e-b646-f15598875a4e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:28.724813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-89b48fd4-3473-454e-b646-f15598875a4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:28.724813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:28.724813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:28.724813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:28.724813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:28.724813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:28.724813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:28.724813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:28.724813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:28.724813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:28.724813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:28.724813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:28.724813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:28.724813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:28.724813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:28.726025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:28.726025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:28.726025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:28.726025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:28.726025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:28.726025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:28.726025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:28.726025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:28.726025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:28.726025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:28.726025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:28.726025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:28.726025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:28.726025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:28.726025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:28.726025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:28.726025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:28.727291 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:28.727291 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:28.727291 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:28.727291 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:28.727291 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:28.727291 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:28.727291 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:28.727291 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:28.729666 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 409/830] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:28.736121 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c005d5-dc14-470c-81b6-9ea2f8a4e0db None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:28.809430 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:28.858416 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c005d5-dc14-470c-81b6-9ea2f8a4e0db None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:28.901120 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d8ffd-780c-4d4e-bd3d-64978b6e5fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:28.901669 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d8ffd-780c-4d4e-bd3d-64978b6e5fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:28.901952 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d8ffd-780c-4d4e-bd3d-64978b6e5fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:28.902234 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d8ffd-780c-4d4e-bd3d-64978b6e5fc2 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:28.902940 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d8ffd-780c-4d4e-bd3d-64978b6e5fc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:28.903248 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d8ffd-780c-4d4e-bd3d-64978b6e5fc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:28.904700 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d8ffd-780c-4d4e-bd3d-64978b6e5fc2 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:28.919393 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 422/831] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:28.925232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b48fd4-3473-454e-b646-f15598875a4e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:28.960386 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:29.036312 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b48fd4-3473-454e-b646-f15598875a4e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:29.072997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecccce-5b50-4637-b409-94c7926909d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:29.073689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecccce-5b50-4637-b409-94c7926909d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:29.073962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecccce-5b50-4637-b409-94c7926909d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:29.074235 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecccce-5b50-4637-b409-94c7926909d6 None admin] PATH_INFO: `/v3/projects/975f49bcc95643fe876cc03d0d731423/users/635e47d0a5a34fdfb5c8967a96a87828/roles/5351e6d174334a8eaf71e8d2b3c079a7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:29.091397 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecccce-5b50-4637-b409-94c7926909d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=975f49bcc95643fe876cc03d0d731423, user_id=635e47d0a5a34fdfb5c8967a96a87828, role_id=5351e6d174334a8eaf71e8d2b3c079a7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:29.092844 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecccce-5b50-4637-b409-94c7926909d6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:29.172500 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 410/832] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:15:28 2022] PUT /identity/v3/projects/975f49bcc95643fe876cc03d0d731423/users/635e47d0a5a34fdfb5c8967a96a87828/roles/5351e6d174334a8eaf71e8d2b3c079a7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:15:29.466123 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51bc11-be0e-4a84-a9b8-9eb71911f0fb None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:29.466302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51bc11-be0e-4a84-a9b8-9eb71911f0fb None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:29.466679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51bc11-be0e-4a84-a9b8-9eb71911f0fb None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:29.469724 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 423/833] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:29.474679 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a807f2-7105-4428-a41f-1c4cb16908f2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:29.474968 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a807f2-7105-4428-a41f-1c4cb16908f2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:29.475241 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a807f2-7105-4428-a41f-1c4cb16908f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:29.483989 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb190da-4abe-448d-8002-0489870149f6 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:29.484273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb190da-4abe-448d-8002-0489870149f6 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:29.484539 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb190da-4abe-448d-8002-0489870149f6 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:29.486132 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 424/834] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:15:29.491063 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf02a0b-b1c5-47c3-95b8-0121ef5fd75a None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:29.491353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf02a0b-b1c5-47c3-95b8-0121ef5fd75a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:29.491626 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf02a0b-b1c5-47c3-95b8-0121ef5fd75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:29.495878 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b3a807f2-7105-4428-a41f-1c4cb16908f2 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:29.497355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b3a807f2-7105-4428-a41f-1c4cb16908f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:29.510337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-1bf02a0b-b1c5-47c3-95b8-0121ef5fd75a None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:29.511821 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1bf02a0b-b1c5-47c3-95b8-0121ef5fd75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:29.585102 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 411/835] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:29.597097 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 425/836] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:29.860408 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a807f2-7105-4428-a41f-1c4cb16908f2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:29.873101 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:29.874540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf02a0b-b1c5-47c3-95b8-0121ef5fd75a None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:29.954679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:29.987207 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a807f2-7105-4428-a41f-1c4cb16908f2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:29.998083 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf02a0b-b1c5-47c3-95b8-0121ef5fd75a None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:30.033967 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45482c-232f-4439-b702-45f9406f35da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:30.034594 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45482c-232f-4439-b702-45f9406f35da None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:30.034904 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45482c-232f-4439-b702-45f9406f35da None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:30.035605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45482c-232f-4439-b702-45f9406f35da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:30.040994 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42219068-70d8-468b-a910-0c4195e76085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:30.042035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42219068-70d8-468b-a910-0c4195e76085 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:30.042538 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42219068-70d8-468b-a910-0c4195e76085 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:30.043276 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42219068-70d8-468b-a910-0c4195e76085 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:30.044443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42219068-70d8-468b-a910-0c4195e76085 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:30.046207 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42219068-70d8-468b-a910-0c4195e76085 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:30.046920 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45482c-232f-4439-b702-45f9406f35da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:15:30.052910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-3a45482c-232f-4439-b702-45f9406f35da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:15:30.052910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:30.052910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:30.052910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:30.052910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:30.052910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:30.052910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:30.052910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:30.052910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:30.052910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:30.052910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:30.052910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:30.052910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:15:30.052910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:15:30.052910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:15:30.052910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:15:30.053875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:15:30.053875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:15:30.053875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:15:30.053875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:15:30.053875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:30.053875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:30.053875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:30.053875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:30.053875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:30.053875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:30.053875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:30.053875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:30.053875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:30.053875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:30.053875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:30.053875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:30.054721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:30.054721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:30.054721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:30.054721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:30.054721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:15:30.054721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:15:30.054721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:15:30.054721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:15:30.054721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:15:30.054721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:15:30.054721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:15:30.054721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:30.054721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 412/837] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:15:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:30.061523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-42219068-70d8-468b-a910-0c4195e76085 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 14:15:30.061523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:30.061523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:15:30.061523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:15:30.061523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:15:30.061523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:15:30.061523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:15:30.061523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:30.061523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 14:15:30.061523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:30.061523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:30.061523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:30.061523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:30.061523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:30.061523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:30.061523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:30.061523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:30.062501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:30.062501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:30.062501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:30.062501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:30.062501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:30.062501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:30.062501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:15:30.062501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:15:30.062501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:15:30.062501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:15:30.062501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:30.062501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:30.062501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:30.062501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:30.062501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:30.062501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:30.063323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:30.063323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:30.063323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:30.063323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:30.063323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:30.063323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:30.063323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:30.063323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:30.063323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:30.063323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:30.063323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:15:30.063323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:30.063323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 14:15:30.063323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:30.064059 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45482c-232f-4439-b702-45f9406f35da None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:30.064129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 426/838] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 5 14:15:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:30.071798 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42219068-70d8-468b-a910-0c4195e76085 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:30.140448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:30.188170 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42219068-70d8-468b-a910-0c4195e76085 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:30.188408 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45482c-232f-4439-b702-45f9406f35da None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:30.206690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:30.225876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac61ea5-0257-4716-a2f2-acd2a2c67360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:30.226837 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac61ea5-0257-4716-a2f2-acd2a2c67360 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:30.227230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc883a-a5f6-45eb-b383-0a6b6505e35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:30.228246 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac61ea5-0257-4716-a2f2-acd2a2c67360 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:30.228606 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc883a-a5f6-45eb-b383-0a6b6505e35b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:30.228962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac61ea5-0257-4716-a2f2-acd2a2c67360 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:30.229095 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc883a-a5f6-45eb-b383-0a6b6505e35b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:30.229306 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc883a-a5f6-45eb-b383-0a6b6505e35b None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:30.229940 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc883a-a5f6-45eb-b383-0a6b6505e35b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:30.230243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc883a-a5f6-45eb-b383-0a6b6505e35b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:30.230612 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac61ea5-0257-4716-a2f2-acd2a2c67360 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:30.231135 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac61ea5-0257-4716-a2f2-acd2a2c67360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:30.231626 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc883a-a5f6-45eb-b383-0a6b6505e35b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:30.232959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac61ea5-0257-4716-a2f2-acd2a2c67360 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:30.242498 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 427/839] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 5 14:15:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:30.243654 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc883a-a5f6-45eb-b383-0a6b6505e35b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:30.248751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 413/840] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:15:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:30.249966 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac61ea5-0257-4716-a2f2-acd2a2c67360 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:30.357939 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac61ea5-0257-4716-a2f2-acd2a2c67360 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:30.360231 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc883a-a5f6-45eb-b383-0a6b6505e35b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:30.390078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:30.395647 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24f0e4-281a-4cda-98c9-cd7e30a66a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:30.396332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24f0e4-281a-4cda-98c9-cd7e30a66a5c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:30.396926 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24f0e4-281a-4cda-98c9-cd7e30a66a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:30.397250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24f0e4-281a-4cda-98c9-cd7e30a66a5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:30.402906 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8276d-0375-4fec-9102-32fa3c78931a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:30.403739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8276d-0375-4fec-9102-32fa3c78931a None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:30.404218 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8276d-0375-4fec-9102-32fa3c78931a None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:30.404677 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8276d-0375-4fec-9102-32fa3c78931a None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:30.405517 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8276d-0375-4fec-9102-32fa3c78931a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:30.405996 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8276d-0375-4fec-9102-32fa3c78931a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:30.407568 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8276d-0375-4fec-9102-32fa3c78931a None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:30.409812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24f0e4-281a-4cda-98c9-cd7e30a66a5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:30.411944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24f0e4-281a-4cda-98c9-cd7e30a66a5c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:30.412838 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 428/841] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 5 14:15:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:30.434704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-7f24f0e4-281a-4cda-98c9-cd7e30a66a5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:30.434704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:30.434704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:30.434704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:30.434704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:30.434704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:30.434704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:30.434704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:30.434704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:30.434704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:30.434704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:30.434704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:30.434704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:30.434704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:30.434704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:30.434704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:30.435809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:30.435809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:30.435809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:30.435809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:30.435809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:30.435809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:30.435809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:30.435809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:30.435809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:30.435809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:30.435809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:30.435809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:30.435809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:30.435809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:30.435809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:30.435809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:30.435809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:30.436694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:30.436694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:30.436694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:30.436694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 414/842] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:30.442507 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8276d-0375-4fec-9102-32fa3c78931a None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:30.501443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:30.558082 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8276d-0375-4fec-9102-32fa3c78931a None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:30.594784 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e342a9-c524-4c11-b724-d2d4c34019de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:30.595399 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e342a9-c524-4c11-b724-d2d4c34019de None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:30.595679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e342a9-c524-4c11-b724-d2d4c34019de None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:30.595969 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e342a9-c524-4c11-b724-d2d4c34019de None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:30.596603 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e342a9-c524-4c11-b724-d2d4c34019de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:30.596909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e342a9-c524-4c11-b724-d2d4c34019de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:30.598353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e342a9-c524-4c11-b724-d2d4c34019de None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:30.612183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 429/843] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:30.619092 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24f0e4-281a-4cda-98c9-cd7e30a66a5c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:30.726579 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24f0e4-281a-4cda-98c9-cd7e30a66a5c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:30.737079 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e96e4-653c-4523-a034-d72838da5cae None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:30.737079 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e96e4-653c-4523-a034-d72838da5cae None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:30.737079 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e96e4-653c-4523-a034-d72838da5cae None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:30.741080 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 430/844] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:30.745083 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75531fc5-737e-4983-89d9-07328d983fb7 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:30.745083 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75531fc5-737e-4983-89d9-07328d983fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:30.745294 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75531fc5-737e-4983-89d9-07328d983fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:30.776842 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-75531fc5-737e-4983-89d9-07328d983fb7 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:30.778093 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-75531fc5-737e-4983-89d9-07328d983fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:30.812908 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d863038-3d0c-49a1-a321-4318d8d89912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:30.812908 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d863038-3d0c-49a1-a321-4318d8d89912 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:30.812908 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d863038-3d0c-49a1-a321-4318d8d89912 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:30.812908 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d863038-3d0c-49a1-a321-4318d8d89912 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:30.826635 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d863038-3d0c-49a1-a321-4318d8d89912 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:30.826635 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d863038-3d0c-49a1-a321-4318d8d89912 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:30.849082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-0d863038-3d0c-49a1-a321-4318d8d89912 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 14:15:30.849082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:30.849082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:30.849082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:30.849082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:30.849082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:30.849082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:30.849082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:30.849082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:30.849082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:30.849082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:30.849082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:30.849082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:30.849082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:30.849082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:30.849082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:30.850075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:30.850075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:30.850075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:30.850075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:30.850075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:30.850075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:30.850075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:30.850075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:30.850075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:30.850075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:30.850075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:30.850075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:30.850075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:30.850075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:30.850075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:30.850075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:30.850075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:30.850075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:30.851014 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:30.851014 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:30.851014 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:30.851014 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:30.851014 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:30.851014 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:30.851014 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:30.851014 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:30.851014 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 14:15:30.851014 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:30.857111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 415/845] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:15:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:30.857111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d863038-3d0c-49a1-a321-4318d8d89912 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:30.945081 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 431/846] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:30.945724 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:30.997872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d863038-3d0c-49a1-a321-4318d8d89912 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:31.033431 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bb7bd-6b6f-4e3e-bd5a-b84f615efb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:31.037138 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bb7bd-6b6f-4e3e-bd5a-b84f615efb90 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:31.037138 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bb7bd-6b6f-4e3e-bd5a-b84f615efb90 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:31.037138 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bb7bd-6b6f-4e3e-bd5a-b84f615efb90 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:31.037138 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bb7bd-6b6f-4e3e-bd5a-b84f615efb90 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:31.037138 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bb7bd-6b6f-4e3e-bd5a-b84f615efb90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:31.037138 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bb7bd-6b6f-4e3e-bd5a-b84f615efb90 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:31.057034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 416/847] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Sep 5 14:15:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:31.062720 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75531fc5-737e-4983-89d9-07328d983fb7 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:31.107033 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:31.191348 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75531fc5-737e-4983-89d9-07328d983fb7 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:31.218589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e9a11-e4bc-48c1-998f-665f52ba16ac None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:31.219477 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e9a11-e4bc-48c1-998f-665f52ba16ac None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:31.219933 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e9a11-e4bc-48c1-998f-665f52ba16ac None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:31.221911 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 417/848] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:31.227003 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c63b0-4322-4fb3-b011-be07e0bee27c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:31.227973 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d06dba-77c3-48b6-86b9-35fdfc3581a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:31.228370 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c63b0-4322-4fb3-b011-be07e0bee27c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:31.228648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d06dba-77c3-48b6-86b9-35fdfc3581a5 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:31.228973 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d06dba-77c3-48b6-86b9-35fdfc3581a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:31.229273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d06dba-77c3-48b6-86b9-35fdfc3581a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:31.229525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c63b0-4322-4fb3-b011-be07e0bee27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:31.251920 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-587c63b0-4322-4fb3-b011-be07e0bee27c None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:31.253478 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-587c63b0-4322-4fb3-b011-be07e0bee27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:31.302498 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d06dba-77c3-48b6-86b9-35fdfc3581a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:31.303946 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d06dba-77c3-48b6-86b9-35fdfc3581a5 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:31.325722 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 418/849] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 14:15:31.326850 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c63b0-4322-4fb3-b011-be07e0bee27c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:31.340910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:31.359700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:31.412824 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 432/850] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:15:31 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 14:15:31.418991 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d06dba-77c3-48b6-86b9-35fdfc3581a5 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:31.445940 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c63b0-4322-4fb3-b011-be07e0bee27c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:31.485673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a6847-709f-4e2f-b695-5423a462d6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:31.486656 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a6847-709f-4e2f-b695-5423a462d6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:31.487174 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a6847-709f-4e2f-b695-5423a462d6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:31.487820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a6847-709f-4e2f-b695-5423a462d6f5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:31.488764 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a6847-709f-4e2f-b695-5423a462d6f5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:31.490355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a6847-709f-4e2f-b695-5423a462d6f5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:31.500337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-162a6847-709f-4e2f-b695-5423a462d6f5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 14:15:31.500337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:31.500337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:15:31.500337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:15:31.500337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:15:31.500337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:15:31.500337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:15:31.500337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:31.500337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 14:15:31.500337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:31.500337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:31.500337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:31.500337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:31.500337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:31.500337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:31.500337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:31.501336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:31.501336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:31.501336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:31.501336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:31.501336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:31.501336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:31.501336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:31.501336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:15:31.501336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:15:31.501336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:15:31.501336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:15:31.501336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:31.501336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:31.501336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:31.501336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:31.501336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:31.501336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:31.502296 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:31.502296 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:31.502296 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:31.502296 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:31.502296 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:31.502296 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:31.502296 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:31.502296 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:31.502296 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:31.502296 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:31.502296 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:15:31.502296 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:31.502296 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 14:15:31.502296 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:31.505037 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 419/851] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Sep 5 14:15:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:31.513216 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a6847-709f-4e2f-b695-5423a462d6f5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:31.526606 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d06dba-77c3-48b6-86b9-35fdfc3581a5 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:31.564547 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e5ded-342e-4eeb-a8d1-15cbc616dc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:31.565502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e5ded-342e-4eeb-a8d1-15cbc616dc76 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:31.565970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e5ded-342e-4eeb-a8d1-15cbc616dc76 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:31.566376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e5ded-342e-4eeb-a8d1-15cbc616dc76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:31.568408 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:31.579423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e5ded-342e-4eeb-a8d1-15cbc616dc76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:31.581235 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e5ded-342e-4eeb-a8d1-15cbc616dc76 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:31.598089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-226e5ded-342e-4eeb-a8d1-15cbc616dc76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:31.598089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:31.598089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:31.598089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:31.598089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:31.598089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:31.598089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:31.598089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:31.598089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:31.598089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:31.598089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:31.598089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:31.598089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:31.598089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:31.598089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:31.598089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:31.599426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:31.599426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:31.599426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:31.599426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:31.599426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:31.599426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:31.599426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:31.599426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:31.599426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:31.599426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:31.599426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:31.599426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:31.599426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:31.599426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:31.599426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:31.599426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:31.599426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:31.600344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:31.600344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:31.600344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:31.602468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 433/852] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:31.607725 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e5ded-342e-4eeb-a8d1-15cbc616dc76 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:31.619228 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:31.625046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a6847-709f-4e2f-b695-5423a462d6f5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:31.662088 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27baf72-1657-4269-9eb2-7e37b9a09912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:31.662692 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27baf72-1657-4269-9eb2-7e37b9a09912 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:31.662967 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27baf72-1657-4269-9eb2-7e37b9a09912 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:31.663247 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27baf72-1657-4269-9eb2-7e37b9a09912 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:31.663867 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27baf72-1657-4269-9eb2-7e37b9a09912 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:31.664167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27baf72-1657-4269-9eb2-7e37b9a09912 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:31.665617 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27baf72-1657-4269-9eb2-7e37b9a09912 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:31.670599 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 420/853] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 5 14:15:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:31.671430 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27baf72-1657-4269-9eb2-7e37b9a09912 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:31.721768 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e5ded-342e-4eeb-a8d1-15cbc616dc76 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:31.759759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132809e6-4df0-48e3-a516-0e981263ea79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:31.760292 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132809e6-4df0-48e3-a516-0e981263ea79 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:31.760932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132809e6-4df0-48e3-a516-0e981263ea79 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:31.761255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132809e6-4df0-48e3-a516-0e981263ea79 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:31.761928 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132809e6-4df0-48e3-a516-0e981263ea79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:31.762227 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132809e6-4df0-48e3-a516-0e981263ea79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:31.763611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132809e6-4df0-48e3-a516-0e981263ea79 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:31.781338 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 434/854] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:31.781998 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132809e6-4df0-48e3-a516-0e981263ea79 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:31.785246 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27baf72-1657-4269-9eb2-7e37b9a09912 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:31.823716 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25750e91-8332-48f0-be8a-3fae35872752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:31.824482 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25750e91-8332-48f0-be8a-3fae35872752 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:31.824832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25750e91-8332-48f0-be8a-3fae35872752 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:31.825136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25750e91-8332-48f0-be8a-3fae35872752 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:31.831914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:31.835710 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25750e91-8332-48f0-be8a-3fae35872752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:15:31.840541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-25750e91-8332-48f0-be8a-3fae35872752 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:31.840541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:31.840541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:31.840541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:31.840541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:31.840541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:31.840541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:31.840541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:31.840541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:31.840541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:31.840541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:31.840541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:31.840541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:15:31.840541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:15:31.840541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:15:31.840541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:15:31.845984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:15:31.845984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:15:31.845984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:15:31.845984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:15:31.845984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:31.845984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:31.845984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:31.845984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:31.845984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:31.845984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:31.845984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:31.845984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:31.845984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:31.845984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:31.845984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:31.845984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:31.846821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:31.846821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:31.846821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:31.846821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:31.846821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:15:31.846821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:15:31.846821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:15:31.846821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:15:31.846821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:15:31.846821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:15:31.846821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:15:31.846821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:31.846821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 421/855] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:15:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:31.846821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25750e91-8332-48f0-be8a-3fae35872752 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:31.869282 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:31.896022 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132809e6-4df0-48e3-a516-0e981263ea79 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:31.935041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a8b24-c481-4c6f-8aad-174d9c150ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:31.935884 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a8b24-c481-4c6f-8aad-174d9c150ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:31.936218 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a8b24-c481-4c6f-8aad-174d9c150ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:31.936549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a8b24-c481-4c6f-8aad-174d9c150ec9 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:31.937277 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a8b24-c481-4c6f-8aad-174d9c150ec9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:31.937641 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a8b24-c481-4c6f-8aad-174d9c150ec9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:31.939073 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a8b24-c481-4c6f-8aad-174d9c150ec9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:31.943977 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 435/856] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 5 14:15:31 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:31.944672 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a8b24-c481-4c6f-8aad-174d9c150ec9 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:31.968139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25750e91-8332-48f0-be8a-3fae35872752 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:32.021843 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c956c9-3c10-4993-acc6-71854512d4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:32.023064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c956c9-3c10-4993-acc6-71854512d4ce None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:32.023495 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c956c9-3c10-4993-acc6-71854512d4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:32.024627 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c956c9-3c10-4993-acc6-71854512d4ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:32.033569 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c956c9-3c10-4993-acc6-71854512d4ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:32.035260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c956c9-3c10-4993-acc6-71854512d4ce None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:32.048236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-82c956c9-3c10-4993-acc6-71854512d4ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:32.048236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:32.048236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:32.048236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:32.048236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:32.048236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:32.048236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:32.048236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:32.048236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:32.048236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:32.048236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:32.048236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:32.048236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:32.048236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:32.048236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:32.049405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:32.049405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:32.049405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:32.049405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:32.049405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:32.049405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:32.049405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:32.049405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:32.049405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:32.049405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:32.049405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:32.049405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:32.049405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:32.049405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:32.049405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:32.049405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:32.049405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:32.050523 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:32.050523 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:32.050523 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:32.050523 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:32.050523 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:32.050523 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:32.050523 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:32.050523 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:32.058078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 422/857] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:32.058580 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c956c9-3c10-4993-acc6-71854512d4ce None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:32.075287 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a8b24-c481-4c6f-8aad-174d9c150ec9 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:32.091466 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:32.122290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2639249-022e-4f68-94a7-40152109b19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:32.123190 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2639249-022e-4f68-94a7-40152109b19e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:32.123467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2639249-022e-4f68-94a7-40152109b19e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:32.123735 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2639249-022e-4f68-94a7-40152109b19e None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:32.124587 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2639249-022e-4f68-94a7-40152109b19e None admin] RBAC: Adding query filter params (name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:32.124693 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2639249-022e-4f68-94a7-40152109b19e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:32.126235 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2639249-022e-4f68-94a7-40152109b19e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:32.141812 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 436/858] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 5 14:15:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:32.147255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2639249-022e-4f68-94a7-40152109b19e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:32.162135 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:32.183183 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c956c9-3c10-4993-acc6-71854512d4ce None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:32.235732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205811d-c9cb-4a3a-8f79-0cb339bcfb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:32.236345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205811d-c9cb-4a3a-8f79-0cb339bcfb31 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:32.236681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205811d-c9cb-4a3a-8f79-0cb339bcfb31 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:32.236953 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205811d-c9cb-4a3a-8f79-0cb339bcfb31 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:32.237690 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205811d-c9cb-4a3a-8f79-0cb339bcfb31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:32.237994 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205811d-c9cb-4a3a-8f79-0cb339bcfb31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:32.239415 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205811d-c9cb-4a3a-8f79-0cb339bcfb31 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:32.264750 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 423/859] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:32.265513 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205811d-c9cb-4a3a-8f79-0cb339bcfb31 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:32.275903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2639249-022e-4f68-94a7-40152109b19e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:32.313570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ed83c-64d7-4fa7-9b81-f8ba00cc74fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:32.314297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ed83c-64d7-4fa7-9b81-f8ba00cc74fa None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:32.314519 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ed83c-64d7-4fa7-9b81-f8ba00cc74fa None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:32.314793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ed83c-64d7-4fa7-9b81-f8ba00cc74fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:32.330012 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ed83c-64d7-4fa7-9b81-f8ba00cc74fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:32.331617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ed83c-64d7-4fa7-9b81-f8ba00cc74fa None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:32.346531 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-588ed83c-64d7-4fa7-9b81-f8ba00cc74fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:32.346531 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:32.346531 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:32.346531 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:32.346531 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:32.346531 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:32.346531 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:32.346531 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:32.346531 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:32.346531 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:32.346531 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:32.346531 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:32.346531 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:32.346531 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:32.346531 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:32.346531 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:32.347500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:32.347500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:32.347500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:32.347500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:32.347500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:32.347500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:32.347500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:32.347500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:32.347500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:32.347500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:32.347500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:32.347500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:32.347500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:32.347500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:32.347500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:32.347500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:32.347500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:32.348387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:32.348387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:32.348387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:32.352464 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 437/860] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:32.353761 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ed83c-64d7-4fa7-9b81-f8ba00cc74fa None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:32.382051 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:32.402268 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205811d-c9cb-4a3a-8f79-0cb339bcfb31 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:32.447817 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274acdb-2df4-4da2-b7e2-605a86320f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:32.449986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274acdb-2df4-4da2-b7e2-605a86320f68 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:32.450509 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274acdb-2df4-4da2-b7e2-605a86320f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:32.450983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274acdb-2df4-4da2-b7e2-605a86320f68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:32.452847 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274acdb-2df4-4da2-b7e2-605a86320f68 None admin] RBAC: Adding query filter params (role.id=f22e6e660eab44c5be25e3dee1e3042c, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=1ed60e9eecb94ef39c2f4a5e5f50d670) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:32.453415 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274acdb-2df4-4da2-b7e2-605a86320f68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:32.455091 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274acdb-2df4-4da2-b7e2-605a86320f68 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:32.468357 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ed83c-64d7-4fa7-9b81-f8ba00cc74fa None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:32.469172 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 424/861] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:15:32 2022] GET /identity/v3/role_assignments?user.id=1ed60e9eecb94ef39c2f4a5e5f50d670&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=f22e6e660eab44c5be25e3dee1e3042c => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:32.507104 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb32bf-37a7-445b-8834-357d7e00140c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:32.507716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb32bf-37a7-445b-8834-357d7e00140c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:32.507996 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb32bf-37a7-445b-8834-357d7e00140c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:32.509123 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb32bf-37a7-445b-8834-357d7e00140c None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:32.509581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb32bf-37a7-445b-8834-357d7e00140c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:32.509882 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb32bf-37a7-445b-8834-357d7e00140c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:32.511276 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb32bf-37a7-445b-8834-357d7e00140c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:32.530193 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 438/862] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:32.531595 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274acdb-2df4-4da2-b7e2-605a86320f68 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:32.533848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37ee1e-5bc1-4b1a-aa60-01d73d12cc12 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:32.534326 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37ee1e-5bc1-4b1a-aa60-01d73d12cc12 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:32.534793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37ee1e-5bc1-4b1a-aa60-01d73d12cc12 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:32.536634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 439/863] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:15:32.542553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bda7a-8834-468b-b907-ca4f2aadef3e None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:32.542835 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bda7a-8834-468b-b907-ca4f2aadef3e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:32.543111 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bda7a-8834-468b-b907-ca4f2aadef3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:32.553167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:32.562613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-223bda7a-8834-468b-b907-ca4f2aadef3e None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:32.565292 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-223bda7a-8834-468b-b907-ca4f2aadef3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:32.650825 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 440/864] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:32.685244 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274acdb-2df4-4da2-b7e2-605a86320f68 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:32.719680 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd0b17-57f6-4e92-bad5-4d359ab012d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:32.720309 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd0b17-57f6-4e92-bad5-4d359ab012d7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:32.720591 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd0b17-57f6-4e92-bad5-4d359ab012d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:32.720861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd0b17-57f6-4e92-bad5-4d359ab012d7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:32.729208 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd0b17-57f6-4e92-bad5-4d359ab012d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:32.730656 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd0b17-57f6-4e92-bad5-4d359ab012d7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:32.741846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-9ccd0b17-57f6-4e92-bad5-4d359ab012d7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 14:15:32.741846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:32.741846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:32.741846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:32.741846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:32.741846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:32.741846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:32.741846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:32.741846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:32.741846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:32.741846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:32.741846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:32.741846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:32.741846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:32.741846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:32.741846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:32.744209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:32.744209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:32.744209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:32.744209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:32.744209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:32.744209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:32.744209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:32.744209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:32.744209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:32.744209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:32.744209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:32.744209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:32.744209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:32.744209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:32.744209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:32.744209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:32.744209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:32.744209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:32.745213 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:32.745213 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:32.745213 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:32.745213 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:32.745213 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:32.745213 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:32.745213 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:32.745213 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:32.745213 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 14:15:32.745213 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:32.745213 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 425/865] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 5 14:15:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:32.751950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bda7a-8834-468b-b907-ca4f2aadef3e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:32.768832 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:32.858374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bda7a-8834-468b-b907-ca4f2aadef3e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:32.894892 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19b873-1420-4fa6-a090-91917c6072c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:32.895909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19b873-1420-4fa6-a090-91917c6072c1 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:32.896384 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19b873-1420-4fa6-a090-91917c6072c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:32.896862 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19b873-1420-4fa6-a090-91917c6072c1 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:32.897875 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19b873-1420-4fa6-a090-91917c6072c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:32.898376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19b873-1420-4fa6-a090-91917c6072c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:32.900263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19b873-1420-4fa6-a090-91917c6072c1 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:32.921424 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd0b17-57f6-4e92-bad5-4d359ab012d7 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:32.921771 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 441/866] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Sep 5 14:15:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:32.924199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19b873-1420-4fa6-a090-91917c6072c1 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:32.990705 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:33.003902 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:33.040696 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19b873-1420-4fa6-a090-91917c6072c1 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:33.044475 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd0b17-57f6-4e92-bad5-4d359ab012d7 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:33.088452 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747d597-090f-496d-b0b8-5fd55acdff5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:33.089077 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747d597-090f-496d-b0b8-5fd55acdff5c None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:33.089360 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747d597-090f-496d-b0b8-5fd55acdff5c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:33.089627 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747d597-090f-496d-b0b8-5fd55acdff5c None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:33.090012 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7c211-6c2e-4dff-9dd0-7506b0d786cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:33.090465 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747d597-090f-496d-b0b8-5fd55acdff5c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:33.091259 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7c211-6c2e-4dff-9dd0-7506b0d786cf None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:33.091638 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747d597-090f-496d-b0b8-5fd55acdff5c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:33.091954 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7c211-6c2e-4dff-9dd0-7506b0d786cf None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:33.092412 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7c211-6c2e-4dff-9dd0-7506b0d786cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:33.151809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 426/867] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 5 14:15:32 2022] POST /identity/v3/services => generated 251 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:15:33.173487 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7c211-6c2e-4dff-9dd0-7506b0d786cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:33.175324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7c211-6c2e-4dff-9dd0-7506b0d786cf None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:33.259670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:33.299273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 442/868] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:15:32 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 14:15:33.300614 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747d597-090f-496d-b0b8-5fd55acdff5c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:33.416633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747d597-090f-496d-b0b8-5fd55acdff5c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:33.438390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:33.453262 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6f709-3d32-41fb-94e2-47c2a77d6e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:33.453891 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6f709-3d32-41fb-94e2-47c2a77d6e49 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:33.454172 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6f709-3d32-41fb-94e2-47c2a77d6e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:33.454436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6f709-3d32-41fb-94e2-47c2a77d6e49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:33.465239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6f709-3d32-41fb-94e2-47c2a77d6e49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:33.466686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6f709-3d32-41fb-94e2-47c2a77d6e49 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:33.481986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-57b6f709-3d32-41fb-94e2-47c2a77d6e49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:33.481986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:33.481986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:33.481986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:33.481986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:33.481986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:33.481986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:33.481986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:33.481986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:33.481986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:33.481986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:33.481986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:33.481986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:33.481986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:33.481986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:33.481986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:33.482958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:33.482958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:33.482958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:33.482958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:33.482958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:33.482958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:33.482958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:33.482958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:33.482958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:33.482958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:33.482958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:33.482958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:33.482958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:33.482958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:33.482958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:33.482958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:33.482958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:33.483848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:33.483848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:33.483848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:33.487730 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 427/869] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:33.489080 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7c211-6c2e-4dff-9dd0-7506b0d786cf None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:33.603642 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7c211-6c2e-4dff-9dd0-7506b0d786cf None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:33.640484 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab874d-ad45-467d-8d5a-b41719f17a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:33.641129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab874d-ad45-467d-8d5a-b41719f17a37 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:33.641404 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab874d-ad45-467d-8d5a-b41719f17a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:33.641675 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab874d-ad45-467d-8d5a-b41719f17a37 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:33.642316 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab874d-ad45-467d-8d5a-b41719f17a37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:33.642619 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab874d-ad45-467d-8d5a-b41719f17a37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:33.643998 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab874d-ad45-467d-8d5a-b41719f17a37 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:33.656176 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 443/870] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:33.661755 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6f709-3d32-41fb-94e2-47c2a77d6e49 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:33.770244 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6f709-3d32-41fb-94e2-47c2a77d6e49 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:33.807954 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f871c-2e2e-407c-8d53-d1b9914d4f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:33.808969 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f871c-2e2e-407c-8d53-d1b9914d4f9e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:33.809509 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f871c-2e2e-407c-8d53-d1b9914d4f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:33.809987 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f871c-2e2e-407c-8d53-d1b9914d4f9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:33.817251 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f871c-2e2e-407c-8d53-d1b9914d4f9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:33.818926 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f871c-2e2e-407c-8d53-d1b9914d4f9e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:33.830660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-ae3f871c-2e2e-407c-8d53-d1b9914d4f9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:33.830660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:33.830660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:33.830660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:33.830660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:33.830660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:33.830660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:33.830660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:33.830660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:33.830660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:33.830660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:33.830660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:33.830660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:33.830660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:33.830660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:33.831575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:33.831575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:33.831575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:33.831575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:33.831575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:33.831575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:33.831575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:33.831575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:33.831575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:33.831575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:33.831575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:33.831575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:33.831575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:33.831575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:33.831575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:33.831575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:33.831575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:33.832471 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:33.832471 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:33.832471 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:33.832471 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:33.832471 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:33.832471 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:33.832471 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:33.832471 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:33.838601 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 428/871] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:33.849951 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab874d-ad45-467d-8d5a-b41719f17a37 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:33.886774 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:33.933283 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885800a3-226a-41fd-8eb8-3ce30e264a5f None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:33.933629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885800a3-226a-41fd-8eb8-3ce30e264a5f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:33.933828 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885800a3-226a-41fd-8eb8-3ce30e264a5f None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:33.935435 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 429/872] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:15:33.940144 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe59f88-0703-465c-b2e1-3af7ff64df0a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:33.940452 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe59f88-0703-465c-b2e1-3af7ff64df0a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:33.940685 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe59f88-0703-465c-b2e1-3af7ff64df0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:33.959169 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-cfe59f88-0703-465c-b2e1-3af7ff64df0a None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:33.960428 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cfe59f88-0703-465c-b2e1-3af7ff64df0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:33.964449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab874d-ad45-467d-8d5a-b41719f17a37 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:33.988735 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:34.010246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3c680-5369-4eab-8481-3eaa4c27ca02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:34.011391 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3c680-5369-4eab-8481-3eaa4c27ca02 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:34.011845 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3c680-5369-4eab-8481-3eaa4c27ca02 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:34.012444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3c680-5369-4eab-8481-3eaa4c27ca02 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:34.013655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3c680-5369-4eab-8481-3eaa4c27ca02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:34.014134 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3c680-5369-4eab-8481-3eaa4c27ca02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:34.015743 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3c680-5369-4eab-8481-3eaa4c27ca02 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:34.039399 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 430/874] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:33 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 14:15:34.040475 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 444/874] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:34.042014 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe59f88-0703-465c-b2e1-3af7ff64df0a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:34.143937 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe59f88-0703-465c-b2e1-3af7ff64df0a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:34.179259 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749936d-7e24-4d7f-8c85-f09781ef33be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:34.180315 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749936d-7e24-4d7f-8c85-f09781ef33be None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:34.180770 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749936d-7e24-4d7f-8c85-f09781ef33be None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:34.181269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749936d-7e24-4d7f-8c85-f09781ef33be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:34.182220 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749936d-7e24-4d7f-8c85-f09781ef33be None admin] RBAC: Adding query filter params (role.id=5351e6d174334a8eaf71e8d2b3c079a7, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=635e47d0a5a34fdfb5c8967a96a87828) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:34.182830 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749936d-7e24-4d7f-8c85-f09781ef33be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:34.184428 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749936d-7e24-4d7f-8c85-f09781ef33be None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:34.190784 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 431/875] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:15:34 2022] GET /identity/v3/role_assignments?user.id=635e47d0a5a34fdfb5c8967a96a87828&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=5351e6d174334a8eaf71e8d2b3c079a7 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:34.308444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3c680-5369-4eab-8481-3eaa4c27ca02 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:34.405919 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:34.416430 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3c680-5369-4eab-8481-3eaa4c27ca02 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:34.454206 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d88cd9-cd60-4e4f-af53-992659ac6f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:34.454846 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d88cd9-cd60-4e4f-af53-992659ac6f3d None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:34.455130 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d88cd9-cd60-4e4f-af53-992659ac6f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:34.455402 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d88cd9-cd60-4e4f-af53-992659ac6f3d None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:34.456061 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d88cd9-cd60-4e4f-af53-992659ac6f3d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:34.457535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d88cd9-cd60-4e4f-af53-992659ac6f3d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:34.533909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 445/876] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 5 14:15:34 2022] POST /identity/v3/services => generated 269 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:15:34.592148 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ecee5-e9a6-4a8b-8125-2067cf64e43e None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:34.592651 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ecee5-e9a6-4a8b-8125-2067cf64e43e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:34.592651 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ecee5-e9a6-4a8b-8125-2067cf64e43e None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:34.594311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 432/877] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:34.599938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed54c3-b6a9-4865-9803-3d0ba85989eb None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:34.600214 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed54c3-b6a9-4865-9803-3d0ba85989eb None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:34.600489 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed54c3-b6a9-4865-9803-3d0ba85989eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:34.621876 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-33ed54c3-b6a9-4865-9803-3d0ba85989eb None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:34.623188 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-33ed54c3-b6a9-4865-9803-3d0ba85989eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:34.709382 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 446/878] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:34.994169 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ecee5-e9a6-4a8b-8125-2067cf64e43e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:35.023617 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:35.112197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ecee5-e9a6-4a8b-8125-2067cf64e43e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:35.148112 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e0796-e884-434a-95b6-d140789b0b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:35.149234 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e0796-e884-434a-95b6-d140789b0b8e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:35.150024 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e0796-e884-434a-95b6-d140789b0b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:35.150468 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e0796-e884-434a-95b6-d140789b0b8e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:35.151214 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e0796-e884-434a-95b6-d140789b0b8e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:35.152741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e0796-e884-434a-95b6-d140789b0b8e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:35.161768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-719e0796-e884-434a-95b6-d140789b0b8e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 14:15:35.161768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:35.161768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:15:35.161768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:15:35.161768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:15:35.161768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:15:35.161768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:15:35.161768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:35.161768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 14:15:35.161768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:35.161768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:35.161768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:35.161768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:35.161768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:35.161768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:35.161768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:35.161768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:35.162727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:35.162727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:35.162727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:35.162727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:35.162727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:35.162727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:35.162727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:15:35.162727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:15:35.162727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:15:35.162727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:15:35.162727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:35.162727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:35.162727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:35.162727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:35.162727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:35.162727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:35.163562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:35.163562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:35.163562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:35.163562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:35.163562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:35.163562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:35.163562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:35.163562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:35.163562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:35.163562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:35.163562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:15:35.163562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:35.163562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 14:15:35.163562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:35.165882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 433/879] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 5 14:15:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:35.171606 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed54c3-b6a9-4865-9803-3d0ba85989eb None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:35.174454 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddcdb3-9ed1-441b-9e53-db4b854e6c37 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:35.174744 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddcdb3-9ed1-441b-9e53-db4b854e6c37 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:35.175020 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ddcdb3-9ed1-441b-9e53-db4b854e6c37 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:35.176690 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 434/880] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:35.182482 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1d26f-acdd-4827-8c8d-4bda0cc4e5c0 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:35.182771 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1d26f-acdd-4827-8c8d-4bda0cc4e5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:35.183051 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1d26f-acdd-4827-8c8d-4bda0cc4e5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:35.204315 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d4b1d26f-acdd-4827-8c8d-4bda0cc4e5c0 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:35.205545 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d4b1d26f-acdd-4827-8c8d-4bda0cc4e5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:35.274329 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:35.293192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 435/881] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 14:15:35.302357 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed54c3-b6a9-4865-9803-3d0ba85989eb None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:35.338756 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f2006-6448-4ea8-9ef9-50ee35ea1fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:35.340214 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f2006-6448-4ea8-9ef9-50ee35ea1fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:35.340722 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f2006-6448-4ea8-9ef9-50ee35ea1fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:35.341269 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f2006-6448-4ea8-9ef9-50ee35ea1fd3 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:35.342105 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f2006-6448-4ea8-9ef9-50ee35ea1fd3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:35.342609 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f2006-6448-4ea8-9ef9-50ee35ea1fd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:35.344287 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f2006-6448-4ea8-9ef9-50ee35ea1fd3 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:35.349792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 447/882] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 5 14:15:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:35.356878 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1d26f-acdd-4827-8c8d-4bda0cc4e5c0 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:35.381990 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:35.460404 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1d26f-acdd-4827-8c8d-4bda0cc4e5c0 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:35.497161 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4a0c2-f76a-4e1e-88ca-ed8a0f843116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:35.497783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4a0c2-f76a-4e1e-88ca-ed8a0f843116 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:35.498064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4a0c2-f76a-4e1e-88ca-ed8a0f843116 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:35.498331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4a0c2-f76a-4e1e-88ca-ed8a0f843116 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:35.498973 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4a0c2-f76a-4e1e-88ca-ed8a0f843116 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:35.499273 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4a0c2-f76a-4e1e-88ca-ed8a0f843116 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:35.500645 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4a0c2-f76a-4e1e-88ca-ed8a0f843116 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:35.505951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 436/883] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 5 14:15:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:35.569694 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f2006-6448-4ea8-9ef9-50ee35ea1fd3 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:35.685721 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f2006-6448-4ea8-9ef9-50ee35ea1fd3 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:35.722205 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdcac3-af61-4518-a638-d9e84eb1d3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:35.722896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdcac3-af61-4518-a638-d9e84eb1d3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:35.723176 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdcac3-af61-4518-a638-d9e84eb1d3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:35.723450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdcac3-af61-4518-a638-d9e84eb1d3a1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:35.724098 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cdcac3-af61-4518-a638-d9e84eb1d3a1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:35.725520 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cdcac3-af61-4518-a638-d9e84eb1d3a1 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:35.735310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-a9cdcac3-af61-4518-a638-d9e84eb1d3a1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 14:15:35.735310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:35.735310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:15:35.735310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:15:35.735310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:15:35.735310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:15:35.735310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:15:35.735310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:35.735310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 14:15:35.735310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:35.735310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:35.735310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:35.735310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:35.735310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:35.735310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:35.735310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:35.735310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:35.736327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:35.736327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:35.736327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:35.736327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:35.736327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:35.736327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:35.736327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:15:35.736327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:15:35.736327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:15:35.736327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:15:35.736327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:35.736327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:35.736327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:35.736327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:35.736327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:35.736327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:35.737263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:35.737263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:35.737263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:35.737263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:35.737263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:35.737263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:35.737263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:35.737263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:35.737263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:35.737263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:35.737263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:15:35.737263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:35.737263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 14:15:35.737263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:35.737263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 448/884] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 5 14:15:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:35.744991 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4a0c2-f76a-4e1e-88ca-ed8a0f843116 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:35.840831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:35.856345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4a0c2-f76a-4e1e-88ca-ed8a0f843116 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:35.891989 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4fc19-b59f-421d-b666-f9990abd5ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:35.892597 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4fc19-b59f-421d-b666-f9990abd5ecd None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:35.892871 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4fc19-b59f-421d-b666-f9990abd5ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:35.893172 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4fc19-b59f-421d-b666-f9990abd5ecd None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:35.893986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4fc19-b59f-421d-b666-f9990abd5ecd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:35.894695 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4fc19-b59f-421d-b666-f9990abd5ecd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:35.896056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4fc19-b59f-421d-b666-f9990abd5ecd None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:35.901762 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 437/885] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 5 14:15:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:35.907303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdcac3-af61-4518-a638-d9e84eb1d3a1 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:35.922572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:36.024741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdcac3-af61-4518-a638-d9e84eb1d3a1 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:36.063181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752b91e-55bd-492e-8965-32a27c32aa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:36.064191 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752b91e-55bd-492e-8965-32a27c32aa79 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:36.064671 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752b91e-55bd-492e-8965-32a27c32aa79 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:36.065274 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752b91e-55bd-492e-8965-32a27c32aa79 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:36.066137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752b91e-55bd-492e-8965-32a27c32aa79 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:36.066700 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752b91e-55bd-492e-8965-32a27c32aa79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:36.068272 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752b91e-55bd-492e-8965-32a27c32aa79 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:36.074673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 449/886] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 5 14:15:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:36.080723 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4fc19-b59f-421d-b666-f9990abd5ecd None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:36.186999 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4fc19-b59f-421d-b666-f9990abd5ecd None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:36.225209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7d4e3-0c21-48a2-8f89-f6b12c96fd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:36.225896 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7d4e3-0c21-48a2-8f89-f6b12c96fd21 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:36.226181 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7d4e3-0c21-48a2-8f89-f6b12c96fd21 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:36.226451 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7d4e3-0c21-48a2-8f89-f6b12c96fd21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:36.228343 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7d4e3-0c21-48a2-8f89-f6b12c96fd21 None admin] RBAC: Adding query filter params (interface=public, service_id=9f5ac7f4f8044a2893176204dddcb471, region_id=RegionOne) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:36.228659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7d4e3-0c21-48a2-8f89-f6b12c96fd21 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:36.230135 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7d4e3-0c21-48a2-8f89-f6b12c96fd21 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:36.237696 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 438/887] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 5 14:15:36 2022] GET /identity/v3/endpoints?service_id=9f5ac7f4f8044a2893176204dddcb471&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:36.243756 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752b91e-55bd-492e-8965-32a27c32aa79 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:36.315836 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:36.348044 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752b91e-55bd-492e-8965-32a27c32aa79 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:36.351363 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc64d56-826b-4517-8604-0d2ca0263c0e None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:36.351648 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc64d56-826b-4517-8604-0d2ca0263c0e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:36.352453 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc64d56-826b-4517-8604-0d2ca0263c0e None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:36.357617 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 439/888] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:15:36.359961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a23ec7-e8c0-4cde-a5d6-0b8b7ab4d889 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:36.360463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a23ec7-e8c0-4cde-a5d6-0b8b7ab4d889 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:36.360854 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a23ec7-e8c0-4cde-a5d6-0b8b7ab4d889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:36.385343 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-47a23ec7-e8c0-4cde-a5d6-0b8b7ab4d889 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:36.385718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b10e4-026f-4b98-be3d-2ec0e9bab363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:36.386330 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b10e4-026f-4b98-be3d-2ec0e9bab363 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:36.386524 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-47a23ec7-e8c0-4cde-a5d6-0b8b7ab4d889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:36.386625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b10e4-026f-4b98-be3d-2ec0e9bab363 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:36.386865 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b10e4-026f-4b98-be3d-2ec0e9bab363 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:36.387508 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b10e4-026f-4b98-be3d-2ec0e9bab363 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:36.388908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b10e4-026f-4b98-be3d-2ec0e9bab363 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:36.395311 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 450/889] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 5 14:15:36 2022] GET /identity/v3/services => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:15:36.395971 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:36.469543 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 440/890] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:36.616987 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff945e-1f16-4e1d-8dd0-ba7baff69017 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:36.617604 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff945e-1f16-4e1d-8dd0-ba7baff69017 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:36.618763 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff945e-1f16-4e1d-8dd0-ba7baff69017 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:36.620153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 451/891] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:36.625379 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27ecff-df82-48d2-ae16-64315bafea7d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:36.625766 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27ecff-df82-48d2-ae16-64315bafea7d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:36.626136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27ecff-df82-48d2-ae16-64315bafea7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:36.645089 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-bd27ecff-df82-48d2-ae16-64315bafea7d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:36.646272 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bd27ecff-df82-48d2-ae16-64315bafea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:36.719871 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 441/892] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:36.750355 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff945e-1f16-4e1d-8dd0-ba7baff69017 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:36.868867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff945e-1f16-4e1d-8dd0-ba7baff69017 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:36.904040 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5f31d-201c-4b1c-8a18-962c6eb27e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:36.904665 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5f31d-201c-4b1c-8a18-962c6eb27e09 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:36.904943 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5f31d-201c-4b1c-8a18-962c6eb27e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:36.905243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5f31d-201c-4b1c-8a18-962c6eb27e09 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:36.907058 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:36.917119 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5f31d-201c-4b1c-8a18-962c6eb27e09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:15:36.922160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-1cc5f31d-201c-4b1c-8a18-962c6eb27e09 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 14:15:36.922160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:36.922160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:36.922160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:36.922160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:36.922160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:36.922160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:36.922160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:36.922160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:36.922160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:36.922160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:36.922160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:36.922160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:15:36.922160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:15:36.922160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:15:36.922160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:15:36.932482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:15:36.932482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:15:36.932482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:15:36.932482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:15:36.932482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:36.932482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:36.932482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:36.932482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:36.932482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:36.932482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:36.932482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:36.932482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:36.932482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:36.932482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:36.932482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:36.932482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:36.934537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:36.934537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:36.934537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:36.934537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:36.934537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:15:36.934537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:15:36.934537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:15:36.934537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:15:36.934537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:15:36.934537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:15:36.934537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 14:15:36.934537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:36.934537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 452/893] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Sep 5 14:15:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:36.936171 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27ecff-df82-48d2-ae16-64315bafea7d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:36.992092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5f31d-201c-4b1c-8a18-962c6eb27e09 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:37.004106 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:37.034683 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27ecff-df82-48d2-ae16-64315bafea7d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:37.071918 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb7915-7306-4f38-89e4-c04f211a559f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:37.072346 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb7915-7306-4f38-89e4-c04f211a559f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:37.072563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb7915-7306-4f38-89e4-c04f211a559f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:37.072829 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb7915-7306-4f38-89e4-c04f211a559f None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:37.073519 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb7915-7306-4f38-89e4-c04f211a559f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:37.073817 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb7915-7306-4f38-89e4-c04f211a559f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:37.075177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb7915-7306-4f38-89e4-c04f211a559f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:37.083863 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 442/894] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Sep 5 14:15:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:37.090518 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb7915-7306-4f38-89e4-c04f211a559f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:37.108623 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5f31d-201c-4b1c-8a18-962c6eb27e09 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:37.155307 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f48b54-8cef-4e61-a0e4-dacc5657bf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:37.156227 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f48b54-8cef-4e61-a0e4-dacc5657bf07 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:37.156501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f48b54-8cef-4e61-a0e4-dacc5657bf07 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:37.156765 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f48b54-8cef-4e61-a0e4-dacc5657bf07 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:37.157616 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f48b54-8cef-4e61-a0e4-dacc5657bf07 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:37.159458 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f48b54-8cef-4e61-a0e4-dacc5657bf07 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:37.172027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-c4f48b54-8cef-4e61-a0e4-dacc5657bf07 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 14:15:37.172027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:37.172027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:15:37.172027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:15:37.172027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:15:37.172027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:15:37.172027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:15:37.172027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:37.172027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 14:15:37.172027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:37.172027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:37.172027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:37.172027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:37.172027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:37.172027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:37.172027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:37.173185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:37.173185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:37.173185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:37.173185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:37.173185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:37.173185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:37.173185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:37.173185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:15:37.173185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:15:37.173185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:15:37.173185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:15:37.173185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:37.173185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:37.173185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:37.173185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:37.173185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:37.173185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:37.174243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:37.174243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:37.174243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:37.174243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:37.174243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:37.174243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:37.174243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:37.174243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:37.174243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:37.174243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:37.174243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:15:37.174243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:37.174243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 14:15:37.174243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:37.174243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 453/895] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Sep 5 14:15:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:37.180035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f48b54-8cef-4e61-a0e4-dacc5657bf07 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:37.218079 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb7915-7306-4f38-89e4-c04f211a559f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:37.245845 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:37.254728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573313cc-9581-4577-8b03-5ebbb5e0b411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:37.255946 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573313cc-9581-4577-8b03-5ebbb5e0b411 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:37.259125 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573313cc-9581-4577-8b03-5ebbb5e0b411 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:37.259125 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573313cc-9581-4577-8b03-5ebbb5e0b411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:37.259704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:37.275995 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573313cc-9581-4577-8b03-5ebbb5e0b411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:37.277756 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573313cc-9581-4577-8b03-5ebbb5e0b411 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:37.293913 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f48b54-8cef-4e61-a0e4-dacc5657bf07 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:37.296575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-573313cc-9581-4577-8b03-5ebbb5e0b411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:37.296575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:37.296575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:37.296575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:37.296575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:37.296575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:37.296575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:37.296575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:37.296575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:37.296575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:37.296575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:37.296575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:37.296575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:37.296575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:37.296575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:37.296575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:37.297668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:37.297668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:37.297668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:37.297668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:37.297668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:37.297668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:37.297668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:37.297668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:37.297668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:37.297668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:37.297668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:37.297668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:37.297668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:37.297668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:37.297668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:37.297668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:37.297668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:37.298551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:37.298551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:37.298551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:37.303170 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 443/896] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:37.304078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573313cc-9581-4577-8b03-5ebbb5e0b411 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:37.334269 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadb3c6-1029-4cac-999e-2da6e6007e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:37.335213 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadb3c6-1029-4cac-999e-2da6e6007e21 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:37.335687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadb3c6-1029-4cac-999e-2da6e6007e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:37.336147 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadb3c6-1029-4cac-999e-2da6e6007e21 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:37.337180 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadb3c6-1029-4cac-999e-2da6e6007e21 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:37.337809 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadb3c6-1029-4cac-999e-2da6e6007e21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:37.339371 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadb3c6-1029-4cac-999e-2da6e6007e21 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:37.349718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 454/897] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 5 14:15:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:37.351788 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadb3c6-1029-4cac-999e-2da6e6007e21 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:37.434849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573313cc-9581-4577-8b03-5ebbb5e0b411 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:37.474465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadb3c6-1029-4cac-999e-2da6e6007e21 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:37.480094 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec58e4-a078-4f91-a412-2ecf3951cde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:37.480703 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec58e4-a078-4f91-a412-2ecf3951cde8 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:37.480981 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec58e4-a078-4f91-a412-2ecf3951cde8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:37.481281 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec58e4-a078-4f91-a412-2ecf3951cde8 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:37.482451 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec58e4-a078-4f91-a412-2ecf3951cde8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:37.483272 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec58e4-a078-4f91-a412-2ecf3951cde8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:37.485124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec58e4-a078-4f91-a412-2ecf3951cde8 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:37.500027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:37.502902 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 444/898] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:37.508858 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec58e4-a078-4f91-a412-2ecf3951cde8 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:37.516048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e44e43-3486-43e4-82d3-cdb814e559c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:37.516674 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e44e43-3486-43e4-82d3-cdb814e559c5 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:37.516948 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e44e43-3486-43e4-82d3-cdb814e559c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:37.517252 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e44e43-3486-43e4-82d3-cdb814e559c5 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:37.517894 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e44e43-3486-43e4-82d3-cdb814e559c5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:37.518198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e44e43-3486-43e4-82d3-cdb814e559c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:37.519697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e44e43-3486-43e4-82d3-cdb814e559c5 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:37.526388 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 455/899] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 5 14:15:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:37.532060 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e44e43-3486-43e4-82d3-cdb814e559c5 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:37.569727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:37.628975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec58e4-a078-4f91-a412-2ecf3951cde8 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:37.658150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e44e43-3486-43e4-82d3-cdb814e559c5 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:37.667348 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd37994-22f9-4bcf-8d56-64b5d196d22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:37.667972 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd37994-22f9-4bcf-8d56-64b5d196d22d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:37.668247 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd37994-22f9-4bcf-8d56-64b5d196d22d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:37.668513 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd37994-22f9-4bcf-8d56-64b5d196d22d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:37.676429 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd37994-22f9-4bcf-8d56-64b5d196d22d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:37.677871 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd37994-22f9-4bcf-8d56-64b5d196d22d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:37.688831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-6bd37994-22f9-4bcf-8d56-64b5d196d22d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 14:15:37.688831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:37.688831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:37.688831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:37.688831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:37.688831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:37.688831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:37.688831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:37.688831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:37.688831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:37.688831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:37.688831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:37.688831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:37.688831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:37.688831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:37.688831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:37.689951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:37.689951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:37.689951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:37.689951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:37.689951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:37.689951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:37.689951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:37.689951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:37.689951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:37.689951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:37.689951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:37.689951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:37.689951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:37.689951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:37.689951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:37.689951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:37.689951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:37.689951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:37.690925 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:37.690925 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:37.690925 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:37.690925 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:37.690925 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:37.690925 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:37.690925 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:37.690925 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:37.690925 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 14:15:37.690925 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:37.690925 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 445/900] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 5 14:15:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:37.691525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9222d-f747-4277-8a29-f97a6f13a722 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:37.691687 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9222d-f747-4277-8a29-f97a6f13a722 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:37.691964 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9222d-f747-4277-8a29-f97a6f13a722 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:37.693303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 446/901] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:37.698124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9222d-f747-4277-8a29-f97a6f13a722 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:37.703664 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f57485-87ca-41f3-81d2-5cfdd51d2983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:37.704488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f57485-87ca-41f3-81d2-5cfdd51d2983 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:37.704944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f57485-87ca-41f3-81d2-5cfdd51d2983 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:37.705424 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f57485-87ca-41f3-81d2-5cfdd51d2983 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:37.706340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f57485-87ca-41f3-81d2-5cfdd51d2983 None admin] RBAC: Adding query filter params (interface=public, service_id=48217b9e84274f05962a286324490551, region_id=RegionOne) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:37.706844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f57485-87ca-41f3-81d2-5cfdd51d2983 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:37.708377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f57485-87ca-41f3-81d2-5cfdd51d2983 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:37.715456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 456/902] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 5 14:15:37 2022] GET /identity/v3/endpoints?service_id=48217b9e84274f05962a286324490551&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:37.716804 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72068641-49f3-4905-84cd-3dd10efdb90f None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:37.717116 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72068641-49f3-4905-84cd-3dd10efdb90f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:37.717394 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72068641-49f3-4905-84cd-3dd10efdb90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:37.735773 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-72068641-49f3-4905-84cd-3dd10efdb90f None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:37.736948 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-72068641-49f3-4905-84cd-3dd10efdb90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:37.787169 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:37.818601 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 457/903] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:37.818601 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72068641-49f3-4905-84cd-3dd10efdb90f None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:37.818867 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9222d-f747-4277-8a29-f97a6f13a722 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:37.824208 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:37.853429 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc3745-bc4c-4c41-9260-59a99f6a3458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:37.854101 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc3745-bc4c-4c41-9260-59a99f6a3458 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:37.854432 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc3745-bc4c-4c41-9260-59a99f6a3458 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:37.854704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc3745-bc4c-4c41-9260-59a99f6a3458 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:37.855440 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc3745-bc4c-4c41-9260-59a99f6a3458 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:37.855749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc3745-bc4c-4c41-9260-59a99f6a3458 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:37.857204 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc3745-bc4c-4c41-9260-59a99f6a3458 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:37.877351 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 447/904] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Sep 5 14:15:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:37.882912 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc3745-bc4c-4c41-9260-59a99f6a3458 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:37.942267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72068641-49f3-4905-84cd-3dd10efdb90f None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:37.985086 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6a33b-64c9-41ed-888d-3fb3aa767413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:37.985717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6a33b-64c9-41ed-888d-3fb3aa767413 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:37.986051 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6a33b-64c9-41ed-888d-3fb3aa767413 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:37.986333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6a33b-64c9-41ed-888d-3fb3aa767413 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:37.986947 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6a33b-64c9-41ed-888d-3fb3aa767413 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:37.988800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6a33b-64c9-41ed-888d-3fb3aa767413 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:38.001108 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 458/905] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 5 14:15:37 2022] GET /identity/v3/services => generated 1268 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:15:38.024172 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc3745-bc4c-4c41-9260-59a99f6a3458 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:38.064834 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b190fa0-c9b8-45c5-903c-1a14573cd7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:38.065398 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b190fa0-c9b8-45c5-903c-1a14573cd7b0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:38.065673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b190fa0-c9b8-45c5-903c-1a14573cd7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:38.065944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b190fa0-c9b8-45c5-903c-1a14573cd7b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:38.102419 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:38.102730 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6a33b-64c9-41ed-888d-3fb3aa767413 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:38.144651 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b190fa0-c9b8-45c5-903c-1a14573cd7b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:38.146145 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b190fa0-c9b8-45c5-903c-1a14573cd7b0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:38.156856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:38.222041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6a33b-64c9-41ed-888d-3fb3aa767413 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:38.261049 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42744a9-9689-483c-9fa9-4c51182fb3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:38.262455 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42744a9-9689-483c-9fa9-4c51182fb3da None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:38.263134 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42744a9-9689-483c-9fa9-4c51182fb3da None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:38.263819 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42744a9-9689-483c-9fa9-4c51182fb3da None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:38.265199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42744a9-9689-483c-9fa9-4c51182fb3da None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:38.266810 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42744a9-9689-483c-9fa9-4c51182fb3da None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:38.284849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 448/906] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:15:37 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 14:15:38.290837 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b190fa0-c9b8-45c5-903c-1a14573cd7b0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:38.349358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 459/907] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 5 14:15:38 2022] POST /identity/v3/services => generated 241 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:15:38.363370 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:38.369563 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87259eb2-c7f8-4f49-bf3c-e8a0d9122730 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:38.370105 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87259eb2-c7f8-4f49-bf3c-e8a0d9122730 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:38.370105 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87259eb2-c7f8-4f49-bf3c-e8a0d9122730 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:38.372369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 460/908] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:38.379085 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e372c-36a4-4cf4-ba22-0e0adf30e124 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:38.379646 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e372c-36a4-4cf4-ba22-0e0adf30e124 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:38.384035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e372c-36a4-4cf4-ba22-0e0adf30e124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:38.402557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-6c0e372c-36a4-4cf4-ba22-0e0adf30e124 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:38.403918 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6c0e372c-36a4-4cf4-ba22-0e0adf30e124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:38.422024 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b190fa0-c9b8-45c5-903c-1a14573cd7b0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:38.470381 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0043a-ba27-45c2-a3e8-d16f9b30ba3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:38.471507 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0043a-ba27-45c2-a3e8-d16f9b30ba3d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:38.471990 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0043a-ba27-45c2-a3e8-d16f9b30ba3d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:38.472484 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0043a-ba27-45c2-a3e8-d16f9b30ba3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:38.485428 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0043a-ba27-45c2-a3e8-d16f9b30ba3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:38.487317 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 461/909] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 14:15:38.487442 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0043a-ba27-45c2-a3e8-d16f9b30ba3d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:38.503455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-c9f0043a-ba27-45c2-a3e8-d16f9b30ba3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:38.503455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:38.503455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:38.503455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:38.503455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:38.503455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:38.503455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:38.503455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:38.503455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:38.503455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:38.503455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:38.503455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:38.503455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:38.503455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:38.503455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:38.503455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:38.504613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:38.504613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:38.504613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:38.504613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:38.504613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:38.504613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:38.504613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:38.504613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:38.504613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:38.504613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:38.504613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:38.504613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:38.504613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:38.504613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:38.504613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:38.504613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:38.504613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:38.505553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:38.505553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:38.505553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:38.507160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 449/910] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:38.512785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e372c-36a4-4cf4-ba22-0e0adf30e124 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:38.553595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:38.622660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e372c-36a4-4cf4-ba22-0e0adf30e124 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:38.659423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf5739-1998-45f8-a197-b838f63d4a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:38.660074 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf5739-1998-45f8-a197-b838f63d4a2d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:38.660349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf5739-1998-45f8-a197-b838f63d4a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:38.660635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf5739-1998-45f8-a197-b838f63d4a2d None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:38.661330 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf5739-1998-45f8-a197-b838f63d4a2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:38.661631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf5739-1998-45f8-a197-b838f63d4a2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:38.663053 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf5739-1998-45f8-a197-b838f63d4a2d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:38.675294 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 462/911] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:38.682181 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0043a-ba27-45c2-a3e8-d16f9b30ba3d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:38.790267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf5739-1998-45f8-a197-b838f63d4a2d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:38.790501 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0043a-ba27-45c2-a3e8-d16f9b30ba3d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:38.805649 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:38.839883 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62d42a-0f4c-42ed-8860-32d0478838c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:38.840724 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62d42a-0f4c-42ed-8860-32d0478838c0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:38.841700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62d42a-0f4c-42ed-8860-32d0478838c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:38.842144 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62d42a-0f4c-42ed-8860-32d0478838c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:38.851293 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62d42a-0f4c-42ed-8860-32d0478838c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:38.853689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62d42a-0f4c-42ed-8860-32d0478838c0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:38.871659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-2a62d42a-0f4c-42ed-8860-32d0478838c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:38.871659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:38.871659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:38.871659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:38.871659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:38.871659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:38.871659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:38.871659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:38.871659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:38.871659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:38.871659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:38.871659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:38.871659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:38.871659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:38.871659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:38.872811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:38.872811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:38.872811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:38.872811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:38.872811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:38.872811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:38.872811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:38.872811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:38.872811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:38.872811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:38.872811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:38.872811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:38.872811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:38.872811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:38.872811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:38.872811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:38.872811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:38.873780 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:38.873780 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:38.873780 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:38.873780 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:38.873780 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:38.873780 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:38.873780 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:38.873780 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:38.877132 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 450/912] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:38.878672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62d42a-0f4c-42ed-8860-32d0478838c0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:38.906343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:38.917896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf5739-1998-45f8-a197-b838f63d4a2d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:38.964066 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbed6bd-a3fe-48ad-851e-be283fb643f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:38.965068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbed6bd-a3fe-48ad-851e-be283fb643f2 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:38.965068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbed6bd-a3fe-48ad-851e-be283fb643f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:38.965470 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbed6bd-a3fe-48ad-851e-be283fb643f2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:38.966118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbed6bd-a3fe-48ad-851e-be283fb643f2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:38.967676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbed6bd-a3fe-48ad-851e-be283fb643f2 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:38.977137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-3bbed6bd-a3fe-48ad-851e-be283fb643f2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 14:15:38.977137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:38.977137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:15:38.977137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:15:38.977137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:15:38.977137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:15:38.977137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:15:38.977137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:38.977137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 14:15:38.977137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:38.977137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:38.977137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:38.977137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:38.977137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:38.977137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:38.977137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:38.977137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:38.978142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:38.978142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:38.978142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:38.978142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:38.978142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:38.978142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:38.978142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:15:38.978142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:15:38.978142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:15:38.978142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:15:38.978142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:38.978142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:38.978142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:38.978142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:38.978142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:38.978142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:38.978970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:38.978970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:38.978970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:38.978970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:38.978970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:38.978970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:38.978970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:38.978970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:38.978970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:38.978970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:38.978970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:15:38.978970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:38.978970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 14:15:38.978970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:38.983407 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 463/913] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 5 14:15:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:38.984646 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbed6bd-a3fe-48ad-851e-be283fb643f2 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:38.997709 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62d42a-0f4c-42ed-8860-32d0478838c0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:39.035003 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a4f6f-91ec-4e1d-9e63-c5d188d9cc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:39.035616 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a4f6f-91ec-4e1d-9e63-c5d188d9cc73 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:39.035872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a4f6f-91ec-4e1d-9e63-c5d188d9cc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:39.036141 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a4f6f-91ec-4e1d-9e63-c5d188d9cc73 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:39.036825 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a4f6f-91ec-4e1d-9e63-c5d188d9cc73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:39.037219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a4f6f-91ec-4e1d-9e63-c5d188d9cc73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:39.038644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a4f6f-91ec-4e1d-9e63-c5d188d9cc73 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:39.057678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 451/914] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:39.059033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a4f6f-91ec-4e1d-9e63-c5d188d9cc73 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:39.101378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:39.111624 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbed6bd-a3fe-48ad-851e-be283fb643f2 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:39.146261 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ec4ca-c340-4863-ad68-9e71fdda817c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:39.146866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ec4ca-c340-4863-ad68-9e71fdda817c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:39.147145 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ec4ca-c340-4863-ad68-9e71fdda817c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:39.147415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ec4ca-c340-4863-ad68-9e71fdda817c None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:39.148062 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ec4ca-c340-4863-ad68-9e71fdda817c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:39.148364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ec4ca-c340-4863-ad68-9e71fdda817c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:39.150470 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ec4ca-c340-4863-ad68-9e71fdda817c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:39.156779 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 464/915] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 5 14:15:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:39.166154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ec4ca-c340-4863-ad68-9e71fdda817c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:39.193389 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:39.196329 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a4f6f-91ec-4e1d-9e63-c5d188d9cc73 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:39.247700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df565cdc-0264-4d90-b732-dc095b5f05c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:39.248792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df565cdc-0264-4d90-b732-dc095b5f05c2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:39.249103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df565cdc-0264-4d90-b732-dc095b5f05c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:39.249385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df565cdc-0264-4d90-b732-dc095b5f05c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:39.250114 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df565cdc-0264-4d90-b732-dc095b5f05c2 None admin] RBAC: Adding query filter params (role.id=599c4ddaf84948b2822c11b41782ebe2, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=635e47d0a5a34fdfb5c8967a96a87828) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:39.250584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df565cdc-0264-4d90-b732-dc095b5f05c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:39.252280 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df565cdc-0264-4d90-b732-dc095b5f05c2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:39.265162 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 452/916] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:15:39 2022] GET /identity/v3/role_assignments?user.id=635e47d0a5a34fdfb5c8967a96a87828&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=599c4ddaf84948b2822c11b41782ebe2 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:39.292104 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ec4ca-c340-4863-ad68-9e71fdda817c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:39.331398 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a32ed2-4b7d-46b4-ad62-8b43ff0f4db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:39.332394 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a32ed2-4b7d-46b4-ad62-8b43ff0f4db1 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:39.332844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a32ed2-4b7d-46b4-ad62-8b43ff0f4db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:39.333313 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a32ed2-4b7d-46b4-ad62-8b43ff0f4db1 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:39.334254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a32ed2-4b7d-46b4-ad62-8b43ff0f4db1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:39.334737 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a32ed2-4b7d-46b4-ad62-8b43ff0f4db1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:39.336455 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a32ed2-4b7d-46b4-ad62-8b43ff0f4db1 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:39.347454 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 465/917] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Sep 5 14:15:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:39.349202 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df565cdc-0264-4d90-b732-dc095b5f05c2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:39.459208 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:39.466452 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df565cdc-0264-4d90-b732-dc095b5f05c2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:39.504410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce08f1f-bd79-4d48-a2dd-2f493fe07df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:39.505089 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce08f1f-bd79-4d48-a2dd-2f493fe07df4 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:39.505374 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce08f1f-bd79-4d48-a2dd-2f493fe07df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:39.505640 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce08f1f-bd79-4d48-a2dd-2f493fe07df4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:39.506361 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce08f1f-bd79-4d48-a2dd-2f493fe07df4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:39.507710 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce08f1f-bd79-4d48-a2dd-2f493fe07df4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:39.609202 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 453/918] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:15:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:15:40.014554 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf833f7-0991-498c-bba2-9136aa56cddf None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:40.015078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf833f7-0991-498c-bba2-9136aa56cddf None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:40.015078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf833f7-0991-498c-bba2-9136aa56cddf None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:40.016768 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 466/919] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:40.021992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d73c8-4899-42fd-ae5d-0d5cb84908af None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:40.022280 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d73c8-4899-42fd-ae5d-0d5cb84908af None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:40.022556 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d73c8-4899-42fd-ae5d-0d5cb84908af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:40.041370 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-0b6d73c8-4899-42fd-ae5d-0d5cb84908af None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:40.042544 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0b6d73c8-4899-42fd-ae5d-0d5cb84908af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:40.115656 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 454/920] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:40.333258 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404ac20-4d9f-48e2-9e60-c6e162b14891 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:40.333758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404ac20-4d9f-48e2-9e60-c6e162b14891 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:40.334179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404ac20-4d9f-48e2-9e60-c6e162b14891 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:40.335911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 467/921] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:40.342124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09b2dc-7d41-41fb-9a7a-358f544d872d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:40.342676 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09b2dc-7d41-41fb-9a7a-358f544d872d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:40.343177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09b2dc-7d41-41fb-9a7a-358f544d872d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:40.361857 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7a09b2dc-7d41-41fb-9a7a-358f544d872d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:40.363389 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7a09b2dc-7d41-41fb-9a7a-358f544d872d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:40.388630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404ac20-4d9f-48e2-9e60-c6e162b14891 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:40.441387 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 455/922] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:40.493456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:40.506168 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404ac20-4d9f-48e2-9e60-c6e162b14891 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:40.541656 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9b8b8-c550-4a45-b710-0d2d7d90e812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:40.542287 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9b8b8-c550-4a45-b710-0d2d7d90e812 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:40.542557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9b8b8-c550-4a45-b710-0d2d7d90e812 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:40.542827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9b8b8-c550-4a45-b710-0d2d7d90e812 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:40.543403 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9b8b8-c550-4a45-b710-0d2d7d90e812 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:40.544781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9b8b8-c550-4a45-b710-0d2d7d90e812 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:40.554173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-e3b9b8b8-c550-4a45-b710-0d2d7d90e812 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 14:15:40.554173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:40.554173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:15:40.554173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:15:40.554173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:15:40.554173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:15:40.554173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:15:40.554173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:40.554173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 14:15:40.554173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:40.554173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:40.554173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:40.554173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:40.554173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:40.554173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:40.554173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:40.555746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:40.555746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:40.555746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:40.555746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:40.555746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:40.555746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:40.555746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:40.555746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:15:40.555746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:15:40.555746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:15:40.555746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:15:40.555746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:40.555746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:40.555746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:40.555746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:40.555746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:40.555746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:40.557138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:40.557138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:40.557138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:40.557138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:40.557138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:40.557138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:40.557138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:40.557138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:40.557138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:40.557138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:40.557138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:15:40.557138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:40.557138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 14:15:40.557138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:40.557138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 468/923] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Sep 5 14:15:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:40.564997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09b2dc-7d41-41fb-9a7a-358f544d872d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:40.576528 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:40.676421 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09b2dc-7d41-41fb-9a7a-358f544d872d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:40.717306 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20124113-1291-4f57-99cc-996430c20ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:40.717919 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20124113-1291-4f57-99cc-996430c20ace None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:40.718249 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20124113-1291-4f57-99cc-996430c20ace None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:40.718528 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20124113-1291-4f57-99cc-996430c20ace None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:40.719159 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20124113-1291-4f57-99cc-996430c20ace None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:40.719508 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20124113-1291-4f57-99cc-996430c20ace None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:40.720885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20124113-1291-4f57-99cc-996430c20ace None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:40.726123 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 456/924] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 5 14:15:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:40.734367 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9b8b8-c550-4a45-b710-0d2d7d90e812 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:40.762537 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20124113-1291-4f57-99cc-996430c20ace None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:40.847855 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9b8b8-c550-4a45-b710-0d2d7d90e812 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:40.881461 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:40.885609 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc6bc1-9250-43f2-971c-a88185958441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:40.886503 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc6bc1-9250-43f2-971c-a88185958441 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:40.886982 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc6bc1-9250-43f2-971c-a88185958441 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:40.887510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc6bc1-9250-43f2-971c-a88185958441 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:40.888329 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc6bc1-9250-43f2-971c-a88185958441 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:40.888843 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc6bc1-9250-43f2-971c-a88185958441 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:40.890443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc6bc1-9250-43f2-971c-a88185958441 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:40.900372 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20124113-1291-4f57-99cc-996430c20ace None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:40.900631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 469/925] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 5 14:15:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:40.902252 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc6bc1-9250-43f2-971c-a88185958441 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:40.920372 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:40.950685 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7786a9-ee97-4e9e-9e8f-924c0ce9c69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:40.951871 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7786a9-ee97-4e9e-9e8f-924c0ce9c69a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:40.952156 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7786a9-ee97-4e9e-9e8f-924c0ce9c69a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:40.952429 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7786a9-ee97-4e9e-9e8f-924c0ce9c69a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:40.953018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7786a9-ee97-4e9e-9e8f-924c0ce9c69a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:40.954894 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7786a9-ee97-4e9e-9e8f-924c0ce9c69a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:40.967426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-ff7786a9-ee97-4e9e-9e8f-924c0ce9c69a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 14:15:40.967426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:40.967426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:15:40.967426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:15:40.967426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:15:40.967426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:15:40.967426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:15:40.967426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:40.967426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 14:15:40.967426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:40.967426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:40.967426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:40.967426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:40.967426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:40.967426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:40.967426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:40.967426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:40.968426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:40.968426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:40.968426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:40.968426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:40.968426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:40.968426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:40.968426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:15:40.968426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:15:40.968426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:15:40.968426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:15:40.968426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:40.968426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:40.968426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:40.968426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:40.968426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:40.968426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:40.969287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:40.969287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:40.969287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:40.969287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:40.969287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:40.969287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:40.969287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:40.969287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:40.969287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:40.969287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:40.969287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:15:40.969287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:40.969287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 14:15:40.969287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:40.969287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 457/926] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 5 14:15:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:40.976332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7786a9-ee97-4e9e-9e8f-924c0ce9c69a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:41.038106 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc6bc1-9250-43f2-971c-a88185958441 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:41.086853 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7786a9-ee97-4e9e-9e8f-924c0ce9c69a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:41.087392 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20793c-c286-455f-9deb-d69a99fc5242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:41.087819 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20793c-c286-455f-9deb-d69a99fc5242 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:41.088100 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20793c-c286-455f-9deb-d69a99fc5242 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:41.088372 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20793c-c286-455f-9deb-d69a99fc5242 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:41.089044 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c20793c-c286-455f-9deb-d69a99fc5242 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:41.091595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c20793c-c286-455f-9deb-d69a99fc5242 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:41.125043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57f443-1908-4c7d-ba11-adc6fb88d83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:41.125772 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57f443-1908-4c7d-ba11-adc6fb88d83b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:41.126112 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57f443-1908-4c7d-ba11-adc6fb88d83b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:41.126465 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57f443-1908-4c7d-ba11-adc6fb88d83b None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:41.127150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57f443-1908-4c7d-ba11-adc6fb88d83b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:41.127511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57f443-1908-4c7d-ba11-adc6fb88d83b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:41.128971 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57f443-1908-4c7d-ba11-adc6fb88d83b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:41.131147 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:41.135233 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 458/927] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 5 14:15:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:41.140578 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57f443-1908-4c7d-ba11-adc6fb88d83b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:41.213145 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 470/928] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:15:40 2022] POST /identity/v3/endpoints => generated 347 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:15:41.255929 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57f443-1908-4c7d-ba11-adc6fb88d83b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:41.300535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337794d-1cf9-4a92-8868-e8451cd78a1a None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:41.300822 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337794d-1cf9-4a92-8868-e8451cd78a1a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:41.301391 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337794d-1cf9-4a92-8868-e8451cd78a1a None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:41.302873 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 471/929] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:15:41.305699 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0236a29-0856-4d37-8d2a-b3d6bcff4aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:41.306529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0236a29-0856-4d37-8d2a-b3d6bcff4aaa None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:41.306935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0236a29-0856-4d37-8d2a-b3d6bcff4aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:41.307349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0236a29-0856-4d37-8d2a-b3d6bcff4aaa None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:41.308115 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0236a29-0856-4d37-8d2a-b3d6bcff4aaa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:41.308644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0236a29-0856-4d37-8d2a-b3d6bcff4aaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:41.310285 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0236a29-0856-4d37-8d2a-b3d6bcff4aaa None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:41.311191 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd8530-4b62-493e-869d-b9f2818ef8d6 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:41.311582 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd8530-4b62-493e-869d-b9f2818ef8d6 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:41.312039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd8530-4b62-493e-869d-b9f2818ef8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:41.317201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 459/930] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 5 14:15:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:41.324020 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0236a29-0856-4d37-8d2a-b3d6bcff4aaa None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:41.337830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-6bbd8530-4b62-493e-869d-b9f2818ef8d6 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:41.339999 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6bbd8530-4b62-493e-869d-b9f2818ef8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:41.392304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:41.422519 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:41.431452 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 472/931] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 14:15:41.439618 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0236a29-0856-4d37-8d2a-b3d6bcff4aaa None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:41.477684 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95251df5-9176-4dea-b555-97170eb1a853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:41.478217 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95251df5-9176-4dea-b555-97170eb1a853 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:41.478494 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95251df5-9176-4dea-b555-97170eb1a853 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:41.478766 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95251df5-9176-4dea-b555-97170eb1a853 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:41.479553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95251df5-9176-4dea-b555-97170eb1a853 None admin] RBAC: Adding query filter params (interface=public, service_id=bf8c32d3b2be4773834f478d4ffcb238, region_id=RegionOne) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:41.479858 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95251df5-9176-4dea-b555-97170eb1a853 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:41.481246 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95251df5-9176-4dea-b555-97170eb1a853 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:41.487696 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 460/932] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 5 14:15:41 2022] GET /identity/v3/endpoints?service_id=bf8c32d3b2be4773834f478d4ffcb238&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:41.493855 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd8530-4b62-493e-869d-b9f2818ef8d6 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:41.602873 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd8530-4b62-493e-869d-b9f2818ef8d6 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:41.639402 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85795a-306d-4553-9113-3c30cae58b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:41.640023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85795a-306d-4553-9113-3c30cae58b0d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:41.640299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85795a-306d-4553-9113-3c30cae58b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:41.640566 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85795a-306d-4553-9113-3c30cae58b0d None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:41.641254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85795a-306d-4553-9113-3c30cae58b0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:41.642639 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85795a-306d-4553-9113-3c30cae58b0d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:41.648136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2d33c-b216-48e4-9e52-b7b4c9e770f2 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:41.648422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2d33c-b216-48e4-9e52-b7b4c9e770f2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:41.648791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2d33c-b216-48e4-9e52-b7b4c9e770f2 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:41.649257 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 473/933] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 5 14:15:41 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:15:41.650413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 461/934] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:15:41.655986 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d7892-ae15-4038-b30f-86dcbfdef4b3 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:41.656298 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d7892-ae15-4038-b30f-86dcbfdef4b3 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:41.656540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d7892-ae15-4038-b30f-86dcbfdef4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:41.677657 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c30d7892-ae15-4038-b30f-86dcbfdef4b3 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:41.678896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c30d7892-ae15-4038-b30f-86dcbfdef4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:41.713936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2d33c-b216-48e4-9e52-b7b4c9e770f2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:41.751244 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:41.761728 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 474/935] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:41.840277 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2d33c-b216-48e4-9e52-b7b4c9e770f2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:41.875313 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:41.876669 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fc91b-5803-4d73-aec3-57506bf0ab30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:41.877335 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fc91b-5803-4d73-aec3-57506bf0ab30 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:41.877624 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fc91b-5803-4d73-aec3-57506bf0ab30 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:41.877905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fc91b-5803-4d73-aec3-57506bf0ab30 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:41.888505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fc91b-5803-4d73-aec3-57506bf0ab30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:15:41.893390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-730fc91b-5803-4d73-aec3-57506bf0ab30 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 14:15:41.893390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:41.893390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:41.893390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:41.893390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:41.893390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:41.893390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:41.893390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:41.893390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:41.893390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:41.893390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:41.893390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:41.893390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:15:41.893390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:15:41.893390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:15:41.893390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:15:41.894288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:15:41.894288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:15:41.894288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:15:41.894288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:15:41.894288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:41.894288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:41.894288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:41.894288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:41.894288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:41.894288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:41.894288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:41.894288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:41.894288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:41.894288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:41.894288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:41.894288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:41.895137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:41.895137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:41.895137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:41.895137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:41.895137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:15:41.895137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:15:41.895137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:15:41.895137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:15:41.895137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:15:41.895137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:15:41.895137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 14:15:41.895137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:41.895137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 462/936] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Sep 5 14:15:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:41.901470 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d7892-ae15-4038-b30f-86dcbfdef4b3 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:42.015898 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d7892-ae15-4038-b30f-86dcbfdef4b3 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:42.050304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fc91b-5803-4d73-aec3-57506bf0ab30 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:42.051304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75048d25-ac16-4bad-b6d1-543060fc543b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:42.051917 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75048d25-ac16-4bad-b6d1-543060fc543b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:42.052193 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75048d25-ac16-4bad-b6d1-543060fc543b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:42.052464 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75048d25-ac16-4bad-b6d1-543060fc543b None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:42.053214 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75048d25-ac16-4bad-b6d1-543060fc543b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:42.053520 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75048d25-ac16-4bad-b6d1-543060fc543b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:42.055663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75048d25-ac16-4bad-b6d1-543060fc543b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:42.064698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 475/937] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Sep 5 14:15:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:42.071469 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75048d25-ac16-4bad-b6d1-543060fc543b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:42.132904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:42.182137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75048d25-ac16-4bad-b6d1-543060fc543b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:42.186297 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fc91b-5803-4d73-aec3-57506bf0ab30 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:42.226118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b36063-6cd6-4665-b2ba-4e3b104e494e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:42.230586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c2577-9fca-41a4-9a4d-f545c4c92117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:42.230586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c2577-9fca-41a4-9a4d-f545c4c92117 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:42.230586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c2577-9fca-41a4-9a4d-f545c4c92117 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:42.230586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c2577-9fca-41a4-9a4d-f545c4c92117 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:42.230928 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c2577-9fca-41a4-9a4d-f545c4c92117 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:42.231481 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c2577-9fca-41a4-9a4d-f545c4c92117 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:42.233619 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b36063-6cd6-4665-b2ba-4e3b104e494e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:42.234100 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b36063-6cd6-4665-b2ba-4e3b104e494e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:42.234390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: WARNING keystone.server.flask.common [None req-259c2577-9fca-41a4-9a4d-f545c4c92117 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 05 14:15:42.234781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b36063-6cd6-4665-b2ba-4e3b104e494e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:42.247799 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b36063-6cd6-4665-b2ba-4e3b104e494e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:42.249750 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b36063-6cd6-4665-b2ba-4e3b104e494e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:42.277488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-30b36063-6cd6-4665-b2ba-4e3b104e494e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:42.277488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:42.277488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:42.277488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:42.277488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:42.277488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:42.277488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:42.277488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:42.277488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:42.277488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:42.277488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:42.277488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:42.277488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:42.277488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:42.277488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:42.277488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:42.278602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:42.278602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:42.278602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:42.278602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:42.278602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:42.278602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:42.278602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:42.278602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:42.278602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:42.278602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:42.278602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:42.278602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:42.278602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:42.278602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:42.278602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:42.278602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:42.278602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:42.279564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:42.279564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:42.279564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:42.279564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 476/938] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:42.279564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b36063-6cd6-4665-b2ba-4e3b104e494e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:42.302905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.sql.core [None req-259c2577-9fca-41a4-9a4d-f545c4c92117 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 05 14:15:42.302905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 05 14:15:42.302905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [parameters: {'id': 'be9f7417b4d14d6a80c14959edc0a249', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 05 14:15:42.302905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81623) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 05 14:15:42.320074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-259c2577-9fca-41a4-9a4d-f545c4c92117 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id be9f7417b4d14d6a80c14959edc0a249.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id be9f7417b4d14d6a80c14959edc0a249. Sep 05 14:15:42.320074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:42.320074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 14:15:42.320074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 14:15:42.320074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 14:15:42.320074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 14:15:42.320074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 14:15:42.320074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 14:15:42.320074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 14:15:42.320074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application conn.query(q) Sep 05 14:15:42.320074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 14:15:42.320074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 14:15:42.320074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 14:15:42.324197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result.read() Sep 05 14:15:42.324197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 14:15:42.324197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 14:15:42.324197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 14:15:42.324197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 14:15:42.324197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 14:15:42.324197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 14:15:42.324197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 14:15:42.324197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 14:15:42.324197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 05 14:15:42.324197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:42.324197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 05 14:15:42.324197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:42.324197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:42.324197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 05 14:15:42.324197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 05 14:15:42.324197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 05 14:15:42.324197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 05 14:15:42.325305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 14:15:42.325305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application next(self.gen) Sep 05 14:15:42.325305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 05 14:15:42.325305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application yield resource Sep 05 14:15:42.325305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 14:15:42.325305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application next(self.gen) Sep 05 14:15:42.325305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 05 14:15:42.325305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.session.rollback() Sep 05 14:15:42.325305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 05 14:15:42.325305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.force_reraise() Sep 05 14:15:42.325305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 05 14:15:42.325305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise self.value Sep 05 14:15:42.325305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 05 14:15:42.325305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 05 14:15:42.325305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 05 14:15:42.325305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application session.commit() Sep 05 14:15:42.325305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 05 14:15:42.326232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 05 14:15:42.326232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 05 14:15:42.326232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._prepare_impl() Sep 05 14:15:42.326232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 05 14:15:42.326232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.session.flush() Sep 05 14:15:42.326232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 05 14:15:42.326232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._flush(objects) Sep 05 14:15:42.326232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 05 14:15:42.326232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 05 14:15:42.326232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 05 14:15:42.326232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application compat.raise_( Sep 05 14:15:42.326232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 14:15:42.326232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception Sep 05 14:15:42.326232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 05 14:15:42.326232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application flush_context.execute() Sep 05 14:15:42.326232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 05 14:15:42.326232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rec.execute(self) Sep 05 14:15:42.328004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 05 14:15:42.328004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 05 14:15:42.328004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 05 14:15:42.328004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 05 14:15:42.328004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 05 14:15:42.328004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 05 14:15:42.328004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 05 14:15:42.328004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 05 14:15:42.328004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 05 14:15:42.328004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 05 14:15:42.328004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 05 14:15:42.328004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 05 14:15:42.328004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 05 14:15:42.328004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 05 14:15:42.328004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 05 14:15:42.329759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 05 14:15:42.329759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 14:15:42.329759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception Sep 05 14:15:42.329759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 14:15:42.329759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 14:15:42.329759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 14:15:42.329759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 14:15:42.329759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 14:15:42.329759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 14:15:42.329759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 14:15:42.329759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application conn.query(q) Sep 05 14:15:42.329759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 14:15:42.329759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 14:15:42.329759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 14:15:42.329759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result.read() Sep 05 14:15:42.329759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 14:15:42.329759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 14:15:42.333274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 14:15:42.333274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 14:15:42.333274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 14:15:42.333274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 14:15:42.333274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 14:15:42.333274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 14:15:42.333274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 05 14:15:42.333274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 05 14:15:42.333274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [parameters: {'id': 'be9f7417b4d14d6a80c14959edc0a249', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 05 14:15:42.333274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 05 14:15:42.333274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:42.333274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:42.333274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:42.333274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:42.333274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 05 14:15:42.335371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 05 14:15:42.335371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 05 14:15:42.335371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 05 14:15:42.335371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 05 14:15:42.335371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:42.335371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:42.335371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:42.335371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:42.335371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:42.335371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:42.335371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:42.335371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:42.335371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:42.335371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:42.335371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:42.335371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:42.335371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:42.338909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:42.338909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 05 14:15:42.338909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 05 14:15:42.338909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:42.338909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:42.338909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 05 14:15:42.338909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 05 14:15:42.338909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id be9f7417b4d14d6a80c14959edc0a249. Sep 05 14:15:42.338909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:42.338909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 463/939] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Sep 5 14:15:42 2022] POST /identity/v3/projects => generated 262 bytes in 272 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:42.338909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c2577-9fca-41a4-9a4d-f545c4c92117 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:42.380194 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:42.438560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b36063-6cd6-4665-b2ba-4e3b104e494e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:42.448476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c2577-9fca-41a4-9a4d-f545c4c92117 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:42.451491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:42.484889 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ddb90-b26f-4fb3-b061-dcf65799cf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:42.485517 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb81d8-e94f-4221-b641-a2923ff961c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:42.485653 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ddb90-b26f-4fb3-b061-dcf65799cf9b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:42.485860 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ddb90-b26f-4fb3-b061-dcf65799cf9b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:42.486098 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ddb90-b26f-4fb3-b061-dcf65799cf9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:42.487043 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb81d8-e94f-4221-b641-a2923ff961c2 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:42.487539 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb81d8-e94f-4221-b641-a2923ff961c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:42.488022 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb81d8-e94f-4221-b641-a2923ff961c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:42.489036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb81d8-e94f-4221-b641-a2923ff961c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:42.489846 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb81d8-e94f-4221-b641-a2923ff961c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:42.491444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb81d8-e94f-4221-b641-a2923ff961c2 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:42.494120 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ddb90-b26f-4fb3-b061-dcf65799cf9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:42.495900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ddb90-b26f-4fb3-b061-dcf65799cf9b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:42.511127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-312ddb90-b26f-4fb3-b061-dcf65799cf9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:42.511127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:42.511127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:42.511127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:42.511127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:42.511127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:42.511127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:42.511127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:42.511127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:42.511127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:42.511127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:42.511127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:42.511127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:42.511127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:42.511127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:42.512067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:42.512067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:42.512067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:42.512067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:42.512067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:42.512067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:42.512067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:42.512067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:42.512067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:42.512067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:42.512067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:42.512067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:42.512067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:42.512067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:42.512067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:42.512067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:42.512067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:42.513422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:42.513422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:42.513422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:42.513422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:42.513422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:42.513422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:42.513422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:42.513422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:42.513422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 464/940] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:42.514295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ddb90-b26f-4fb3-b061-dcf65799cf9b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:42.514739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 477/941] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:42.515846 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb81d8-e94f-4221-b641-a2923ff961c2 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:42.627027 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:42.630567 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ddb90-b26f-4fb3-b061-dcf65799cf9b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:42.636417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb81d8-e94f-4221-b641-a2923ff961c2 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:42.667061 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6ceed-d72f-46f5-b1da-1f16f851870c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:42.668004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6ceed-d72f-46f5-b1da-1f16f851870c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:42.668133 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6ceed-d72f-46f5-b1da-1f16f851870c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:42.668319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6ceed-d72f-46f5-b1da-1f16f851870c None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:42.668961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6ceed-d72f-46f5-b1da-1f16f851870c None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:42.669409 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6ceed-d72f-46f5-b1da-1f16f851870c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:42.671046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6ceed-d72f-46f5-b1da-1f16f851870c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:42.677707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccfab0-2d12-4001-91fd-25f3a77406a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:42.678555 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccfab0-2d12-4001-91fd-25f3a77406a0 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:42.678994 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccfab0-2d12-4001-91fd-25f3a77406a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:42.679413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccfab0-2d12-4001-91fd-25f3a77406a0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:42.688102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccfab0-2d12-4001-91fd-25f3a77406a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:42.689771 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccfab0-2d12-4001-91fd-25f3a77406a0 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:42.700929 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 465/942] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 5 14:15:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:42.703267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-4bccfab0-2d12-4001-91fd-25f3a77406a0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 14:15:42.703267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:42.703267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:42.703267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:42.703267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:42.703267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:42.703267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:42.703267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:42.703267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:42.703267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:42.703267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:42.703267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:42.703267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:42.703267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:42.703267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:42.703267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:42.704380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:42.704380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:42.704380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:42.704380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:42.704380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:42.704380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:42.704380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:42.704380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:42.704380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:42.704380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:42.704380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:42.704380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:42.704380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:42.704380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:42.704380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:42.704380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:42.704380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:42.704380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:42.705364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:42.705364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:42.705364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:42.705364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:42.705364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:42.705364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:42.705364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:42.705364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:42.705364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 14:15:42.705364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:42.707923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 478/943] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 5 14:15:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:42.714499 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6ceed-d72f-46f5-b1da-1f16f851870c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:42.839574 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6ceed-d72f-46f5-b1da-1f16f851870c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:42.878203 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffb72b-a692-42a4-9a49-4b5342a72821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:42.878740 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffb72b-a692-42a4-9a49-4b5342a72821 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:42.879069 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffb72b-a692-42a4-9a49-4b5342a72821 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:42.879345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffb72b-a692-42a4-9a49-4b5342a72821 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:42.880079 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffb72b-a692-42a4-9a49-4b5342a72821 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:42.880382 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffb72b-a692-42a4-9a49-4b5342a72821 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:42.881911 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffb72b-a692-42a4-9a49-4b5342a72821 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:42.902040 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 466/944] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Sep 5 14:15:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:42.907670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccfab0-2d12-4001-91fd-25f3a77406a0 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:42.940528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:43.018882 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccfab0-2d12-4001-91fd-25f3a77406a0 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:43.054579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6861518-2a29-401b-b71b-82f3d035a83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:43.055822 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6861518-2a29-401b-b71b-82f3d035a83d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:43.056103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6861518-2a29-401b-b71b-82f3d035a83d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:43.056376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6861518-2a29-401b-b71b-82f3d035a83d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:43.067348 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6861518-2a29-401b-b71b-82f3d035a83d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:43.068787 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6861518-2a29-401b-b71b-82f3d035a83d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:43.083290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-d6861518-2a29-401b-b71b-82f3d035a83d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:43.083290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:43.083290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:43.083290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:43.083290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:43.083290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:43.083290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:43.083290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:43.083290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:43.083290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:43.083290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:43.083290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:43.083290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:43.083290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:43.083290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:43.083290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:43.084268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:43.084268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:43.084268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:43.084268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:43.084268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:43.084268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:43.084268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:43.084268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:43.084268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:43.084268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:43.084268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:43.084268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:43.084268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:43.084268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:43.084268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:43.084268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:43.084268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:43.085181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:43.085181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:43.085181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:43.085181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 479/945] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:43.091718 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffb72b-a692-42a4-9a49-4b5342a72821 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:43.113048 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:43.209983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffb72b-a692-42a4-9a49-4b5342a72821 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:43.252822 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f861ace-3b34-4fb1-ad4b-3de1142d137e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:43.253508 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f861ace-3b34-4fb1-ad4b-3de1142d137e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:43.253885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f861ace-3b34-4fb1-ad4b-3de1142d137e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:43.254159 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f861ace-3b34-4fb1-ad4b-3de1142d137e None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:43.254845 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f861ace-3b34-4fb1-ad4b-3de1142d137e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:43.255149 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f861ace-3b34-4fb1-ad4b-3de1142d137e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:43.256506 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f861ace-3b34-4fb1-ad4b-3de1142d137e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:43.269445 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 467/946] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:43.277511 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6861518-2a29-401b-b71b-82f3d035a83d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:43.287226 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876f40c-1e6d-482c-8257-775d136f67fa None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:43.287801 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876f40c-1e6d-482c-8257-775d136f67fa None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:43.288283 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876f40c-1e6d-482c-8257-775d136f67fa None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:43.290961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 468/947] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:15:43.298065 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df154d96-9f38-44c3-8ed1-51a12edbd3d1 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:43.299941 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df154d96-9f38-44c3-8ed1-51a12edbd3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:43.299941 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df154d96-9f38-44c3-8ed1-51a12edbd3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:43.322821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-df154d96-9f38-44c3-8ed1-51a12edbd3d1 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:43.324354 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-df154d96-9f38-44c3-8ed1-51a12edbd3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:43.380288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:43.407464 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6861518-2a29-401b-b71b-82f3d035a83d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:43.408090 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 469/948] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:43.442222 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa62d9-1ed5-4256-9bbd-40223d39b75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:43.442843 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa62d9-1ed5-4256-9bbd-40223d39b75a None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:43.443113 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa62d9-1ed5-4256-9bbd-40223d39b75a None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:43.443377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa62d9-1ed5-4256-9bbd-40223d39b75a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:43.450375 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa62d9-1ed5-4256-9bbd-40223d39b75a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:43.451881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa62d9-1ed5-4256-9bbd-40223d39b75a None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:43.464241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-b6fa62d9-1ed5-4256-9bbd-40223d39b75a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:43.464241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:43.464241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:43.464241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:43.464241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:43.464241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:43.464241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:43.464241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:43.464241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:43.464241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:43.464241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:43.464241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:43.464241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:43.464241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:43.464241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:43.465197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:43.465197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:43.465197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:43.465197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:43.465197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:43.465197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:43.465197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:43.465197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:43.465197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:43.465197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:43.465197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:43.465197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:43.465197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:43.465197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:43.465197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:43.465197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:43.465197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:43.466112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:43.466112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:43.466112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:43.466112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:43.466112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:43.466112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:43.466112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:43.466112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:43.466112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 480/949] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:43.471224 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df154d96-9f38-44c3-8ed1-51a12edbd3d1 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:43.501459 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:43.576041 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df154d96-9f38-44c3-8ed1-51a12edbd3d1 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:43.611655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31fc5a-8b44-49ba-be20-05da6366d2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:43.612422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31fc5a-8b44-49ba-be20-05da6366d2c1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:43.612607 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31fc5a-8b44-49ba-be20-05da6366d2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:43.612875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31fc5a-8b44-49ba-be20-05da6366d2c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:43.613595 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31fc5a-8b44-49ba-be20-05da6366d2c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:43.613896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fd196-f11c-4062-8497-c1339593d71d None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:43.614019 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31fc5a-8b44-49ba-be20-05da6366d2c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:43.614175 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fd196-f11c-4062-8497-c1339593d71d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:43.614443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fd196-f11c-4062-8497-c1339593d71d None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:43.615318 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31fc5a-8b44-49ba-be20-05da6366d2c1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:43.616026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 481/950] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:15:43.620863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905af2f-019d-4213-b568-8fab013f9279 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:43.621185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905af2f-019d-4213-b568-8fab013f9279 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:43.621461 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905af2f-019d-4213-b568-8fab013f9279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:43.627866 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 470/951] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:43.633230 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31fc5a-8b44-49ba-be20-05da6366d2c1 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:43.640039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-e905af2f-019d-4213-b568-8fab013f9279 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:43.641311 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e905af2f-019d-4213-b568-8fab013f9279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:43.716281 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:43.722394 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 482/952] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 14:15:43.727214 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905af2f-019d-4213-b568-8fab013f9279 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:43.752956 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31fc5a-8b44-49ba-be20-05da6366d2c1 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:43.792164 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a1e4c-193f-4963-8168-d415a3922eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:43.792906 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a1e4c-193f-4963-8168-d415a3922eff None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:43.793323 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a1e4c-193f-4963-8168-d415a3922eff None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:43.793749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a1e4c-193f-4963-8168-d415a3922eff None admin] PATH_INFO: `/v3/projects/975f49bcc95643fe876cc03d0d731423/users/635e47d0a5a34fdfb5c8967a96a87828/roles/599c4ddaf84948b2822c11b41782ebe2` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:43.796108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a1e4c-193f-4963-8168-d415a3922eff None admin] RBAC: Authorizing `identity:create_grant(project_id=975f49bcc95643fe876cc03d0d731423, user_id=635e47d0a5a34fdfb5c8967a96a87828, role_id=599c4ddaf84948b2822c11b41782ebe2)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:43.797784 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a1e4c-193f-4963-8168-d415a3922eff None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:43.817259 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:43.848775 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905af2f-019d-4213-b568-8fab013f9279 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:43.866003 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 471/953] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:15:43 2022] PUT /identity/v3/projects/975f49bcc95643fe876cc03d0d731423/users/635e47d0a5a34fdfb5c8967a96a87828/roles/599c4ddaf84948b2822c11b41782ebe2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:15:43.895593 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd34f7-a605-4cf3-a6a7-08c5738a1d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:43.896726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd34f7-a605-4cf3-a6a7-08c5738a1d82 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:43.897238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd34f7-a605-4cf3-a6a7-08c5738a1d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:43.897744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd34f7-a605-4cf3-a6a7-08c5738a1d82 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:43.898657 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd34f7-a605-4cf3-a6a7-08c5738a1d82 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:43.900358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd34f7-a605-4cf3-a6a7-08c5738a1d82 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:43.911032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-b3fd34f7-a605-4cf3-a6a7-08c5738a1d82 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 14:15:43.911032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:43.911032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:15:43.911032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:15:43.911032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:15:43.911032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:15:43.911032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:15:43.911032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:43.911032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 14:15:43.911032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:43.911032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:43.911032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:43.911032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:43.911032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:43.911032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:43.911032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:43.911032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:43.912299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:43.912299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:43.912299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:43.912299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:43.912299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:43.912299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:43.912299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:15:43.912299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:15:43.912299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:15:43.912299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:15:43.912299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:43.912299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:43.912299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:43.912299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:43.912299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:43.912299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:43.913212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:43.913212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:43.913212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:43.913212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:43.913212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:43.913212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:43.913212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:43.913212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:43.913212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:43.913212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:43.913212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:15:43.913212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:43.913212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 14:15:43.913212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:43.917039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 483/954] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:43.925316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a1e4c-193f-4963-8168-d415a3922eff None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:43.991591 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd34f7-a605-4cf3-a6a7-08c5738a1d82 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:44.065467 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a1e4c-193f-4963-8168-d415a3922eff None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:44.096226 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:44.106802 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be172f6-76c4-4de7-8741-dacfc205d0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:44.109006 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be172f6-76c4-4de7-8741-dacfc205d0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:44.109006 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be172f6-76c4-4de7-8741-dacfc205d0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:44.109006 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be172f6-76c4-4de7-8741-dacfc205d0c9 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:44.109006 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be172f6-76c4-4de7-8741-dacfc205d0c9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:44.109376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be172f6-76c4-4de7-8741-dacfc205d0c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:44.110577 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be172f6-76c4-4de7-8741-dacfc205d0c9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:44.115999 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 472/955] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 5 14:15:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:44.122783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be172f6-76c4-4de7-8741-dacfc205d0c9 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:44.124450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd34f7-a605-4cf3-a6a7-08c5738a1d82 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:44.162104 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf60531-379c-420c-9a70-56582cb004c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:44.163056 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf60531-379c-420c-9a70-56582cb004c5 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:44.163507 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf60531-379c-420c-9a70-56582cb004c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:44.163945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf60531-379c-420c-9a70-56582cb004c5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:44.165291 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf60531-379c-420c-9a70-56582cb004c5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:44.166841 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf60531-379c-420c-9a70-56582cb004c5 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:44.169026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:44.177041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-6bf60531-379c-420c-9a70-56582cb004c5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 14:15:44.177041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:44.177041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:15:44.177041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:15:44.177041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:15:44.177041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:15:44.177041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:15:44.177041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:44.177041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 14:15:44.177041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:44.177041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:44.177041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:44.177041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:44.177041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:44.177041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:44.177041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:44.177041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:44.183679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:44.183679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:44.183679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:44.183679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:44.183679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:44.183679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:44.183679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:15:44.183679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:15:44.183679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:15:44.183679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:15:44.183679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:44.183679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:44.183679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:44.183679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:44.183679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:44.183679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:44.184649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:44.184649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:44.184649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:44.184649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:44.184649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:44.184649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:44.184649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:44.184649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:44.184649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:44.184649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:44.184649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:15:44.184649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:44.184649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 14:15:44.184649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:44.184649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 484/956] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 5 14:15:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:44.185499 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf60531-379c-420c-9a70-56582cb004c5 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:44.263481 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be172f6-76c4-4de7-8741-dacfc205d0c9 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:44.291497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf60531-379c-420c-9a70-56582cb004c5 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:44.312842 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead216e6-eade-4726-bcc9-d7c0c75586ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:44.313472 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead216e6-eade-4726-bcc9-d7c0c75586ab None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:44.313750 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead216e6-eade-4726-bcc9-d7c0c75586ab None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:44.314024 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead216e6-eade-4726-bcc9-d7c0c75586ab None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:44.314650 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead216e6-eade-4726-bcc9-d7c0c75586ab None admin] RBAC: Adding query filter params (type=compute) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:44.314952 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead216e6-eade-4726-bcc9-d7c0c75586ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:44.316317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead216e6-eade-4726-bcc9-d7c0c75586ab None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:44.325124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 473/957] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 5 14:15:44 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:44.340156 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874d27a-644f-4984-b44f-84168608cf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:44.340782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874d27a-644f-4984-b44f-84168608cf71 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:44.341081 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874d27a-644f-4984-b44f-84168608cf71 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:44.341367 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874d27a-644f-4984-b44f-84168608cf71 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:44.342071 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874d27a-644f-4984-b44f-84168608cf71 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:44.342383 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874d27a-644f-4984-b44f-84168608cf71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:44.343806 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874d27a-644f-4984-b44f-84168608cf71 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:44.349885 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 485/958] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 5 14:15:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:44.358273 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead216e6-eade-4726-bcc9-d7c0c75586ab None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:44.439634 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:44.480588 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead216e6-eade-4726-bcc9-d7c0c75586ab None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:44.518689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e59d0-57cc-48c1-be64-b60b97f38cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:44.519314 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e59d0-57cc-48c1-be64-b60b97f38cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:44.519684 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e59d0-57cc-48c1-be64-b60b97f38cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:44.520020 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e59d0-57cc-48c1-be64-b60b97f38cf1 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:44.520715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e59d0-57cc-48c1-be64-b60b97f38cf1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:44.521105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e59d0-57cc-48c1-be64-b60b97f38cf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:44.522608 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e59d0-57cc-48c1-be64-b60b97f38cf1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:44.528406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 474/959] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 5 14:15:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:44.534052 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874d27a-644f-4984-b44f-84168608cf71 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:44.603880 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:44.644165 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874d27a-644f-4984-b44f-84168608cf71 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:44.681171 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3498b5-977c-4783-b83b-4a71758c730c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:44.681872 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3498b5-977c-4783-b83b-4a71758c730c None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:44.682226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3498b5-977c-4783-b83b-4a71758c730c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:44.682559 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3498b5-977c-4783-b83b-4a71758c730c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:44.683293 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3498b5-977c-4783-b83b-4a71758c730c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:44.684798 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3498b5-977c-4783-b83b-4a71758c730c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:44.766813 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 486/960] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:15:44 2022] POST /identity/v3/endpoints => generated 349 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:15:44.886166 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cc97e-93d6-4a8a-901c-8e168380b090 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:44.886346 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cc97e-93d6-4a8a-901c-8e168380b090 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:44.886654 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cc97e-93d6-4a8a-901c-8e168380b090 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:44.888306 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 475/961] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:44.894066 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fb59d-f738-4938-a6b0-e33745d8b8df None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:44.894350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fb59d-f738-4938-a6b0-e33745d8b8df None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:44.894623 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fb59d-f738-4938-a6b0-e33745d8b8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:44.914732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c34fb59d-f738-4938-a6b0-e33745d8b8df None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:44.916154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c34fb59d-f738-4938-a6b0-e33745d8b8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:44.996130 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 487/962] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:45.271492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988cc97e-93d6-4a8a-901c-8e168380b090 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:45.382443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988cc97e-93d6-4a8a-901c-8e168380b090 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:45.403818 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:45.419053 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae219e-b892-44f5-91b7-1ed5fd267f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:45.419925 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae219e-b892-44f5-91b7-1ed5fd267f09 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:45.420363 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae219e-b892-44f5-91b7-1ed5fd267f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:45.420784 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae219e-b892-44f5-91b7-1ed5fd267f09 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:45.421604 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae219e-b892-44f5-91b7-1ed5fd267f09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:45.423164 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae219e-b892-44f5-91b7-1ed5fd267f09 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:45.474342 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.sql.core [None req-d9ae219e-b892-44f5-91b7-1ed5fd267f09 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 05 14:15:45.474342 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 05 14:15:45.474342 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [parameters: {'user_id': '159cf9c863534dea84b7c1079fe6afc5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 05 14:15:45.474342 dv-cinder-842905-3-smb devstack@keystone.service[81623]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81623) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 05 14:15:45.482186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-d9ae219e-b892-44f5-91b7-1ed5fd267f09 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 05 14:15:45.482186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:45.482186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 14:15:45.482186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 14:15:45.482186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 14:15:45.482186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 14:15:45.482186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 14:15:45.482186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 14:15:45.482186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 14:15:45.482186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application conn.query(q) Sep 05 14:15:45.482186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 14:15:45.482186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 14:15:45.482186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 14:15:45.482186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result.read() Sep 05 14:15:45.482186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 14:15:45.483448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 14:15:45.483448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 14:15:45.483448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 14:15:45.483448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 14:15:45.483448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 14:15:45.483448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 14:15:45.483448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 14:15:45.483448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 05 14:15:45.483448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:45.483448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 05 14:15:45.483448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:45.483448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:45.483448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 05 14:15:45.483448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 05 14:15:45.483448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 05 14:15:45.483448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 05 14:15:45.483448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 14:15:45.483448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application next(self.gen) Sep 05 14:15:45.484631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 05 14:15:45.484631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application yield resource Sep 05 14:15:45.484631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 14:15:45.484631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application next(self.gen) Sep 05 14:15:45.484631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 05 14:15:45.484631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.session.rollback() Sep 05 14:15:45.484631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 05 14:15:45.484631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.force_reraise() Sep 05 14:15:45.484631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 05 14:15:45.484631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise self.value Sep 05 14:15:45.484631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 05 14:15:45.484631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 05 14:15:45.484631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 05 14:15:45.484631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application session.commit() Sep 05 14:15:45.484631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 05 14:15:45.484631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 05 14:15:45.484631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 05 14:15:45.485760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._prepare_impl() Sep 05 14:15:45.485760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 05 14:15:45.485760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.session.flush() Sep 05 14:15:45.485760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 05 14:15:45.485760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._flush(objects) Sep 05 14:15:45.485760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 05 14:15:45.485760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 05 14:15:45.485760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 05 14:15:45.485760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application compat.raise_( Sep 05 14:15:45.485760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 14:15:45.485760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception Sep 05 14:15:45.485760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 05 14:15:45.485760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application flush_context.execute() Sep 05 14:15:45.485760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 05 14:15:45.485760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rec.execute(self) Sep 05 14:15:45.485760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 05 14:15:45.485760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 05 14:15:45.486859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 05 14:15:45.486859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 05 14:15:45.486859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 05 14:15:45.486859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 05 14:15:45.486859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 05 14:15:45.486859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 05 14:15:45.486859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 05 14:15:45.486859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 05 14:15:45.486859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 05 14:15:45.486859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 05 14:15:45.486859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 05 14:15:45.486859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 05 14:15:45.486859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 05 14:15:45.486859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 05 14:15:45.486859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 14:15:45.486859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception Sep 05 14:15:45.487963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 14:15:45.487963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 14:15:45.487963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 14:15:45.487963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 14:15:45.487963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 14:15:45.487963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 14:15:45.487963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 14:15:45.487963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application conn.query(q) Sep 05 14:15:45.487963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 14:15:45.487963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 14:15:45.487963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 14:15:45.487963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result.read() Sep 05 14:15:45.487963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 14:15:45.487963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 14:15:45.487963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 14:15:45.487963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 14:15:45.488897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 14:15:45.488897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 14:15:45.488897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 14:15:45.488897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 14:15:45.488897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 05 14:15:45.488897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 05 14:15:45.488897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [parameters: {'user_id': '159cf9c863534dea84b7c1079fe6afc5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 05 14:15:45.488897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 05 14:15:45.488897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:45.488897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:45.488897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:45.488897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:45.488897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:45.488897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:45.488897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:45.489791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:45.489791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:45.489791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:45.489791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:45.489791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:45.489791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:45.489791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:45.489791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 05 14:15:45.489791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 05 14:15:45.489791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:45.489791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:45.489791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:45.489791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:45.489791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:45.489791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:45.489791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 05 14:15:45.489791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 05 14:15:45.490684 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 05 14:15:45.490684 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 05 14:15:45.490684 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 05 14:15:45.490684 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 05 14:15:45.490684 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 05 14:15:45.490684 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:45.493509 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 476/963] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Sep 5 14:15:45 2022] POST /identity/v3/users => generated 160 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:45.503555 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fb59d-f738-4938-a6b0-e33745d8b8df None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:45.555087 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:45.613291 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fb59d-f738-4938-a6b0-e33745d8b8df None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:45.650947 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075eece6-4c66-4eb0-9f58-cfbce8a782ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:45.651580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075eece6-4c66-4eb0-9f58-cfbce8a782ff None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:45.651856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075eece6-4c66-4eb0-9f58-cfbce8a782ff None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:45.652127 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075eece6-4c66-4eb0-9f58-cfbce8a782ff None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:45.661266 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075eece6-4c66-4eb0-9f58-cfbce8a782ff None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:45.662718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075eece6-4c66-4eb0-9f58-cfbce8a782ff None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:45.675414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-075eece6-4c66-4eb0-9f58-cfbce8a782ff None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 14:15:45.675414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:45.675414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:45.675414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:45.675414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:45.675414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:45.675414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:45.675414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:45.675414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:45.675414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:45.675414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:45.675414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:45.675414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:45.675414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:45.675414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:45.675414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:45.676620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:45.676620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:45.676620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:45.676620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:45.676620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:45.676620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:45.676620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:45.676620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:45.676620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:45.676620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:45.676620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:45.676620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:45.676620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:45.676620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:45.676620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:45.676620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:45.676620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:45.676620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:45.677648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:45.677648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:45.677648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:45.677648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:45.677648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:45.677648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:45.677648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:45.677648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:45.677648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 14:15:45.677648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:45.681205 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 488/964] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:15:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:45.686131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae219e-b892-44f5-91b7-1ed5fd267f09 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:45.792551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae219e-b892-44f5-91b7-1ed5fd267f09 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:45.829022 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60704c-ad70-48b5-9343-2e0b0f4e44de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:45.829971 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60704c-ad70-48b5-9343-2e0b0f4e44de None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:45.830404 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60704c-ad70-48b5-9343-2e0b0f4e44de None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:45.830896 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60704c-ad70-48b5-9343-2e0b0f4e44de None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:45.831800 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60704c-ad70-48b5-9343-2e0b0f4e44de None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:45.832242 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60704c-ad70-48b5-9343-2e0b0f4e44de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:45.834088 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60704c-ad70-48b5-9343-2e0b0f4e44de None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:45.881222 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 477/965] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Sep 5 14:15:45 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:45.890285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b84e1-9bcc-440e-9966-3cbd72a09fe2 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:45.890571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b84e1-9bcc-440e-9966-3cbd72a09fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:45.890850 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b84e1-9bcc-440e-9966-3cbd72a09fe2 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:45.892576 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 489/966] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:45.898526 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a74e5-e065-4393-8ccb-5523d06cde78 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:45.898888 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a74e5-e065-4393-8ccb-5523d06cde78 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:45.899108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a74e5-e065-4393-8ccb-5523d06cde78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:45.919847 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-813a74e5-e065-4393-8ccb-5523d06cde78 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:45.921453 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-813a74e5-e065-4393-8ccb-5523d06cde78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:45.963667 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:46.001765 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 478/967] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:46.280895 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b84e1-9bcc-440e-9966-3cbd72a09fe2 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:46.359875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e95d02-6c3f-4781-8603-55eddeeebe0a None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:46.360401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e95d02-6c3f-4781-8603-55eddeeebe0a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:46.360401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e95d02-6c3f-4781-8603-55eddeeebe0a None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:46.361925 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 479/968] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:46.366651 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d20e4-e1a6-47ec-98bb-9154eb01d0ca None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:46.376376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d20e4-e1a6-47ec-98bb-9154eb01d0ca None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:46.376376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d20e4-e1a6-47ec-98bb-9154eb01d0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:46.388087 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b84e1-9bcc-440e-9966-3cbd72a09fe2 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:46.389596 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-392d20e4-e1a6-47ec-98bb-9154eb01d0ca None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:46.391272 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-392d20e4-e1a6-47ec-98bb-9154eb01d0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:46.391672 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:46.425233 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59103c1-23bf-4e2a-b1b2-223afb29d3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:46.426130 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59103c1-23bf-4e2a-b1b2-223afb29d3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:46.426411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59103c1-23bf-4e2a-b1b2-223afb29d3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:46.426707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59103c1-23bf-4e2a-b1b2-223afb29d3e4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:46.438655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59103c1-23bf-4e2a-b1b2-223afb29d3e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:15:46.443896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-e59103c1-23bf-4e2a-b1b2-223afb29d3e4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 14:15:46.443896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:46.443896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:46.443896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:46.443896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:46.443896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:46.443896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:46.443896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:46.443896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:46.443896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:46.443896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:46.443896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:46.443896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:15:46.443896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:15:46.443896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:15:46.443896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:15:46.444833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:15:46.444833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:15:46.444833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:15:46.444833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:15:46.444833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:46.444833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:46.444833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:46.444833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:46.444833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:46.444833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:46.444833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:46.444833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:46.444833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:46.444833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:46.444833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:46.444833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:46.445863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:46.445863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:46.445863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:46.445863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:46.445863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:15:46.445863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:15:46.445863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:15:46.445863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:15:46.445863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:15:46.445863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:15:46.445863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 14:15:46.445863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:46.445863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 490/969] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Sep 5 14:15:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:46.451244 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59103c1-23bf-4e2a-b1b2-223afb29d3e4 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:46.464973 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 480/970] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 14:15:46.553158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59103c1-23bf-4e2a-b1b2-223afb29d3e4 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:46.587739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2d6c1-1982-43b7-90db-61147e3ca3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:46.588406 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2d6c1-1982-43b7-90db-61147e3ca3aa None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:46.588685 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2d6c1-1982-43b7-90db-61147e3ca3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:46.588957 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2d6c1-1982-43b7-90db-61147e3ca3aa None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:46.589686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2d6c1-1982-43b7-90db-61147e3ca3aa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:46.589993 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2d6c1-1982-43b7-90db-61147e3ca3aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:46.591365 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2d6c1-1982-43b7-90db-61147e3ca3aa None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:46.599474 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 491/971] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Sep 5 14:15:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:46.605116 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d20e4-e1a6-47ec-98bb-9154eb01d0ca None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:46.710334 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:46.715895 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d20e4-e1a6-47ec-98bb-9154eb01d0ca None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:46.741002 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2d6c1-1982-43b7-90db-61147e3ca3aa None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:46.749930 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a81429-d883-492d-b1f9-3cb673b254ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:46.750573 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a81429-d883-492d-b1f9-3cb673b254ca None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:46.750852 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a81429-d883-492d-b1f9-3cb673b254ca None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:46.751124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a81429-d883-492d-b1f9-3cb673b254ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:46.765690 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a81429-d883-492d-b1f9-3cb673b254ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:46.767153 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a81429-d883-492d-b1f9-3cb673b254ca None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:46.770699 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:46.783068 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-10a81429-d883-492d-b1f9-3cb673b254ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:46.783068 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:46.783068 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:46.783068 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:46.783068 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:46.783068 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:46.783068 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:46.783068 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:46.783068 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:46.783068 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:46.783068 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:46.783068 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:46.783068 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:46.783068 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:46.783068 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:46.783068 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:46.784034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:46.784034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:46.784034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:46.784034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:46.784034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:46.784034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:46.784034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:46.784034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:46.784034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:46.784034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:46.784034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:46.784034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:46.784034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:46.784034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:46.784034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:46.784034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:46.784034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:46.785379 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:46.785379 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:46.785379 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:46.785379 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 481/972] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:46.790494 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a81429-d883-492d-b1f9-3cb673b254ca None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:46.851163 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2d6c1-1982-43b7-90db-61147e3ca3aa None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:46.885455 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae38e9-4156-4bc2-ac80-5c6302f74d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:46.886058 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae38e9-4156-4bc2-ac80-5c6302f74d75 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:46.886337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae38e9-4156-4bc2-ac80-5c6302f74d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:46.886609 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae38e9-4156-4bc2-ac80-5c6302f74d75 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:46.887263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae38e9-4156-4bc2-ac80-5c6302f74d75 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:46.888635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae38e9-4156-4bc2-ac80-5c6302f74d75 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:46.891793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a81429-d883-492d-b1f9-3cb673b254ca None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:46.925171 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be442a4-da63-4a92-ace6-595171c63127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:46.925768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be442a4-da63-4a92-ace6-595171c63127 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:46.926303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be442a4-da63-4a92-ace6-595171c63127 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:46.926576 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be442a4-da63-4a92-ace6-595171c63127 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:46.927213 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be442a4-da63-4a92-ace6-595171c63127 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:46.927524 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be442a4-da63-4a92-ace6-595171c63127 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:46.928917 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be442a4-da63-4a92-ace6-595171c63127 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:46.940460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 482/973] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:46.941690 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d6e13-5395-48f9-ad14-5e92480dd305 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:46.941959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d6e13-5395-48f9-ad14-5e92480dd305 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:46.942229 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d6e13-5395-48f9-ad14-5e92480dd305 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:46.943415 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 483/974] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:46.946376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d6e13-5395-48f9-ad14-5e92480dd305 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:46.960740 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:46.994741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 492/975] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 5 14:15:46 2022] POST /identity/v3/services => generated 242 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:15:46.996052 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75202bd2-e7f3-4a7f-b8cf-fece56929bc1 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:46.996372 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75202bd2-e7f3-4a7f-b8cf-fece56929bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:46.996617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75202bd2-e7f3-4a7f-b8cf-fece56929bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:47.020364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-75202bd2-e7f3-4a7f-b8cf-fece56929bc1 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:47.021756 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-75202bd2-e7f3-4a7f-b8cf-fece56929bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:47.062344 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d6e13-5395-48f9-ad14-5e92480dd305 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:47.100718 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f716d03-ba20-4a9a-9f0f-412291d5d701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:47.101459 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f716d03-ba20-4a9a-9f0f-412291d5d701 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:47.101868 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f716d03-ba20-4a9a-9f0f-412291d5d701 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:47.102239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f716d03-ba20-4a9a-9f0f-412291d5d701 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:47.113200 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 493/976] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:47.121599 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f716d03-ba20-4a9a-9f0f-412291d5d701 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:47.123145 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f716d03-ba20-4a9a-9f0f-412291d5d701 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:47.139492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-0f716d03-ba20-4a9a-9f0f-412291d5d701 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 14:15:47.139492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:47.139492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:47.139492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:47.139492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:47.139492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:47.139492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:47.139492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:47.139492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:47.139492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:47.139492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:47.139492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:47.139492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:47.139492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:47.139492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:47.139492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:47.140672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:47.140672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:47.140672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:47.140672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:47.140672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:47.140672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:47.140672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:47.140672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:47.140672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:47.140672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:47.140672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:47.140672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:47.140672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:47.140672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:47.140672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:47.140672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:47.140672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:47.140672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:47.141683 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:47.141683 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:47.141683 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:47.141683 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:47.141683 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:47.141683 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:47.141683 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:47.141683 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:47.141683 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 14:15:47.141683 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:47.141683 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 484/977] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 5 14:15:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:47.146535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75202bd2-e7f3-4a7f-b8cf-fece56929bc1 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:47.164567 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:47.255699 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75202bd2-e7f3-4a7f-b8cf-fece56929bc1 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:47.292757 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03a15f-cc9e-4c1e-97dc-2bad594a84b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:47.293468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03a15f-cc9e-4c1e-97dc-2bad594a84b6 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:47.293771 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03a15f-cc9e-4c1e-97dc-2bad594a84b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:47.294049 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03a15f-cc9e-4c1e-97dc-2bad594a84b6 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:47.294782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03a15f-cc9e-4c1e-97dc-2bad594a84b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:47.295089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03a15f-cc9e-4c1e-97dc-2bad594a84b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:47.296528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03a15f-cc9e-4c1e-97dc-2bad594a84b6 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:47.315070 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 494/978] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Sep 5 14:15:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:47.321487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f716d03-ba20-4a9a-9f0f-412291d5d701 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:47.378243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03a15f-cc9e-4c1e-97dc-2bad594a84b6 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:47.394952 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:47.433012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f716d03-ba20-4a9a-9f0f-412291d5d701 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:47.458936 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:47.469843 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8cc5b-d32d-4bb8-9df7-42be051e3da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:47.470535 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8cc5b-d32d-4bb8-9df7-42be051e3da3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:47.470877 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8cc5b-d32d-4bb8-9df7-42be051e3da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:47.471211 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8cc5b-d32d-4bb8-9df7-42be051e3da3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:47.484248 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03a15f-cc9e-4c1e-97dc-2bad594a84b6 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:47.523336 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea80579-699d-44fc-be5f-2547e6bb4bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:47.523976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea80579-699d-44fc-be5f-2547e6bb4bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:47.524255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea80579-699d-44fc-be5f-2547e6bb4bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:47.524740 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea80579-699d-44fc-be5f-2547e6bb4bd9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:47.525166 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea80579-699d-44fc-be5f-2547e6bb4bd9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:47.526545 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea80579-699d-44fc-be5f-2547e6bb4bd9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:47.535445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-cea80579-699d-44fc-be5f-2547e6bb4bd9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 14:15:47.535445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:47.535445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:15:47.535445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:15:47.535445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:15:47.535445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:15:47.535445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:15:47.535445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:47.535445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 14:15:47.535445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:47.535445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:47.535445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:47.535445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:47.535445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:47.535445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:47.535445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:47.535445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:47.536649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:47.536649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:47.536649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:47.536649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:47.536649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:47.536649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:47.536649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:15:47.536649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:15:47.536649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:15:47.536649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:15:47.536649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:47.536649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:47.536649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:47.536649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:47.536649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:47.536649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:47.537747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:47.537747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:47.537747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:47.537747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:47.537747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:47.537747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:47.537747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:47.537747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:47.537747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:47.537747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:47.537747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:15:47.537747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:47.537747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 14:15:47.537747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:47.543814 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 495/979] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 5 14:15:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:47.544459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea80579-699d-44fc-be5f-2547e6bb4bd9 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:47.548058 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8cc5b-d32d-4bb8-9df7-42be051e3da3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:47.549547 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8cc5b-d32d-4bb8-9df7-42be051e3da3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:47.620263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:47.656289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 485/980] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:15:47 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 14:15:47.661518 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8cc5b-d32d-4bb8-9df7-42be051e3da3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:47.663012 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea80579-699d-44fc-be5f-2547e6bb4bd9 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:47.701466 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908ae70-6f8e-466d-9c7c-ee8871defdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:47.702074 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908ae70-6f8e-466d-9c7c-ee8871defdd2 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:47.702356 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908ae70-6f8e-466d-9c7c-ee8871defdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:47.702630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908ae70-6f8e-466d-9c7c-ee8871defdd2 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:47.703683 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908ae70-6f8e-466d-9c7c-ee8871defdd2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:47.703989 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908ae70-6f8e-466d-9c7c-ee8871defdd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:47.705770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908ae70-6f8e-466d-9c7c-ee8871defdd2 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:47.712854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 496/981] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 5 14:15:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:47.718275 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908ae70-6f8e-466d-9c7c-ee8871defdd2 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:47.721131 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:47.765692 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8cc5b-d32d-4bb8-9df7-42be051e3da3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:47.807635 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57df52a-9ec6-4040-9594-fe50bbc6d005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:47.808282 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57df52a-9ec6-4040-9594-fe50bbc6d005 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:47.808645 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57df52a-9ec6-4040-9594-fe50bbc6d005 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:47.808984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57df52a-9ec6-4040-9594-fe50bbc6d005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:47.819625 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57df52a-9ec6-4040-9594-fe50bbc6d005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:47.821879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57df52a-9ec6-4040-9594-fe50bbc6d005 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:47.831748 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908ae70-6f8e-466d-9c7c-ee8871defdd2 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:47.836997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-e57df52a-9ec6-4040-9594-fe50bbc6d005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:47.836997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:47.836997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:47.836997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:47.836997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:47.836997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:47.836997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:47.836997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:47.836997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:47.836997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:47.836997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:47.836997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:47.836997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:47.836997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:47.836997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:47.836997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:47.837935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:47.837935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:47.837935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:47.837935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:47.837935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:47.837935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:47.837935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:47.837935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:47.837935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:47.837935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:47.837935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:47.837935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:47.837935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:47.837935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:47.837935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:47.837935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:47.837935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:47.838816 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:47.838816 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:47.838816 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:47.838816 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 486/982] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:47.843620 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57df52a-9ec6-4040-9594-fe50bbc6d005 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:47.866558 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:47.871969 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55ed95-afc0-4208-b387-b69eedd59447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:47.872576 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55ed95-afc0-4208-b387-b69eedd59447 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:47.872856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55ed95-afc0-4208-b387-b69eedd59447 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:47.873153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55ed95-afc0-4208-b387-b69eedd59447 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:47.873825 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55ed95-afc0-4208-b387-b69eedd59447 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:47.874126 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55ed95-afc0-4208-b387-b69eedd59447 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:47.875492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55ed95-afc0-4208-b387-b69eedd59447 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:47.880386 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 497/983] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 5 14:15:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:47.886622 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55ed95-afc0-4208-b387-b69eedd59447 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:47.948965 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57df52a-9ec6-4040-9594-fe50bbc6d005 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:47.956510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:47.993469 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55ed95-afc0-4208-b387-b69eedd59447 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:47.997518 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48caf083-98d6-46e9-9d61-07b74de72161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:47.998050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48caf083-98d6-46e9-9d61-07b74de72161 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:47.998340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48caf083-98d6-46e9-9d61-07b74de72161 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:47.998623 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48caf083-98d6-46e9-9d61-07b74de72161 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:47.999293 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48caf083-98d6-46e9-9d61-07b74de72161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:47.999602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48caf083-98d6-46e9-9d61-07b74de72161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:48.002349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48caf083-98d6-46e9-9d61-07b74de72161 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:48.014250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 487/984] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:48.019998 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48caf083-98d6-46e9-9d61-07b74de72161 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:48.043369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb5fd1-c9f7-4949-8284-ddf766ac79af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:48.044025 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb5fd1-c9f7-4949-8284-ddf766ac79af None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:48.044338 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb5fd1-c9f7-4949-8284-ddf766ac79af None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:48.045134 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb5fd1-c9f7-4949-8284-ddf766ac79af None admin] PATH_INFO: `/v3/endpoints` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:48.046132 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb5fd1-c9f7-4949-8284-ddf766ac79af None admin] RBAC: Adding query filter params (interface=admin, service_id=bf8c32d3b2be4773834f478d4ffcb238, region_id=RegionOne) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:48.046460 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb5fd1-c9f7-4949-8284-ddf766ac79af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:48.048489 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb5fd1-c9f7-4949-8284-ddf766ac79af None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:48.060599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 498/985] 10.222.0.23 () {56 vars in 1249 bytes} [Mon Sep 5 14:15:47 2022] GET /identity/v3/endpoints?service_id=bf8c32d3b2be4773834f478d4ffcb238&interface=admin®ion_id=RegionOne => generated 193 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:48.061675 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb5fd1-c9f7-4949-8284-ddf766ac79af None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:48.109752 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:48.130138 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48caf083-98d6-46e9-9d61-07b74de72161 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:48.167864 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742c086-21ea-4d4c-b637-3ae532c5d053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:48.168482 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742c086-21ea-4d4c-b637-3ae532c5d053 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:48.168756 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742c086-21ea-4d4c-b637-3ae532c5d053 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:48.168858 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb5fd1-c9f7-4949-8284-ddf766ac79af None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:48.169046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742c086-21ea-4d4c-b637-3ae532c5d053 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:48.175759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742c086-21ea-4d4c-b637-3ae532c5d053 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:48.177476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742c086-21ea-4d4c-b637-3ae532c5d053 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:48.188433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-4742c086-21ea-4d4c-b637-3ae532c5d053 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:48.188433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:48.188433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:48.188433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:48.188433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:48.188433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:48.188433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:48.188433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:48.188433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:48.188433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:48.188433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:48.188433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:48.188433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:48.188433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:48.188433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:48.189469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:48.189469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:48.189469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:48.189469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:48.189469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:48.189469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:48.189469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:48.189469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:48.189469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:48.189469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:48.189469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:48.189469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:48.189469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:48.189469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:48.189469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:48.189469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:48.189469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:48.190350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:48.190350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:48.190350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:48.190350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:48.190350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:48.190350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:48.190350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:48.190350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:48.190350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 488/986] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:48.195337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742c086-21ea-4d4c-b637-3ae532c5d053 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:48.201560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:48.209210 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8518c-fac5-4cfa-a796-5e64a4060432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:48.209905 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8518c-fac5-4cfa-a796-5e64a4060432 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:48.210242 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8518c-fac5-4cfa-a796-5e64a4060432 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:48.210573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8518c-fac5-4cfa-a796-5e64a4060432 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:48.211778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8518c-fac5-4cfa-a796-5e64a4060432 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:48.213251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8518c-fac5-4cfa-a796-5e64a4060432 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:48.225128 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 499/987] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 5 14:15:48 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:15:48.318347 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742c086-21ea-4d4c-b637-3ae532c5d053 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:48.355497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e34cdd-0e2d-478f-8010-8827ee2c0a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:48.356435 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e34cdd-0e2d-478f-8010-8827ee2c0a27 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:48.356614 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e34cdd-0e2d-478f-8010-8827ee2c0a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:48.356881 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e34cdd-0e2d-478f-8010-8827ee2c0a27 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:48.357612 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e34cdd-0e2d-478f-8010-8827ee2c0a27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:48.357916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e34cdd-0e2d-478f-8010-8827ee2c0a27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:48.359361 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e34cdd-0e2d-478f-8010-8827ee2c0a27 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:48.370152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:48.374590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 489/988] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:48.380365 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8518c-fac5-4cfa-a796-5e64a4060432 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:48.486985 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8518c-fac5-4cfa-a796-5e64a4060432 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:48.521564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed2dfa-da36-4903-b91d-e5960b0aedc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:48.522163 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed2dfa-da36-4903-b91d-e5960b0aedc0 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:48.522433 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed2dfa-da36-4903-b91d-e5960b0aedc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:48.522698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed2dfa-da36-4903-b91d-e5960b0aedc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:48.523668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed2dfa-da36-4903-b91d-e5960b0aedc0 None admin] RBAC: Adding query filter params (role.id=599c4ddaf84948b2822c11b41782ebe2, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=635e47d0a5a34fdfb5c8967a96a87828) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:48.523978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed2dfa-da36-4903-b91d-e5960b0aedc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:48.525502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed2dfa-da36-4903-b91d-e5960b0aedc0 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:48.531629 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 500/989] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:15:48 2022] GET /identity/v3/role_assignments?user.id=635e47d0a5a34fdfb5c8967a96a87828&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=599c4ddaf84948b2822c11b41782ebe2 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:48.967441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41769bf3-f7ea-4a1f-bdd7-183f9541b439 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:48.967960 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41769bf3-f7ea-4a1f-bdd7-183f9541b439 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:48.967960 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41769bf3-f7ea-4a1f-bdd7-183f9541b439 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:48.969509 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 490/990] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:48.974363 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30720e40-8615-4678-9504-3701dde434c3 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:48.974740 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30720e40-8615-4678-9504-3701dde434c3 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:48.974915 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30720e40-8615-4678-9504-3701dde434c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:48.993629 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-30720e40-8615-4678-9504-3701dde434c3 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:48.994820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-30720e40-8615-4678-9504-3701dde434c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:49.051386 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:49.065040 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 501/991] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:49.339768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41769bf3-f7ea-4a1f-bdd7-183f9541b439 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:49.444490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41769bf3-f7ea-4a1f-bdd7-183f9541b439 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:49.478455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2fd6c-c7ec-4e08-9373-85fb1779bd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:49.479066 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2fd6c-c7ec-4e08-9373-85fb1779bd2e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:49.479340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2fd6c-c7ec-4e08-9373-85fb1779bd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:49.479608 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2fd6c-c7ec-4e08-9373-85fb1779bd2e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:49.480179 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2fd6c-c7ec-4e08-9373-85fb1779bd2e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:49.481583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2fd6c-c7ec-4e08-9373-85fb1779bd2e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:49.490129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-18d2fd6c-c7ec-4e08-9373-85fb1779bd2e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 14:15:49.490129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:49.490129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:15:49.490129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:15:49.490129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:15:49.490129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:15:49.490129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:15:49.490129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:49.490129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 14:15:49.490129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:49.490129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:49.490129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:49.490129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:49.490129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:49.490129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:49.490129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:49.490129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:49.491070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:49.491070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:49.491070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:49.491070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:49.491070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:49.491070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:49.491070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:15:49.491070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:15:49.491070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:15:49.491070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:15:49.491070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:49.491070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:49.491070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:49.491070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:49.491070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:49.491070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:49.492490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:49.492490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:49.492490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:49.492490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:49.492490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:49.492490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:49.492490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:49.492490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:49.492490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:49.492490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:49.492490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:15:49.492490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:49.492490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 14:15:49.492490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:49.492490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 491/992] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:49.499005 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30720e40-8615-4678-9504-3701dde434c3 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:49.597577 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30720e40-8615-4678-9504-3701dde434c3 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:49.631302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a7593-4f2d-409d-89ab-0667a1bea439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:49.631932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a7593-4f2d-409d-89ab-0667a1bea439 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:49.632204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a7593-4f2d-409d-89ab-0667a1bea439 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:49.632471 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a7593-4f2d-409d-89ab-0667a1bea439 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:49.633739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a7593-4f2d-409d-89ab-0667a1bea439 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:49.634049 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a7593-4f2d-409d-89ab-0667a1bea439 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:49.635483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a7593-4f2d-409d-89ab-0667a1bea439 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:49.645273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 502/993] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 5 14:15:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:49.647295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2fd6c-c7ec-4e08-9373-85fb1779bd2e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:49.714634 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:49.751834 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2fd6c-c7ec-4e08-9373-85fb1779bd2e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:49.785408 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefca77-6e7a-47d6-a8f4-9f558319b307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:49.786004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefca77-6e7a-47d6-a8f4-9f558319b307 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:49.786283 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefca77-6e7a-47d6-a8f4-9f558319b307 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:49.786550 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefca77-6e7a-47d6-a8f4-9f558319b307 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:49.787171 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefca77-6e7a-47d6-a8f4-9f558319b307 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:49.787470 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefca77-6e7a-47d6-a8f4-9f558319b307 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:49.788813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefca77-6e7a-47d6-a8f4-9f558319b307 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:49.794357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 492/994] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 5 14:15:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:49.799939 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a7593-4f2d-409d-89ab-0667a1bea439 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:49.853478 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:49.901225 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a7593-4f2d-409d-89ab-0667a1bea439 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:49.935471 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668ac88-13e2-4eec-9864-31f4d8f68748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:49.936074 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668ac88-13e2-4eec-9864-31f4d8f68748 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:49.936349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668ac88-13e2-4eec-9864-31f4d8f68748 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:49.936614 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668ac88-13e2-4eec-9864-31f4d8f68748 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:49.937352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668ac88-13e2-4eec-9864-31f4d8f68748 None admin] RBAC: Adding query filter params (interface=public, service_id=051003eb4ce448d0a479b2d8ad62ffd7, region_id=RegionOne) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:49.937655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668ac88-13e2-4eec-9864-31f4d8f68748 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:49.939015 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668ac88-13e2-4eec-9864-31f4d8f68748 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:49.944147 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 503/995] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 5 14:15:49 2022] GET /identity/v3/endpoints?service_id=051003eb4ce448d0a479b2d8ad62ffd7&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:49.950128 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefca77-6e7a-47d6-a8f4-9f558319b307 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:50.054141 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefca77-6e7a-47d6-a8f4-9f558319b307 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:50.080774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:50.089561 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602194fe-f39a-4f16-91c3-11b112acadbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:50.090160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602194fe-f39a-4f16-91c3-11b112acadbf None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:50.090434 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602194fe-f39a-4f16-91c3-11b112acadbf None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:50.090699 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602194fe-f39a-4f16-91c3-11b112acadbf None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:50.091609 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602194fe-f39a-4f16-91c3-11b112acadbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:50.092694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602194fe-f39a-4f16-91c3-11b112acadbf None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:50.105086 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 493/996] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 5 14:15:49 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:15:50.181728 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeee0af-419c-4b38-a64d-6e011662adaa None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:50.182255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeee0af-419c-4b38-a64d-6e011662adaa None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:50.182255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeee0af-419c-4b38-a64d-6e011662adaa None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:50.183718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 504/997] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:50.189488 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bae7b-9dfc-4fa0-8e1c-d31c4bddf4f0 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:50.189771 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bae7b-9dfc-4fa0-8e1c-d31c4bddf4f0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:50.190052 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bae7b-9dfc-4fa0-8e1c-d31c4bddf4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:50.209971 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a96bae7b-9dfc-4fa0-8e1c-d31c4bddf4f0 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:50.211248 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a96bae7b-9dfc-4fa0-8e1c-d31c4bddf4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:50.289254 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 494/998] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:50.482790 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda23f5-24de-421f-b00c-6bdbcdfde1f2 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:50.482976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda23f5-24de-421f-b00c-6bdbcdfde1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:50.483253 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda23f5-24de-421f-b00c-6bdbcdfde1f2 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:50.484719 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 505/999] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:50.489700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954a8af-b390-4c53-8e57-5bf161ea44e2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:50.490050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954a8af-b390-4c53-8e57-5bf161ea44e2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:50.490390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954a8af-b390-4c53-8e57-5bf161ea44e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:50.509756 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5954a8af-b390-4c53-8e57-5bf161ea44e2 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:50.510931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5954a8af-b390-4c53-8e57-5bf161ea44e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:50.557498 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda23f5-24de-421f-b00c-6bdbcdfde1f2 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:50.581843 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 495/1000] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:50.672692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda23f5-24de-421f-b00c-6bdbcdfde1f2 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:50.694319 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:50.712911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e3d56-a5f1-4ea7-9511-74699e9a2872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:50.713572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e3d56-a5f1-4ea7-9511-74699e9a2872 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:50.713849 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e3d56-a5f1-4ea7-9511-74699e9a2872 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:50.720605 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e3d56-a5f1-4ea7-9511-74699e9a2872 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:50.720605 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e3d56-a5f1-4ea7-9511-74699e9a2872 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:50.720605 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e3d56-a5f1-4ea7-9511-74699e9a2872 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:50.724909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-c55e3d56-a5f1-4ea7-9511-74699e9a2872 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 14:15:50.724909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:50.724909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:15:50.724909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:15:50.724909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:15:50.724909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:15:50.724909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:15:50.724909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:50.724909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 14:15:50.724909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:50.724909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:50.724909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:50.724909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:50.724909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:50.724909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:50.724909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:50.724909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:50.725910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:50.725910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:50.725910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:50.725910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:50.725910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:50.725910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:50.725910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:15:50.725910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:15:50.725910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:15:50.725910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:15:50.725910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:50.725910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:50.725910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:50.725910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:50.725910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:50.725910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:50.727579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:50.727579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:50.727579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:50.727579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:50.727579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:50.727579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:50.727579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:50.727579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:50.727579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:50.727579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:50.727579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:15:50.727579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:50.727579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 14:15:50.727579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:50.727579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 506/1001] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Sep 5 14:15:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:50.733122 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954a8af-b390-4c53-8e57-5bf161ea44e2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:50.788379 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:50.838412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954a8af-b390-4c53-8e57-5bf161ea44e2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:50.856673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e3d56-a5f1-4ea7-9511-74699e9a2872 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:50.872698 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766ed6e-c703-4019-8aab-94f7ff9812b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:50.873334 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766ed6e-c703-4019-8aab-94f7ff9812b4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:50.873620 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766ed6e-c703-4019-8aab-94f7ff9812b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:50.873890 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766ed6e-c703-4019-8aab-94f7ff9812b4 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:50.874521 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766ed6e-c703-4019-8aab-94f7ff9812b4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:50.874820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766ed6e-c703-4019-8aab-94f7ff9812b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:50.876178 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766ed6e-c703-4019-8aab-94f7ff9812b4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:50.885136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 496/1002] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 5 14:15:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:50.886701 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766ed6e-c703-4019-8aab-94f7ff9812b4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:50.969233 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e3d56-a5f1-4ea7-9511-74699e9a2872 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:50.990444 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766ed6e-c703-4019-8aab-94f7ff9812b4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:51.004875 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b3a95-f875-472c-aa3b-7a0a79a2ed45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:51.005727 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b3a95-f875-472c-aa3b-7a0a79a2ed45 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:51.006014 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b3a95-f875-472c-aa3b-7a0a79a2ed45 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:51.006279 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b3a95-f875-472c-aa3b-7a0a79a2ed45 None admin] PATH_INFO: `/v3/services/image` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:51.006395 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:51.007057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b3a95-f875-472c-aa3b-7a0a79a2ed45 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:51.008766 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b3a95-f875-472c-aa3b-7a0a79a2ed45 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:51.017573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-0d7b3a95-f875-472c-aa3b-7a0a79a2ed45 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 14:15:51.017573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:51.017573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:15:51.017573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:15:51.017573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:15:51.017573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:15:51.017573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:15:51.017573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:51.017573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 14:15:51.017573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:51.017573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:51.017573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:51.017573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:51.017573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:51.017573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:51.017573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:51.017573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:51.021437 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:51.021437 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:51.021437 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:51.021437 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:51.021437 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:51.021437 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:51.021437 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:15:51.021437 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:15:51.021437 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:15:51.021437 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:15:51.021437 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:51.021437 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:51.021437 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:51.021437 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:51.021437 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:51.021437 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:51.022296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:51.022296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:51.022296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:51.022296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:51.022296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:51.022296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:51.022296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:51.022296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:51.022296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:51.022296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:51.022296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:15:51.022296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:51.022296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 14:15:51.022296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:51.022296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 507/1003] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Sep 5 14:15:50 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:51.025344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b3a95-f875-472c-aa3b-7a0a79a2ed45 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:51.027592 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf8737-ecb2-46c2-8465-bef6491f66c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:51.028201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf8737-ecb2-46c2-8465-bef6491f66c2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:51.028479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf8737-ecb2-46c2-8465-bef6491f66c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:51.028747 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf8737-ecb2-46c2-8465-bef6491f66c2 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:51.029410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf8737-ecb2-46c2-8465-bef6491f66c2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:51.029712 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf8737-ecb2-46c2-8465-bef6491f66c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:51.031061 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf8737-ecb2-46c2-8465-bef6491f66c2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:51.036845 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 497/1004] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Sep 5 14:15:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:51.042530 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf8737-ecb2-46c2-8465-bef6491f66c2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:51.080034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:51.138648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b3a95-f875-472c-aa3b-7a0a79a2ed45 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:51.148261 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf8737-ecb2-46c2-8465-bef6491f66c2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:51.174046 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00698d-a6f3-4cda-a2d3-8c90ba03934b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:51.174653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00698d-a6f3-4cda-a2d3-8c90ba03934b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:51.174929 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00698d-a6f3-4cda-a2d3-8c90ba03934b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:51.175197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00698d-a6f3-4cda-a2d3-8c90ba03934b None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:51.176085 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00698d-a6f3-4cda-a2d3-8c90ba03934b None admin] RBAC: Adding query filter params (name=image) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:51.176392 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00698d-a6f3-4cda-a2d3-8c90ba03934b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:51.177793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00698d-a6f3-4cda-a2d3-8c90ba03934b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:51.182551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48f217-6e1c-4767-aabc-e3a76141e818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:51.183219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48f217-6e1c-4767-aabc-e3a76141e818 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:51.183674 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 508/1005] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:51.184128 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48f217-6e1c-4767-aabc-e3a76141e818 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:51.184128 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48f217-6e1c-4767-aabc-e3a76141e818 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:51.184635 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48f217-6e1c-4767-aabc-e3a76141e818 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:51.186072 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48f217-6e1c-4767-aabc-e3a76141e818 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:51.189131 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00698d-a6f3-4cda-a2d3-8c90ba03934b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:51.281218 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 498/1006] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:15:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:15:51.312752 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00698d-a6f3-4cda-a2d3-8c90ba03934b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:51.323235 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:51.357257 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b67711-691c-4af1-ac81-65477fb8f982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:51.358001 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b67711-691c-4af1-ac81-65477fb8f982 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:51.358349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b67711-691c-4af1-ac81-65477fb8f982 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:51.359013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b67711-691c-4af1-ac81-65477fb8f982 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:51.360022 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b67711-691c-4af1-ac81-65477fb8f982 None admin] RBAC: Adding query filter params (type=image) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:51.360849 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b67711-691c-4af1-ac81-65477fb8f982 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:51.362363 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b67711-691c-4af1-ac81-65477fb8f982 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:51.373875 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 509/1007] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:51 2022] GET /identity/v3/services?type=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:52.097394 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27280bf-a2cc-4803-8162-e5fb04f868e2 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:52.097756 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27280bf-a2cc-4803-8162-e5fb04f868e2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:52.097937 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27280bf-a2cc-4803-8162-e5fb04f868e2 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:52.099415 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 499/1008] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:52.105311 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b47b08-b0a0-4eb7-a88a-4851b6ac5f09 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:52.105598 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b47b08-b0a0-4eb7-a88a-4851b6ac5f09 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:52.105872 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b47b08-b0a0-4eb7-a88a-4851b6ac5f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:52.124475 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d8b47b08-b0a0-4eb7-a88a-4851b6ac5f09 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:52.125687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d8b47b08-b0a0-4eb7-a88a-4851b6ac5f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:52.195915 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 510/1009] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:52 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:52.474751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27280bf-a2cc-4803-8162-e5fb04f868e2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:52.520427 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:52.580837 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27280bf-a2cc-4803-8162-e5fb04f868e2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:52.616105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466686b-96d6-48ab-b5dd-a80dd0ef9c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:52.616731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466686b-96d6-48ab-b5dd-a80dd0ef9c92 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:52.617049 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466686b-96d6-48ab-b5dd-a80dd0ef9c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:52.617339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466686b-96d6-48ab-b5dd-a80dd0ef9c92 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:52.617930 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466686b-96d6-48ab-b5dd-a80dd0ef9c92 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:52.619355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466686b-96d6-48ab-b5dd-a80dd0ef9c92 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:52.628023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-f466686b-96d6-48ab-b5dd-a80dd0ef9c92 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 14:15:52.628023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:52.628023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:15:52.628023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:15:52.628023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:15:52.628023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:15:52.628023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:15:52.628023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:52.628023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 14:15:52.628023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:52.628023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:52.628023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:52.628023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:52.628023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:52.628023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:52.628023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:52.628023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:52.628985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:52.628985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:52.628985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:52.628985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:52.628985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:52.628985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:52.628985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:15:52.628985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:15:52.628985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:15:52.628985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:15:52.628985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:52.628985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:52.628985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:52.628985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:52.628985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:52.628985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:52.629862 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:52.629862 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:52.629862 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:52.629862 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:52.629862 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:52.629862 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:52.629862 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:52.629862 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:52.629862 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:52.629862 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:52.629862 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:15:52.629862 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:52.629862 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 14:15:52.629862 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:52.633144 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 500/1010] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:52.635153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b47b08-b0a0-4eb7-a88a-4851b6ac5f09 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:52.739075 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:52.743403 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b47b08-b0a0-4eb7-a88a-4851b6ac5f09 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:52.778471 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c7e87-3326-4f74-972c-fc121213929d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:52.779127 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c7e87-3326-4f74-972c-fc121213929d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:52.779401 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c7e87-3326-4f74-972c-fc121213929d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:52.779695 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c7e87-3326-4f74-972c-fc121213929d None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:52.780313 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c7e87-3326-4f74-972c-fc121213929d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:52.780612 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c7e87-3326-4f74-972c-fc121213929d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:52.782005 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c7e87-3326-4f74-972c-fc121213929d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:52.791890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 511/1011] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 5 14:15:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:52.793718 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466686b-96d6-48ab-b5dd-a80dd0ef9c92 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:52.899453 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466686b-96d6-48ab-b5dd-a80dd0ef9c92 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:52.902197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:52.935546 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3291b46-17fb-4c0c-8bca-313249c8fec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:52.936152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3291b46-17fb-4c0c-8bca-313249c8fec9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:52.936430 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3291b46-17fb-4c0c-8bca-313249c8fec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:52.936701 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3291b46-17fb-4c0c-8bca-313249c8fec9 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:52.937344 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3291b46-17fb-4c0c-8bca-313249c8fec9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:52.937651 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3291b46-17fb-4c0c-8bca-313249c8fec9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:52.939005 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3291b46-17fb-4c0c-8bca-313249c8fec9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:52.944045 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 501/1012] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Sep 5 14:15:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:52.950231 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c7e87-3326-4f74-972c-fc121213929d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:53.054712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c7e87-3326-4f74-972c-fc121213929d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:53.090648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fcdfb-15db-430e-b6a6-67877aeaa7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:53.091316 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fcdfb-15db-430e-b6a6-67877aeaa7bf None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:53.091595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fcdfb-15db-430e-b6a6-67877aeaa7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:53.091865 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fcdfb-15db-430e-b6a6-67877aeaa7bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:53.092598 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fcdfb-15db-430e-b6a6-67877aeaa7bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:53.094076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fcdfb-15db-430e-b6a6-67877aeaa7bf None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:53.202568 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347f63f-4ec1-4cee-b204-d48aa40f19e8 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:53.202799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347f63f-4ec1-4cee-b204-d48aa40f19e8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:53.203012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347f63f-4ec1-4cee-b204-d48aa40f19e8 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:53.204341 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 502/1013] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:53.209145 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e79577-8bf5-41ea-922d-7425c2473427 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:53.209428 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e79577-8bf5-41ea-922d-7425c2473427 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:53.209695 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e79577-8bf5-41ea-922d-7425c2473427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:53.221328 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 512/1014] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:15:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:15:53.241401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f0e79577-8bf5-41ea-922d-7425c2473427 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:53.242802 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f0e79577-8bf5-41ea-922d-7425c2473427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:53.327553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ef7b0-d4a6-4524-8c24-697f464aa21d None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:53.327742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ef7b0-d4a6-4524-8c24-697f464aa21d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:53.328019 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ef7b0-d4a6-4524-8c24-697f464aa21d None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:53.333241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 513/1015] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:15:53.333404 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 503/1016] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:53 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 14:15:53.335056 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fea649-f0a7-48f0-8ad0-1ce32a7ca34c None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:53.335344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fea649-f0a7-48f0-8ad0-1ce32a7ca34c None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:53.336230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fea649-f0a7-48f0-8ad0-1ce32a7ca34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:53.355587 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-06fea649-f0a7-48f0-8ad0-1ce32a7ca34c None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:53.356809 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-06fea649-f0a7-48f0-8ad0-1ce32a7ca34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:53.371872 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:53.428920 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 514/1017] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:53 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:53.592043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e79577-8bf5-41ea-922d-7425c2473427 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:53.684824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:53.691874 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e79577-8bf5-41ea-922d-7425c2473427 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:53.700171 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fea649-f0a7-48f0-8ad0-1ce32a7ca34c None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:53.725904 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad546c0-8ce2-4f92-8a5f-27f4739f15a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:53.727256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad546c0-8ce2-4f92-8a5f-27f4739f15a3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:53.727535 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad546c0-8ce2-4f92-8a5f-27f4739f15a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:53.727808 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad546c0-8ce2-4f92-8a5f-27f4739f15a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:53.728897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad546c0-8ce2-4f92-8a5f-27f4739f15a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:53.730361 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad546c0-8ce2-4f92-8a5f-27f4739f15a3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:53.732050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 504/1018] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:53.737494 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad546c0-8ce2-4f92-8a5f-27f4739f15a3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:53.808553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fea649-f0a7-48f0-8ad0-1ce32a7ca34c None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:53.842706 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9294db-2893-430f-bf5f-250788b98445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:53.843240 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9294db-2893-430f-bf5f-250788b98445 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:53.843511 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9294db-2893-430f-bf5f-250788b98445 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:53.843781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9294db-2893-430f-bf5f-250788b98445 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:53.844439 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9294db-2893-430f-bf5f-250788b98445 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:53.845892 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9294db-2893-430f-bf5f-250788b98445 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:53.849798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad546c0-8ce2-4f92-8a5f-27f4739f15a3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:53.886837 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24487b-1bf3-4659-b072-7a1b73a33bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:53.887438 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24487b-1bf3-4659-b072-7a1b73a33bb3 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:53.887716 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24487b-1bf3-4659-b072-7a1b73a33bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:53.888096 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24487b-1bf3-4659-b072-7a1b73a33bb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:53.888678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24487b-1bf3-4659-b072-7a1b73a33bb3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:53.890132 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24487b-1bf3-4659-b072-7a1b73a33bb3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:53.925104 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 515/1019] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 5 14:15:53 2022] POST /identity/v3/services => generated 242 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:15:53.993099 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 505/1020] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 5 14:15:53 2022] POST /identity/v3/projects => generated 311 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:15:55.299066 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59b97d-3451-4115-9263-1dce591e93d1 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:55.299574 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59b97d-3451-4115-9263-1dce591e93d1 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:55.299651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59b97d-3451-4115-9263-1dce591e93d1 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:55.301347 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 516/1021] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:55.306851 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5183b38-0a6d-4d1d-81e1-aa32882438dd None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:55.307320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5183b38-0a6d-4d1d-81e1-aa32882438dd None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:55.307399 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5183b38-0a6d-4d1d-81e1-aa32882438dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:55.327487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b5183b38-0a6d-4d1d-81e1-aa32882438dd None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:55.328672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b5183b38-0a6d-4d1d-81e1-aa32882438dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:55.339145 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:55.405872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 506/1022] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:55.686571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59b97d-3451-4115-9263-1dce591e93d1 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:55.698787 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:55.800277 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59b97d-3451-4115-9263-1dce591e93d1 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:55.837299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b5ae5-becb-4c37-a49d-6ea27ebe7f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:55.837932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b5ae5-becb-4c37-a49d-6ea27ebe7f15 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:55.838210 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b5ae5-becb-4c37-a49d-6ea27ebe7f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:55.838479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b5ae5-becb-4c37-a49d-6ea27ebe7f15 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:55.848672 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b5ae5-becb-4c37-a49d-6ea27ebe7f15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:15:55.854770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-b97b5ae5-becb-4c37-a49d-6ea27ebe7f15 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 14:15:55.854770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:55.854770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:55.854770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:55.854770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:55.854770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:55.854770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:55.854770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:55.854770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:55.854770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:55.854770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:55.854770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:55.854770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:15:55.854770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:15:55.854770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:15:55.854770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:15:55.855707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:15:55.855707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:15:55.855707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:15:55.855707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:15:55.855707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:55.855707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:55.855707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:55.855707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:55.855707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:55.855707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:55.855707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:55.855707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:55.855707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:55.855707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:55.855707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:55.855707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:55.856552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:55.856552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:55.856552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:55.856552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:55.856552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:15:55.856552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:15:55.856552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:15:55.856552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:15:55.856552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:15:55.856552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:15:55.856552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 14:15:55.856552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:55.860864 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 517/1023] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Sep 5 14:15:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:55.862374 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8f294-df63-4568-8ac0-8a274bbbafbf None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:55.862669 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8f294-df63-4568-8ac0-8a274bbbafbf None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:55.862946 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8f294-df63-4568-8ac0-8a274bbbafbf None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:55.863419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b5ae5-becb-4c37-a49d-6ea27ebe7f15 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:55.864520 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 507/1024] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:55.870057 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f65df-f975-43b6-91df-c0ed99737e34 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:55.870339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f65df-f975-43b6-91df-c0ed99737e34 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:55.870636 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f65df-f975-43b6-91df-c0ed99737e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:55.891588 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-0c2f65df-f975-43b6-91df-c0ed99737e34 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:55.892786 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0c2f65df-f975-43b6-91df-c0ed99737e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:55.938981 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:55.969416 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 508/1025] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:55.970681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07a320-a1b0-4447-bd27-98dc6274931b None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:55.970969 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07a320-a1b0-4447-bd27-98dc6274931b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:55.971244 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07a320-a1b0-4447-bd27-98dc6274931b None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:55.972468 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 509/1026] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:55.978096 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844b811-6234-466d-893c-c44a9f4c537a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:55.978380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844b811-6234-466d-893c-c44a9f4c537a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:55.978654 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844b811-6234-466d-893c-c44a9f4c537a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:55.979633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b5ae5-becb-4c37-a49d-6ea27ebe7f15 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:55.996751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1844b811-6234-466d-893c-c44a9f4c537a None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:55.997964 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1844b811-6234-466d-893c-c44a9f4c537a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:56.017766 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8b38d-797c-4973-b54c-31b9284ad513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:56.018369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8b38d-797c-4973-b54c-31b9284ad513 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:56.018646 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8b38d-797c-4973-b54c-31b9284ad513 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:56.018910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8b38d-797c-4973-b54c-31b9284ad513 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:56.019567 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8b38d-797c-4973-b54c-31b9284ad513 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:56.019860 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8b38d-797c-4973-b54c-31b9284ad513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:56.021255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8b38d-797c-4973-b54c-31b9284ad513 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:56.029275 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 518/1027] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Sep 5 14:15:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:56.034742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8b38d-797c-4973-b54c-31b9284ad513 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:56.067429 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:56.073088 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 510/1028] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 14:15:56.144563 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8b38d-797c-4973-b54c-31b9284ad513 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:56.180628 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:56.187146 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fb54f-148f-4aaa-ba8f-481f6146b059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:56.187816 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fb54f-148f-4aaa-ba8f-481f6146b059 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:56.188095 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fb54f-148f-4aaa-ba8f-481f6146b059 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:56.188368 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fb54f-148f-4aaa-ba8f-481f6146b059 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:56.202620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4fb54f-148f-4aaa-ba8f-481f6146b059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:56.202620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4fb54f-148f-4aaa-ba8f-481f6146b059 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:56.218018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-7c4fb54f-148f-4aaa-ba8f-481f6146b059 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:56.218018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:56.218018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:56.218018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:56.218018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:56.218018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:56.218018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:56.218018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:56.218018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:56.218018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:56.218018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:56.218018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:56.218018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:56.218018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:56.218018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:56.218018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:56.219149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:56.219149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:56.219149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:56.219149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:56.219149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:56.219149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:56.219149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:56.219149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:56.219149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:56.219149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:56.219149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:56.219149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:56.219149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:56.219149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:56.219149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:56.219149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:56.219149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:56.220248 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:56.220248 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:56.220248 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:56.225370 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 519/1029] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:56.230611 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844b811-6234-466d-893c-c44a9f4c537a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:56.250038 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fb54f-148f-4aaa-ba8f-481f6146b059 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:56.334214 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844b811-6234-466d-893c-c44a9f4c537a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:56.357097 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fb54f-148f-4aaa-ba8f-481f6146b059 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:56.369012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1c211-56f2-467f-af6e-4d12461d6710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:56.369644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1c211-56f2-467f-af6e-4d12461d6710 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:56.369916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1c211-56f2-467f-af6e-4d12461d6710 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:56.370181 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1c211-56f2-467f-af6e-4d12461d6710 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:56.370842 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1c211-56f2-467f-af6e-4d12461d6710 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:56.371138 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1c211-56f2-467f-af6e-4d12461d6710 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:56.372545 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1c211-56f2-467f-af6e-4d12461d6710 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:56.383766 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 511/1030] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:56.383766 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1c211-56f2-467f-af6e-4d12461d6710 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:56.396468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef3e8e-f5c0-410e-b7fe-6535a501379b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:56.397120 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef3e8e-f5c0-410e-b7fe-6535a501379b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:56.397401 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef3e8e-f5c0-410e-b7fe-6535a501379b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:56.397671 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef3e8e-f5c0-410e-b7fe-6535a501379b None admin] PATH_INFO: `/v3/services/image` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:56.398833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef3e8e-f5c0-410e-b7fe-6535a501379b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:56.400503 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef3e8e-f5c0-410e-b7fe-6535a501379b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:56.409149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-eeef3e8e-f5c0-410e-b7fe-6535a501379b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 14:15:56.409149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:56.409149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:15:56.409149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:15:56.409149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:15:56.409149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:15:56.409149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:15:56.409149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:56.409149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 14:15:56.409149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:56.409149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:56.409149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:56.409149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:56.409149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:56.409149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:56.409149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:56.409149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:56.410376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:56.410376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:56.410376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:56.410376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:56.410376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:56.410376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:56.410376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:15:56.410376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:15:56.410376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:15:56.410376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:15:56.410376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:56.410376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:56.410376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:56.410376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:56.410376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:56.410376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:56.411453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:56.411453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:56.411453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:56.411453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:56.411453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:56.411453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:56.411453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:56.411453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:56.411453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:56.411453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:56.411453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:15:56.411453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:56.411453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 14:15:56.411453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:56.411453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 520/1031] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Sep 5 14:15:56 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:56.412464 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef3e8e-f5c0-410e-b7fe-6535a501379b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:56.448876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:56.465027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:56.491916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1c211-56f2-467f-af6e-4d12461d6710 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:56.515652 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef3e8e-f5c0-410e-b7fe-6535a501379b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:56.526525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cce6ed-f1e4-4059-b2d9-5a94433d8ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:56.527144 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cce6ed-f1e4-4059-b2d9-5a94433d8ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:56.527418 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cce6ed-f1e4-4059-b2d9-5a94433d8ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:56.527713 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cce6ed-f1e4-4059-b2d9-5a94433d8ca4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:56.528783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cce6ed-f1e4-4059-b2d9-5a94433d8ca4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:56.530240 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cce6ed-f1e4-4059-b2d9-5a94433d8ca4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:56.531775 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 512/1032] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:56.532517 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cce6ed-f1e4-4059-b2d9-5a94433d8ca4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:56.550558 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99280f1f-0c97-417e-803a-21f6b3737fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:56.551453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99280f1f-0c97-417e-803a-21f6b3737fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:56.551731 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99280f1f-0c97-417e-803a-21f6b3737fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:56.552000 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99280f1f-0c97-417e-803a-21f6b3737fe0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:56.559611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99280f1f-0c97-417e-803a-21f6b3737fe0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:56.561173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99280f1f-0c97-417e-803a-21f6b3737fe0 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:56.572668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-99280f1f-0c97-417e-803a-21f6b3737fe0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 14:15:56.572668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:56.572668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:56.572668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:56.572668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:56.572668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:56.572668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:56.572668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:56.572668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:56.572668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:56.572668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:56.572668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:56.572668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:15:56.572668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:15:56.572668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:15:56.572668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:15:56.573870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:56.573870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:56.573870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:15:56.573870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:56.573870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:15:56.573870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:15:56.573870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:56.573870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:56.573870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:56.573870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:56.573870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:56.573870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:56.573870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:56.573870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:56.573870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:56.573870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:56.573870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:56.573870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:56.574785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:56.574785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:56.574785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:15:56.574785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:15:56.574785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:15:56.574785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:15:56.574785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:15:56.574785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:15:56.574785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 14:15:56.574785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:56.574785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 521/1033] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 5 14:15:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:56.575373 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99280f1f-0c97-417e-803a-21f6b3737fe0 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:56.638140 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cce6ed-f1e4-4059-b2d9-5a94433d8ca4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:56.664888 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:56.672648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99280f1f-0c97-417e-803a-21f6b3737fe0 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:56.672788 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfcb4b-780c-4f31-b97a-4769a48b9020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:56.673329 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfcb4b-780c-4f31-b97a-4769a48b9020 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:56.677200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfcb4b-780c-4f31-b97a-4769a48b9020 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:56.677200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfcb4b-780c-4f31-b97a-4769a48b9020 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:56.677200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfcb4b-780c-4f31-b97a-4769a48b9020 None admin] RBAC: Adding query filter params (name=image) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:56.677200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfcb4b-780c-4f31-b97a-4769a48b9020 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:56.677200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfcb4b-780c-4f31-b97a-4769a48b9020 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:56.680749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:56.686090 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 513/1034] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:56.686090 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfcb4b-780c-4f31-b97a-4769a48b9020 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:56.707854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732090f-3a68-41e9-9bec-1f2c083d19a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:56.708461 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732090f-3a68-41e9-9bec-1f2c083d19a8 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:56.708740 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732090f-3a68-41e9-9bec-1f2c083d19a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:56.709008 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732090f-3a68-41e9-9bec-1f2c083d19a8 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:56.709692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732090f-3a68-41e9-9bec-1f2c083d19a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:56.711247 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732090f-3a68-41e9-9bec-1f2c083d19a8 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:56.790160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfcb4b-780c-4f31-b97a-4769a48b9020 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:56.793937 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 522/1035] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 5 14:15:56 2022] POST /identity/v3/users => generated 285 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:15:56.794683 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732090f-3a68-41e9-9bec-1f2c083d19a8 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:56.829734 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76be5d5-857d-4a70-bec1-cda4010141e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:56.830362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76be5d5-857d-4a70-bec1-cda4010141e7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:56.830640 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76be5d5-857d-4a70-bec1-cda4010141e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:56.830911 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76be5d5-857d-4a70-bec1-cda4010141e7 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:56.831664 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76be5d5-857d-4a70-bec1-cda4010141e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:56.831988 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76be5d5-857d-4a70-bec1-cda4010141e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:56.833575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76be5d5-857d-4a70-bec1-cda4010141e7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:56.855558 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 514/1036] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 5 14:15:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:56.862390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76be5d5-857d-4a70-bec1-cda4010141e7 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:56.918640 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:56.923371 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732090f-3a68-41e9-9bec-1f2c083d19a8 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:56.968764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67c1db-1782-4551-a4eb-0fb29381c4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:56.969902 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67c1db-1782-4551-a4eb-0fb29381c4f0 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:56.969902 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67c1db-1782-4551-a4eb-0fb29381c4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:56.970107 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67c1db-1782-4551-a4eb-0fb29381c4f0 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:56.970722 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67c1db-1782-4551-a4eb-0fb29381c4f0 None admin] RBAC: Adding query filter params (type=image) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:56.971031 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67c1db-1782-4551-a4eb-0fb29381c4f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:56.972541 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67c1db-1782-4551-a4eb-0fb29381c4f0 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:56.978075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76be5d5-857d-4a70-bec1-cda4010141e7 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:56.981217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 523/1037] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:56.984513 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67c1db-1782-4551-a4eb-0fb29381c4f0 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:57.021941 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:57.025229 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2d7d0-6a4b-469b-8d42-c95e0a4f84ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:57.026077 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2d7d0-6a4b-469b-8d42-c95e0a4f84ac None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:57.026354 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2d7d0-6a4b-469b-8d42-c95e0a4f84ac None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:57.026628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2d7d0-6a4b-469b-8d42-c95e0a4f84ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:57.096938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2d7d0-6a4b-469b-8d42-c95e0a4f84ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:57.098319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2d7d0-6a4b-469b-8d42-c95e0a4f84ac None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:57.102013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67c1db-1782-4551-a4eb-0fb29381c4f0 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:57.143824 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e09aca-29aa-445f-a9f9-ebe22deb0424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:57.144582 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e09aca-29aa-445f-a9f9-ebe22deb0424 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:57.144992 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e09aca-29aa-445f-a9f9-ebe22deb0424 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:57.145309 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e09aca-29aa-445f-a9f9-ebe22deb0424 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:57.146013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e09aca-29aa-445f-a9f9-ebe22deb0424 None admin] RBAC: Adding query filter params (interface=public, service_id=7229d5668d484a66aa971060e3ac68e7, region_id=RegionOne) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:57.146572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e09aca-29aa-445f-a9f9-ebe22deb0424 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:57.148833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e09aca-29aa-445f-a9f9-ebe22deb0424 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:57.151126 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:57.156319 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 524/1038] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 5 14:15:56 2022] GET /identity/v3/endpoints?service_id=7229d5668d484a66aa971060e3ac68e7&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:57.161603 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e09aca-29aa-445f-a9f9-ebe22deb0424 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:57.218949 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 515/1039] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:15:56 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 14:15:57.220521 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2d7d0-6a4b-469b-8d42-c95e0a4f84ac None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:57.264688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:57.275269 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e09aca-29aa-445f-a9f9-ebe22deb0424 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:57.312477 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e7ce0-91c1-42ec-9ba9-ed9897a27c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:57.313146 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e7ce0-91c1-42ec-9ba9-ed9897a27c13 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:57.313393 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e7ce0-91c1-42ec-9ba9-ed9897a27c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:57.313665 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e7ce0-91c1-42ec-9ba9-ed9897a27c13 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:57.314272 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e7ce0-91c1-42ec-9ba9-ed9897a27c13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:57.315649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e7ce0-91c1-42ec-9ba9-ed9897a27c13 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:57.322420 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 525/1040] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 5 14:15:57 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:15:57.341588 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2d7d0-6a4b-469b-8d42-c95e0a4f84ac None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:57.382899 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09095f94-eeca-4fd0-9d67-aa762b8451fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:57.383405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09095f94-eeca-4fd0-9d67-aa762b8451fc None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:57.383686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09095f94-eeca-4fd0-9d67-aa762b8451fc None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:57.383961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09095f94-eeca-4fd0-9d67-aa762b8451fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:57.395995 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09095f94-eeca-4fd0-9d67-aa762b8451fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:57.397637 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09095f94-eeca-4fd0-9d67-aa762b8451fc None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:57.414336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-09095f94-eeca-4fd0-9d67-aa762b8451fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:57.414336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:57.414336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:57.414336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:57.414336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:57.414336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:57.414336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:57.414336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:57.414336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:57.414336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:57.414336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:57.414336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:57.414336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:15:57.414336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:15:57.414336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:15:57.414336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:15:57.419002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:57.419002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:57.419002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:57.419002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:57.419002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:57.419002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:57.419002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:57.419002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:57.419002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:57.419002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:57.419002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:57.419002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:57.419002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:57.419002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:57.419002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:57.419002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:57.419002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:15:57.419914 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:15:57.419914 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:15:57.419914 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:57.419914 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 516/1041] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:57.422012 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e7ce0-91c1-42ec-9ba9-ed9897a27c13 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:57.528738 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e7ce0-91c1-42ec-9ba9-ed9897a27c13 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:57.563606 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746667e3-dc6a-4483-b00d-a88f77c62925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:57.564209 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746667e3-dc6a-4483-b00d-a88f77c62925 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:57.564482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746667e3-dc6a-4483-b00d-a88f77c62925 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:57.564739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746667e3-dc6a-4483-b00d-a88f77c62925 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:57.565473 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746667e3-dc6a-4483-b00d-a88f77c62925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:57.565773 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746667e3-dc6a-4483-b00d-a88f77c62925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:57.567138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746667e3-dc6a-4483-b00d-a88f77c62925 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:57.578313 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 526/1042] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:57.584227 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09095f94-eeca-4fd0-9d67-aa762b8451fc None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:57.587140 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:57.688489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09095f94-eeca-4fd0-9d67-aa762b8451fc None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:57.722285 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f9a14-1189-40fa-859a-76a52f1c54cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:57.723024 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f9a14-1189-40fa-859a-76a52f1c54cf None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:57.723359 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f9a14-1189-40fa-859a-76a52f1c54cf None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:57.723674 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f9a14-1189-40fa-859a-76a52f1c54cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:57.731037 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f9a14-1189-40fa-859a-76a52f1c54cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:57.732461 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f9a14-1189-40fa-859a-76a52f1c54cf None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:57.743473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-a03f9a14-1189-40fa-859a-76a52f1c54cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:57.743473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:57.743473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:57.743473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:57.743473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:57.743473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:57.743473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:57.743473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:57.743473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:57.743473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:57.743473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:57.743473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:57.743473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:15:57.743473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:15:57.743473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:15:57.744364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:15:57.744364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:57.744364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:57.744364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:57.744364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:57.744364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:57.744364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:57.744364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:57.744364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:57.744364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:57.744364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:57.744364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:57.744364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:57.744364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:57.744364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:57.744364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:57.744364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:57.745405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:15:57.745405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:15:57.745405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:15:57.745405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:15:57.745405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:15:57.745405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:15:57.745405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:15:57.745405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:57.745405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 517/1043] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:15:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:57.751740 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746667e3-dc6a-4483-b00d-a88f77c62925 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:57.768005 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:57.856046 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746667e3-dc6a-4483-b00d-a88f77c62925 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:57.891008 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4f6a8-de7d-495a-bec3-70d5bb7d18f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:57.891613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4f6a8-de7d-495a-bec3-70d5bb7d18f7 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:57.891884 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4f6a8-de7d-495a-bec3-70d5bb7d18f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:57.892151 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4f6a8-de7d-495a-bec3-70d5bb7d18f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:57.892831 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4f6a8-de7d-495a-bec3-70d5bb7d18f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:57.893155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4f6a8-de7d-495a-bec3-70d5bb7d18f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:57.894586 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4f6a8-de7d-495a-bec3-70d5bb7d18f7 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:57.906491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 527/1044] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:15:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:57.912702 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f9a14-1189-40fa-859a-76a52f1c54cf None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:57.979183 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:58.018419 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f9a14-1189-40fa-859a-76a52f1c54cf None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:58.052111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c67c0-531e-4176-8ead-da6eca361110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:58.052706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c67c0-531e-4176-8ead-da6eca361110 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:58.052986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c67c0-531e-4176-8ead-da6eca361110 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:58.053288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c67c0-531e-4176-8ead-da6eca361110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:58.054003 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c67c0-531e-4176-8ead-da6eca361110 None admin] RBAC: Adding query filter params (role.id=599c4ddaf84948b2822c11b41782ebe2, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=d5515accf3b64006bc41422265a641bc) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:58.054379 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c67c0-531e-4176-8ead-da6eca361110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:58.056487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c67c0-531e-4176-8ead-da6eca361110 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:58.073132 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 518/1045] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:15:57 2022] GET /identity/v3/role_assignments?user.id=d5515accf3b64006bc41422265a641bc&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=599c4ddaf84948b2822c11b41782ebe2 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:15:58.779564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0365401-7cf4-4d34-8176-76ca3fc97791 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:58.780110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0365401-7cf4-4d34-8176-76ca3fc97791 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:58.780110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0365401-7cf4-4d34-8176-76ca3fc97791 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:58.781566 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 528/1046] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:58.786576 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089201ed-315d-42b9-b70a-33ba142c6edc None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:58.786966 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089201ed-315d-42b9-b70a-33ba142c6edc None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:58.787135 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089201ed-315d-42b9-b70a-33ba142c6edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:58.806047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-089201ed-315d-42b9-b70a-33ba142c6edc None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:58.807226 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-089201ed-315d-42b9-b70a-33ba142c6edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:58.876334 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 519/1047] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:59.148830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0365401-7cf4-4d34-8176-76ca3fc97791 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:59.235132 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:59.258353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0365401-7cf4-4d34-8176-76ca3fc97791 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:59.293820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d24db-5c5e-473d-8236-fb883e658b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:59.294450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d24db-5c5e-473d-8236-fb883e658b26 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:59.294725 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d24db-5c5e-473d-8236-fb883e658b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:59.294993 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d24db-5c5e-473d-8236-fb883e658b26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:59.298293 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334d977-919d-42c1-9e21-57b7ca0a4721 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:59.298575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334d977-919d-42c1-9e21-57b7ca0a4721 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:59.298843 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334d977-919d-42c1-9e21-57b7ca0a4721 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:59.300164 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 520/1048] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:15:59.305436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62ae69-44a0-4768-bf8b-2f6da9110286 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:59.305873 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62ae69-44a0-4768-bf8b-2f6da9110286 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:59.306270 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62ae69-44a0-4768-bf8b-2f6da9110286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:59.306560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d24db-5c5e-473d-8236-fb883e658b26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:15:59.311340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-1f0d24db-5c5e-473d-8236-fb883e658b26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:15:59.311340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:59.311340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:59.311340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:59.311340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:59.311340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:59.311340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:59.311340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:59.311340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:59.311340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:59.311340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:59.311340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:59.311340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:15:59.311340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:15:59.311340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:15:59.311340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:15:59.312267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:15:59.312267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:15:59.312267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:15:59.312267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:15:59.312267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:59.312267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:59.312267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:59.312267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:59.312267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:59.312267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:59.312267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:59.312267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:59.312267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:59.312267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:59.312267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:59.312267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:59.313535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:59.313535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:59.313535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:59.313535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:59.313535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:15:59.313535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:15:59.313535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:15:59.313535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:15:59.313535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:15:59.313535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:15:59.313535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:15:59.313535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:15:59.314244 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 529/1049] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:15:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:15:59.318529 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d24db-5c5e-473d-8236-fb883e658b26 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:59.325424 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ac62ae69-44a0-4768-bf8b-2f6da9110286 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:15:59.326622 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ac62ae69-44a0-4768-bf8b-2f6da9110286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:15:59.383359 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:59.400581 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 521/1050] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:15:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:15:59.430073 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d24db-5c5e-473d-8236-fb883e658b26 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:59.465322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25549b5e-772f-41cf-964e-adf6ef293abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:59.465926 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25549b5e-772f-41cf-964e-adf6ef293abc None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:59.466198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25549b5e-772f-41cf-964e-adf6ef293abc None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:59.466516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25549b5e-772f-41cf-964e-adf6ef293abc None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:59.467171 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25549b5e-772f-41cf-964e-adf6ef293abc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:15:59.467467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25549b5e-772f-41cf-964e-adf6ef293abc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:59.468831 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25549b5e-772f-41cf-964e-adf6ef293abc None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:59.470346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:59.483046 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 530/1051] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:15:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:59.488369 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62ae69-44a0-4768-bf8b-2f6da9110286 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:59.593787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62ae69-44a0-4768-bf8b-2f6da9110286 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:59.628554 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b11b39-09a7-4385-ba19-b66bec4341f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:59.629207 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b11b39-09a7-4385-ba19-b66bec4341f3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:59.629484 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b11b39-09a7-4385-ba19-b66bec4341f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:59.629751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b11b39-09a7-4385-ba19-b66bec4341f3 None admin] PATH_INFO: `/v3/users/8cbf44c561884fb6b546b9951205b710` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:59.644027 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b11b39-09a7-4385-ba19-b66bec4341f3 None admin] RBAC: Authorizing `identity:get_user(user_id=8cbf44c561884fb6b546b9951205b710)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:59.645508 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b11b39-09a7-4385-ba19-b66bec4341f3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:59.652515 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 522/1052] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:15:59 2022] GET /identity/v3/users/8cbf44c561884fb6b546b9951205b710 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:15:59.653590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25549b5e-772f-41cf-964e-adf6ef293abc None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:59.682514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b11b39-09a7-4385-ba19-b66bec4341f3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:59.737321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:59.759577 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25549b5e-772f-41cf-964e-adf6ef293abc None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:59.796264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b11b39-09a7-4385-ba19-b66bec4341f3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:59.796791 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fcd486-7bb5-4485-9fb1-5e743c13bc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:59.797438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcd486-7bb5-4485-9fb1-5e743c13bc73 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:59.797881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcd486-7bb5-4485-9fb1-5e743c13bc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:59.798156 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcd486-7bb5-4485-9fb1-5e743c13bc73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:59.832325 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68453bfd-545b-4ea6-a298-f24dccecc105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:15:59.833095 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68453bfd-545b-4ea6-a298-f24dccecc105 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:15:59.833450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68453bfd-545b-4ea6-a298-f24dccecc105 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:15:59.833625 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68453bfd-545b-4ea6-a298-f24dccecc105 None admin] PATH_INFO: `/v3/services/image` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:15:59.834200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68453bfd-545b-4ea6-a298-f24dccecc105 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:59.835718 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68453bfd-545b-4ea6-a298-f24dccecc105 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:59.845443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-68453bfd-545b-4ea6-a298-f24dccecc105 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 14:15:59.845443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:59.845443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:15:59.845443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:15:59.845443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:15:59.845443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:15:59.845443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:15:59.845443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:59.845443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 14:15:59.845443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:59.845443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:15:59.845443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:59.845443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:15:59.845443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:15:59.845443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:15:59.845443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:15:59.845443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:15:59.846457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:15:59.846457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:15:59.846457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:15:59.846457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:15:59.846457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:15:59.846457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:15:59.846457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:15:59.846457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:15:59.846457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:15:59.846457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:15:59.846457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:15:59.846457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:15:59.846457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:15:59.846457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:15:59.846457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:15:59.846457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:15:59.847305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:15:59.847305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:15:59.847305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:15:59.847305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:15:59.847305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:15:59.847305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:15:59.847305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:15:59.847305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:15:59.847305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:15:59.847305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:15:59.847305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:15:59.847305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:15:59.847305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 14:15:59.847305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:15:59.847305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 523/1053] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Sep 5 14:15:59 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:15:59.852889 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68453bfd-545b-4ea6-a298-f24dccecc105 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:15:59.868494 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:59.875135 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fcd486-7bb5-4485-9fb1-5e743c13bc73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:15:59.876631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fcd486-7bb5-4485-9fb1-5e743c13bc73 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:15:59.961238 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68453bfd-545b-4ea6-a298-f24dccecc105 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:15:59.970722 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:15:59.980650 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 531/1054] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:15:59 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 14:15:59.986392 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fcd486-7bb5-4485-9fb1-5e743c13bc73 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:00.000352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3fa54-e15f-460f-bdc2-3aca2697d3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:00.000952 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3fa54-e15f-460f-bdc2-3aca2697d3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:00.001260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3fa54-e15f-460f-bdc2-3aca2697d3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:00.001529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3fa54-e15f-460f-bdc2-3aca2697d3c6 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:00.002147 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3fa54-e15f-460f-bdc2-3aca2697d3c6 None admin] RBAC: Adding query filter params (name=image) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:00.002446 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3fa54-e15f-460f-bdc2-3aca2697d3c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:00.003809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3fa54-e15f-460f-bdc2-3aca2697d3c6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:00.009652 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 524/1055] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:15:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:16:00.010877 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d2887-91f6-4616-bcf3-f63c5334c5f0 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:00.011165 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d2887-91f6-4616-bcf3-f63c5334c5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:00.011425 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d2887-91f6-4616-bcf3-f63c5334c5f0 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:00.012599 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 525/1056] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:16:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:16:00.015119 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d2887-91f6-4616-bcf3-f63c5334c5f0 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:00.082809 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:00.088965 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fcd486-7bb5-4485-9fb1-5e743c13bc73 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:00.117876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d2887-91f6-4616-bcf3-f63c5334c5f0 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:00.122361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1907e-8333-4f12-be09-7803f775df34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:00.122985 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1907e-8333-4f12-be09-7803f775df34 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:00.123264 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1907e-8333-4f12-be09-7803f775df34 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:00.123534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1907e-8333-4f12-be09-7803f775df34 None admin] PATH_INFO: `/v3/projects/6924c4e125a84486963fbedaa25eba86` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:00.124774 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1907e-8333-4f12-be09-7803f775df34 None admin] RBAC: Authorizing `identity:get_project(project_id=6924c4e125a84486963fbedaa25eba86)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:00.126692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1907e-8333-4f12-be09-7803f775df34 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:00.128725 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 532/1057] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:15:59 2022] GET /identity/v3/projects/6924c4e125a84486963fbedaa25eba86 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:16:00.128725 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a1bc3-8c47-42aa-8864-ef0928d09c13 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:00.128725 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a1bc3-8c47-42aa-8864-ef0928d09c13 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:00.128725 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a1bc3-8c47-42aa-8864-ef0928d09c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:00.148036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-a67a1bc3-8c47-42aa-8864-ef0928d09c13 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:16:00.149236 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a67a1bc3-8c47-42aa-8864-ef0928d09c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:16:00.152440 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac3ca9-9bd3-45af-8151-9b3c8011eca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:00.153039 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac3ca9-9bd3-45af-8151-9b3c8011eca3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:00.153447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac3ca9-9bd3-45af-8151-9b3c8011eca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:00.153721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac3ca9-9bd3-45af-8151-9b3c8011eca3 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:00.154345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac3ca9-9bd3-45af-8151-9b3c8011eca3 None admin] RBAC: Adding query filter params (type=image) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:00.154649 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac3ca9-9bd3-45af-8151-9b3c8011eca3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:00.156002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac3ca9-9bd3-45af-8151-9b3c8011eca3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:00.161081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 526/1058] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:16:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:16:00.161894 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac3ca9-9bd3-45af-8151-9b3c8011eca3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:00.205122 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:00.219359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 533/1059] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:16:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:16:00.219359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a1bc3-8c47-42aa-8864-ef0928d09c13 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:00.274959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac3ca9-9bd3-45af-8151-9b3c8011eca3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:00.310956 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6138c4-668a-4543-a14a-a0101622dae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:00.311769 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6138c4-668a-4543-a14a-a0101622dae4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:00.312092 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6138c4-668a-4543-a14a-a0101622dae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:00.312363 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6138c4-668a-4543-a14a-a0101622dae4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:00.313103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6138c4-668a-4543-a14a-a0101622dae4 None admin] RBAC: Adding query filter params (role.id=f22e6e660eab44c5be25e3dee1e3042c, scope.project.id=6924c4e125a84486963fbedaa25eba86, user.id=8cbf44c561884fb6b546b9951205b710) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:00.313412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6138c4-668a-4543-a14a-a0101622dae4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:00.314822 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6138c4-668a-4543-a14a-a0101622dae4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:00.317324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:00.333084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 527/1060] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:16:00 2022] GET /identity/v3/role_assignments?user.id=8cbf44c561884fb6b546b9951205b710&scope.project.id=6924c4e125a84486963fbedaa25eba86&role.id=f22e6e660eab44c5be25e3dee1e3042c => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:00.337484 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a1bc3-8c47-42aa-8864-ef0928d09c13 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:00.379545 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf1133-a5cf-4cb8-b9fd-9e4e86dd8525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:00.380163 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1133-a5cf-4cb8-b9fd-9e4e86dd8525 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:00.380437 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1133-a5cf-4cb8-b9fd-9e4e86dd8525 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:00.380845 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1133-a5cf-4cb8-b9fd-9e4e86dd8525 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:00.381459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf1133-a5cf-4cb8-b9fd-9e4e86dd8525 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:00.383371 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf1133-a5cf-4cb8-b9fd-9e4e86dd8525 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:00.475010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 534/1061] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:16:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:16:00.486964 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6138c4-668a-4543-a14a-a0101622dae4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:00.596283 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:00.599953 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6138c4-668a-4543-a14a-a0101622dae4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:00.644270 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eb99b-9bc0-496b-b1b0-92f157c3d05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:00.644896 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eb99b-9bc0-496b-b1b0-92f157c3d05c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:00.645203 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eb99b-9bc0-496b-b1b0-92f157c3d05c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:00.645472 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eb99b-9bc0-496b-b1b0-92f157c3d05c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:00.656399 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144eb99b-9bc0-496b-b1b0-92f157c3d05c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:16:00.661150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-144eb99b-9bc0-496b-b1b0-92f157c3d05c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 14:16:00.661150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:16:00.661150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:16:00.661150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:16:00.661150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:16:00.661150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:16:00.661150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:16:00.661150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:16:00.661150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:16:00.661150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:16:00.661150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:16:00.661150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:16:00.661150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:16:00.661150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:16:00.661150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:16:00.661150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:16:00.662103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:16:00.662103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:16:00.662103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:16:00.662103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:16:00.662103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:16:00.662103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:16:00.662103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:16:00.662103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:16:00.662103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:16:00.662103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:16:00.662103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:16:00.662103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:16:00.662103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:16:00.662103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:16:00.662103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:16:00.662103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:16:00.663289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:16:00.663289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:16:00.663289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:16:00.663289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:16:00.663289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:16:00.663289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:16:00.663289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:16:00.663289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:16:00.663289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:16:00.663289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:16:00.663289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 14:16:00.663289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:16:00.663289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 528/1062] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Sep 5 14:16:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:16:00.669455 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf1133-a5cf-4cb8-b9fd-9e4e86dd8525 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:00.784068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf1133-a5cf-4cb8-b9fd-9e4e86dd8525 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:00.820331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c1bf7-435b-47e6-a2c2-9b3d78b48cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:00.821249 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c1bf7-435b-47e6-a2c2-9b3d78b48cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:00.821249 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c1bf7-435b-47e6-a2c2-9b3d78b48cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:00.821447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c1bf7-435b-47e6-a2c2-9b3d78b48cf5 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:00.822037 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c1bf7-435b-47e6-a2c2-9b3d78b48cf5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:00.822344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c1bf7-435b-47e6-a2c2-9b3d78b48cf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:00.823726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c1bf7-435b-47e6-a2c2-9b3d78b48cf5 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:00.832208 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 535/1063] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Sep 5 14:16:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:00.839233 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eb99b-9bc0-496b-b1b0-92f157c3d05c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:00.949122 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eb99b-9bc0-496b-b1b0-92f157c3d05c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:00.984389 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde2e1a-096d-4f95-b498-6622916682c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:00.985007 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde2e1a-096d-4f95-b498-6622916682c3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:00.985310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde2e1a-096d-4f95-b498-6622916682c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:00.985579 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde2e1a-096d-4f95-b498-6622916682c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:00.996049 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde2e1a-096d-4f95-b498-6622916682c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:00.997518 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde2e1a-096d-4f95-b498-6622916682c3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:01.012200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-0fde2e1a-096d-4f95-b498-6622916682c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:16:01.012200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:16:01.012200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:16:01.012200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:16:01.012200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:16:01.012200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:16:01.012200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:16:01.012200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:16:01.012200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:16:01.012200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:16:01.012200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:16:01.012200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:16:01.012200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:16:01.012200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:16:01.012200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:16:01.012200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:16:01.013437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:16:01.013437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:16:01.013437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:16:01.013437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:16:01.013437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:16:01.013437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:16:01.013437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:16:01.013437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:16:01.013437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:16:01.013437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:16:01.013437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:16:01.013437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:16:01.013437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:16:01.013437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:16:01.013437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:16:01.013437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:16:01.013437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:16:01.014345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:16:01.014345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:16:01.014345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:16:01.014345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 529/1064] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:16:01.021107 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c1bf7-435b-47e6-a2c2-9b3d78b48cf5 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:01.035564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:01.120410 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c1bf7-435b-47e6-a2c2-9b3d78b48cf5 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:01.154951 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b7eda-bd03-4fa0-ac93-751a26c2334c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:01.155561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b7eda-bd03-4fa0-ac93-751a26c2334c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:01.155838 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b7eda-bd03-4fa0-ac93-751a26c2334c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:01.156111 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b7eda-bd03-4fa0-ac93-751a26c2334c None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:01.156750 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b7eda-bd03-4fa0-ac93-751a26c2334c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:01.157074 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b7eda-bd03-4fa0-ac93-751a26c2334c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:01.158446 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b7eda-bd03-4fa0-ac93-751a26c2334c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:01.174336 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 536/1065] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:16:01.176170 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde2e1a-096d-4f95-b498-6622916682c3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:01.195468 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:01.305009 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde2e1a-096d-4f95-b498-6622916682c3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:01.338791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271af06-d7be-448f-8831-333ef29b501d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:01.339411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271af06-d7be-448f-8831-333ef29b501d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:01.339685 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271af06-d7be-448f-8831-333ef29b501d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:01.339950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271af06-d7be-448f-8831-333ef29b501d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:01.349074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271af06-d7be-448f-8831-333ef29b501d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:01.350491 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271af06-d7be-448f-8831-333ef29b501d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:01.361375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-3271af06-d7be-448f-8831-333ef29b501d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 14:16:01.361375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:16:01.361375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:16:01.361375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:16:01.361375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:16:01.361375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:16:01.361375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:16:01.361375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:16:01.361375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:16:01.361375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:16:01.361375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:16:01.361375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:16:01.361375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:16:01.361375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:16:01.361375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:16:01.361375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:16:01.362331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:16:01.362331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:16:01.362331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:16:01.362331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:16:01.362331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:16:01.362331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:16:01.362331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:16:01.362331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:16:01.362331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:16:01.362331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:16:01.362331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:16:01.362331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:16:01.362331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:16:01.362331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:16:01.362331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:16:01.362331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:16:01.362331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:16:01.362331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:16:01.370996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:16:01.370996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:16:01.370996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:16:01.370996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:16:01.370996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:16:01.370996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:16:01.370996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:16:01.370996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:16:01.370996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 14:16:01.370996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:16:01.370996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 530/1066] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 5 14:16:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:16:01.371607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b7eda-bd03-4fa0-ac93-751a26c2334c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:01.444307 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:01.474237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b7eda-bd03-4fa0-ac93-751a26c2334c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:01.508741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8eab9-a169-42dc-a621-8142d69bfd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:01.509369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8eab9-a169-42dc-a621-8142d69bfd7a None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:01.509642 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8eab9-a169-42dc-a621-8142d69bfd7a None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:01.509906 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8eab9-a169-42dc-a621-8142d69bfd7a None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:01.510618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8eab9-a169-42dc-a621-8142d69bfd7a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:01.510918 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8eab9-a169-42dc-a621-8142d69bfd7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:01.512344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8eab9-a169-42dc-a621-8142d69bfd7a None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:01.535976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 537/1067] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 5 14:16:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:01.537763 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271af06-d7be-448f-8831-333ef29b501d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:01.605957 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:01.641735 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271af06-d7be-448f-8831-333ef29b501d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:01.675160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05e988-5e1d-4e25-a370-87d018561148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:01.676028 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05e988-5e1d-4e25-a370-87d018561148 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:01.676310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05e988-5e1d-4e25-a370-87d018561148 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:01.676630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05e988-5e1d-4e25-a370-87d018561148 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:01.687591 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05e988-5e1d-4e25-a370-87d018561148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:01.689023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05e988-5e1d-4e25-a370-87d018561148 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:01.703511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-7c05e988-5e1d-4e25-a370-87d018561148 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:16:01.703511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:16:01.703511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:16:01.703511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:16:01.703511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:16:01.703511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:16:01.703511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:16:01.703511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:16:01.703511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:16:01.703511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:16:01.703511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:16:01.703511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:16:01.703511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:16:01.703511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:16:01.703511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:16:01.703511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:16:01.704479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:16:01.704479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:16:01.704479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:16:01.704479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:16:01.704479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:16:01.704479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:16:01.704479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:16:01.704479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:16:01.704479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:16:01.704479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:16:01.704479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:16:01.704479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:16:01.704479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:16:01.704479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:16:01.704479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:16:01.704479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:16:01.704479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:16:01.710310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:16:01.710310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:16:01.710310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:16:01.710310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 531/1068] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:16:01.712044 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8eab9-a169-42dc-a621-8142d69bfd7a None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:01.815671 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8eab9-a169-42dc-a621-8142d69bfd7a None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:01.844469 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:01.852057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085f25b-7f47-4501-a3ec-64019051aa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:01.852672 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085f25b-7f47-4501-a3ec-64019051aa57 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:01.852951 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085f25b-7f47-4501-a3ec-64019051aa57 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:01.853271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085f25b-7f47-4501-a3ec-64019051aa57 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:01.853916 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085f25b-7f47-4501-a3ec-64019051aa57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:01.854221 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085f25b-7f47-4501-a3ec-64019051aa57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:01.855610 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085f25b-7f47-4501-a3ec-64019051aa57 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:01.871546 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 538/1069] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:01.873677 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05e988-5e1d-4e25-a370-87d018561148 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:01.978757 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05e988-5e1d-4e25-a370-87d018561148 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:01.998976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:02.013794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018eb8b3-afd6-4c89-8f75-f90425424ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:02.014466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018eb8b3-afd6-4c89-8f75-f90425424ebf None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:02.014745 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018eb8b3-afd6-4c89-8f75-f90425424ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:02.015019 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018eb8b3-afd6-4c89-8f75-f90425424ebf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:02.021517 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018eb8b3-afd6-4c89-8f75-f90425424ebf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:02.023121 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018eb8b3-afd6-4c89-8f75-f90425424ebf None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:02.035093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-018eb8b3-afd6-4c89-8f75-f90425424ebf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:16:02.035093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:16:02.035093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:16:02.035093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:16:02.035093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:16:02.035093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:16:02.035093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:16:02.035093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:16:02.035093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:16:02.035093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:16:02.035093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:16:02.035093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:16:02.035093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:16:02.035093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:16:02.035093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:16:02.035975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:16:02.035975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:16:02.035975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:16:02.035975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:16:02.035975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:16:02.035975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:16:02.035975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:16:02.035975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:16:02.035975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:16:02.035975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:16:02.035975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:16:02.035975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:16:02.035975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:16:02.035975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:16:02.035975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:16:02.035975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:16:02.035975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:16:02.036860 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:16:02.036860 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:16:02.036860 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:16:02.036860 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:16:02.036860 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:16:02.036860 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:16:02.036860 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:16:02.036860 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:16:02.041367 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 532/1070] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:16:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:16:02.042832 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085f25b-7f47-4501-a3ec-64019051aa57 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:02.146247 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085f25b-7f47-4501-a3ec-64019051aa57 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:02.180365 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe03298-c96f-4bf9-80d8-af2053d7102c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:02.180971 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe03298-c96f-4bf9-80d8-af2053d7102c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:02.181275 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe03298-c96f-4bf9-80d8-af2053d7102c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:02.181547 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe03298-c96f-4bf9-80d8-af2053d7102c None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:02.182235 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe03298-c96f-4bf9-80d8-af2053d7102c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:02.182540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe03298-c96f-4bf9-80d8-af2053d7102c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:02.183976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe03298-c96f-4bf9-80d8-af2053d7102c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:02.196441 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 539/1071] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:16:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:02.202697 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018eb8b3-afd6-4c89-8f75-f90425424ebf None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:02.219423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c4dd7-2cd3-4684-8939-7c71c207bc94 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:02.219710 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c4dd7-2cd3-4684-8939-7c71c207bc94 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:02.220147 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c4dd7-2cd3-4684-8939-7c71c207bc94 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:02.222002 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 540/1072] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:16:02.230611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cea8c-91b5-4b7b-b5d0-c26e39fc843d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:02.230611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cea8c-91b5-4b7b-b5d0-c26e39fc843d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:02.230611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cea8c-91b5-4b7b-b5d0-c26e39fc843d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:02.247946 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-8d7cea8c-91b5-4b7b-b5d0-c26e39fc843d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:16:02.249156 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8d7cea8c-91b5-4b7b-b5d0-c26e39fc843d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:16:02.298267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:02.319019 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018eb8b3-afd6-4c89-8f75-f90425424ebf None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:02.319222 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 541/1073] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:16:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 14:16:02.355853 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951497a-adaa-4a86-8cc9-e592cca47936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:02.356932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951497a-adaa-4a86-8cc9-e592cca47936 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:02.357446 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951497a-adaa-4a86-8cc9-e592cca47936 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:02.357940 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951497a-adaa-4a86-8cc9-e592cca47936 None admin] PATH_INFO: `/v3/projects/975f49bcc95643fe876cc03d0d731423/users/d5515accf3b64006bc41422265a641bc/roles/599c4ddaf84948b2822c11b41782ebe2` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:02.360292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951497a-adaa-4a86-8cc9-e592cca47936 None admin] RBAC: Authorizing `identity:create_grant(project_id=975f49bcc95643fe876cc03d0d731423, user_id=d5515accf3b64006bc41422265a641bc, role_id=599c4ddaf84948b2822c11b41782ebe2)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:02.361959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951497a-adaa-4a86-8cc9-e592cca47936 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:02.428967 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 533/1074] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:16:02 2022] PUT /identity/v3/projects/975f49bcc95643fe876cc03d0d731423/users/d5515accf3b64006bc41422265a641bc/roles/599c4ddaf84948b2822c11b41782ebe2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:16:02.451478 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22cfe1-e4a5-4395-8beb-7c5732d93b34 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:02.451761 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22cfe1-e4a5-4395-8beb-7c5732d93b34 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:02.452040 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22cfe1-e4a5-4395-8beb-7c5732d93b34 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:02.453474 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 542/1075] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:16:02.459214 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1ffa5-5f97-48d0-bd89-5ee05de2fb4c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:02.459497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1ffa5-5f97-48d0-bd89-5ee05de2fb4c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:02.459769 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1ffa5-5f97-48d0-bd89-5ee05de2fb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:02.480843 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2ac1ffa5-5f97-48d0-bd89-5ee05de2fb4c None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:16:02.482106 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2ac1ffa5-5f97-48d0-bd89-5ee05de2fb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:16:02.520653 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:02.564061 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 534/1076] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:16:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:16:02.602892 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22cfe1-e4a5-4395-8beb-7c5732d93b34 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:02.708602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22cfe1-e4a5-4395-8beb-7c5732d93b34 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:02.743443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efcf02b-ccf6-45e8-9c27-08bb89900add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:02.744076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcf02b-ccf6-45e8-9c27-08bb89900add None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:02.744357 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcf02b-ccf6-45e8-9c27-08bb89900add None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:02.744630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcf02b-ccf6-45e8-9c27-08bb89900add None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:02.754759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efcf02b-ccf6-45e8-9c27-08bb89900add None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:16:02.760331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-8efcf02b-ccf6-45e8-9c27-08bb89900add None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:16:02.760331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:16:02.760331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:16:02.760331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:16:02.760331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:16:02.760331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:16:02.760331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:16:02.760331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:16:02.760331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:16:02.760331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:16:02.760331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:16:02.760331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:16:02.760331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:16:02.760331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:16:02.760331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:16:02.760331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:16:02.761553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:16:02.761553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:16:02.761553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:16:02.761553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:16:02.761553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:16:02.761553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:16:02.761553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:16:02.761553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:16:02.761553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:16:02.761553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:16:02.761553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:16:02.761553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:16:02.761553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:16:02.761553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:16:02.761553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:16:02.761553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:16:02.762415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:16:02.762415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:16:02.762415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:16:02.762415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:16:02.762415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:16:02.762415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:16:02.762415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:16:02.762415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:16:02.762415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:16:02.762415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:16:02.762415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:16:02.762415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:16:02.768855 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 543/1077] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:16:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:16:02.771902 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1ffa5-5f97-48d0-bd89-5ee05de2fb4c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:02.837902 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efcf02b-ccf6-45e8-9c27-08bb89900add None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:02.878091 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1ffa5-5f97-48d0-bd89-5ee05de2fb4c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:02.883457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:02.916946 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907b35f-c996-46e9-8ba7-9fd39b783ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:02.917588 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907b35f-c996-46e9-8ba7-9fd39b783ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:02.917954 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907b35f-c996-46e9-8ba7-9fd39b783ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:02.918161 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907b35f-c996-46e9-8ba7-9fd39b783ab7 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:02.918804 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907b35f-c996-46e9-8ba7-9fd39b783ab7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:02.919107 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907b35f-c996-46e9-8ba7-9fd39b783ab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:02.920477 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907b35f-c996-46e9-8ba7-9fd39b783ab7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:02.934253 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 535/1078] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:16:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:02.935192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907b35f-c996-46e9-8ba7-9fd39b783ab7 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:02.947802 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efcf02b-ccf6-45e8-9c27-08bb89900add None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:02.967822 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:02.983904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f855a-2004-42c6-8f88-aac353bb820c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:02.984518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f855a-2004-42c6-8f88-aac353bb820c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:02.984799 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f855a-2004-42c6-8f88-aac353bb820c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:02.985197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f855a-2004-42c6-8f88-aac353bb820c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:03.045044 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907b35f-c996-46e9-8ba7-9fd39b783ab7 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:03.058185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f855a-2004-42c6-8f88-aac353bb820c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:03.059662 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f855a-2004-42c6-8f88-aac353bb820c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:03.086121 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556549f4-42d9-41ff-95c6-a42cb865f9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:03.086750 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556549f4-42d9-41ff-95c6-a42cb865f9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:03.087031 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556549f4-42d9-41ff-95c6-a42cb865f9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:03.087306 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556549f4-42d9-41ff-95c6-a42cb865f9b1 None admin] PATH_INFO: `/v3/users/8cbf44c561884fb6b546b9951205b710` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:03.088450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556549f4-42d9-41ff-95c6-a42cb865f9b1 None admin] RBAC: Authorizing `identity:get_user(user_id=8cbf44c561884fb6b546b9951205b710)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:03.089911 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556549f4-42d9-41ff-95c6-a42cb865f9b1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:03.096057 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 536/1079] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:16:02 2022] GET /identity/v3/users/8cbf44c561884fb6b546b9951205b710 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:03.097072 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556549f4-42d9-41ff-95c6-a42cb865f9b1 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:03.110329 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:03.173103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 544/1080] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:16:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 14:16:03.175272 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f855a-2004-42c6-8f88-aac353bb820c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:03.206344 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:03.209349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556549f4-42d9-41ff-95c6-a42cb865f9b1 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:03.245664 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef8014-3665-42a1-bd32-370c5f71c70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:03.246291 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef8014-3665-42a1-bd32-370c5f71c70c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:03.246643 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef8014-3665-42a1-bd32-370c5f71c70c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:03.246892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef8014-3665-42a1-bd32-370c5f71c70c None admin] PATH_INFO: `/v3/projects/6924c4e125a84486963fbedaa25eba86` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:03.247916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef8014-3665-42a1-bd32-370c5f71c70c None admin] RBAC: Authorizing `identity:get_project(project_id=6924c4e125a84486963fbedaa25eba86)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:03.249356 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef8014-3665-42a1-bd32-370c5f71c70c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:03.250965 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 537/1081] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:16:03 2022] GET /identity/v3/projects/6924c4e125a84486963fbedaa25eba86 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:16:03.256651 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef8014-3665-42a1-bd32-370c5f71c70c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:03.303863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f855a-2004-42c6-8f88-aac353bb820c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:03.339925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfce87d-4e67-4e4e-873a-1301c3696595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:03.340575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfce87d-4e67-4e4e-873a-1301c3696595 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:03.340850 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfce87d-4e67-4e4e-873a-1301c3696595 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:03.341150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfce87d-4e67-4e4e-873a-1301c3696595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:03.349415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:03.351431 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfce87d-4e67-4e4e-873a-1301c3696595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:03.353163 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfce87d-4e67-4e4e-873a-1301c3696595 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:03.367741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef8014-3665-42a1-bd32-370c5f71c70c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:03.371438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-dcfce87d-4e67-4e4e-873a-1301c3696595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:16:03.371438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:16:03.371438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:16:03.371438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:16:03.371438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:16:03.371438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:16:03.371438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:16:03.371438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:16:03.371438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:16:03.371438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:16:03.371438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:16:03.371438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:16:03.371438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:16:03.371438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:16:03.371438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:16:03.371438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:16:03.372350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:16:03.372350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:16:03.372350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:16:03.372350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:16:03.372350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:16:03.372350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:16:03.372350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:16:03.372350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:16:03.372350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:16:03.372350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:16:03.372350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:16:03.372350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:16:03.372350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:16:03.372350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:16:03.372350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:16:03.372350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:16:03.372350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:16:03.373441 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:16:03.373441 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:16:03.373441 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:16:03.373441 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 545/1082] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:16:03.378412 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfce87d-4e67-4e4e-873a-1301c3696595 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:03.405717 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0f96a-7736-49cc-a6ff-9d8ea51762a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:03.406376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0f96a-7736-49cc-a6ff-9d8ea51762a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:03.406657 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0f96a-7736-49cc-a6ff-9d8ea51762a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:03.406929 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0f96a-7736-49cc-a6ff-9d8ea51762a7 None admin] PATH_INFO: `/v3/projects/6924c4e125a84486963fbedaa25eba86/users/8cbf44c561884fb6b546b9951205b710/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:03.408839 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0f96a-7736-49cc-a6ff-9d8ea51762a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6924c4e125a84486963fbedaa25eba86, user_id=8cbf44c561884fb6b546b9951205b710, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:03.410310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0f96a-7736-49cc-a6ff-9d8ea51762a7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:03.485467 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 538/1083] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:16:03 2022] PUT /identity/v3/projects/6924c4e125a84486963fbedaa25eba86/users/8cbf44c561884fb6b546b9951205b710/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:16:03.489420 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfce87d-4e67-4e4e-873a-1301c3696595 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:03.530005 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fb5b1-8031-461b-ab70-ead5f98a2255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:03.530638 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fb5b1-8031-461b-ab70-ead5f98a2255 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:03.530916 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fb5b1-8031-461b-ab70-ead5f98a2255 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:03.531187 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fb5b1-8031-461b-ab70-ead5f98a2255 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:03.531869 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fb5b1-8031-461b-ab70-ead5f98a2255 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:03.532172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fb5b1-8031-461b-ab70-ead5f98a2255 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:03.533680 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fb5b1-8031-461b-ab70-ead5f98a2255 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:03.547697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 546/1084] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:16:04.373582 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf6f34-0a7d-4b05-8c18-b5726effc361 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:04.374099 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf6f34-0a7d-4b05-8c18-b5726effc361 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:04.374099 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf6f34-0a7d-4b05-8c18-b5726effc361 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:04.375598 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 539/1085] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:16:04.380772 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb03e5-84e8-4e9d-b978-c470437496c7 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:04.381234 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb03e5-84e8-4e9d-b978-c470437496c7 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:04.381496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb03e5-84e8-4e9d-b978-c470437496c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:04.400003 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d9bb03e5-84e8-4e9d-b978-c470437496c7 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:16:04.401228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d9bb03e5-84e8-4e9d-b978-c470437496c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:16:04.447815 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:04.468218 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 547/1086] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:16:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:16:04.740202 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf6f34-0a7d-4b05-8c18-b5726effc361 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:04.770071 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:04.856855 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf6f34-0a7d-4b05-8c18-b5726effc361 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:04.892876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ca43f-59d2-4695-bde0-d07d22354caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:04.893550 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ca43f-59d2-4695-bde0-d07d22354caf None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:04.893843 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ca43f-59d2-4695-bde0-d07d22354caf None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:04.894115 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ca43f-59d2-4695-bde0-d07d22354caf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:04.907259 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ca43f-59d2-4695-bde0-d07d22354caf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:16:04.911961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-5e7ca43f-59d2-4695-bde0-d07d22354caf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 14:16:04.911961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:16:04.911961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:16:04.911961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:16:04.911961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:16:04.911961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:16:04.911961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:16:04.911961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:16:04.911961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:16:04.911961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:16:04.911961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:16:04.911961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:16:04.911961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:16:04.911961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:16:04.911961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:16:04.911961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:16:04.912892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:16:04.912892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:16:04.912892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:16:04.912892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:16:04.912892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:16:04.912892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:16:04.912892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:16:04.912892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:16:04.912892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:16:04.912892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:16:04.912892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:16:04.912892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:16:04.912892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:16:04.912892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:16:04.912892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:16:04.912892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:16:04.913859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:16:04.913859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:16:04.913859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:16:04.913859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:16:04.913859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:16:04.913859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:16:04.913859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:16:04.913859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:16:04.913859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:16:04.913859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:16:04.913859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 14:16:04.913859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:16:04.914644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 540/1087] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Sep 5 14:16:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:16:04.920554 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb03e5-84e8-4e9d-b978-c470437496c7 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:05.043691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb03e5-84e8-4e9d-b978-c470437496c7 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:05.080641 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cb59e-56e9-478d-bbdf-544efe7e57aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:05.081364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cb59e-56e9-478d-bbdf-544efe7e57aa None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:05.081654 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cb59e-56e9-478d-bbdf-544efe7e57aa None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:05.082118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cb59e-56e9-478d-bbdf-544efe7e57aa None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:05.082805 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cb59e-56e9-478d-bbdf-544efe7e57aa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:05.083119 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cb59e-56e9-478d-bbdf-544efe7e57aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:05.084506 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cb59e-56e9-478d-bbdf-544efe7e57aa None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:05.095690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 548/1088] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Sep 5 14:16:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:05.101175 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ca43f-59d2-4695-bde0-d07d22354caf None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:05.211874 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:05.225500 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ca43f-59d2-4695-bde0-d07d22354caf None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:05.263840 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0448d77-fadf-4596-9780-36995f3309b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:05.264469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0448d77-fadf-4596-9780-36995f3309b6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:05.264793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0448d77-fadf-4596-9780-36995f3309b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:05.265103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0448d77-fadf-4596-9780-36995f3309b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:05.279701 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0448d77-fadf-4596-9780-36995f3309b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:05.281175 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0448d77-fadf-4596-9780-36995f3309b6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:05.298074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-c0448d77-fadf-4596-9780-36995f3309b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:16:05.298074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:16:05.298074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:16:05.298074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:16:05.298074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:16:05.298074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:16:05.298074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:16:05.298074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:16:05.298074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:16:05.298074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:16:05.298074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:16:05.298074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:16:05.298074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:16:05.298074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:16:05.298074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:16:05.298074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:16:05.299073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:16:05.299073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:16:05.299073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:16:05.299073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:16:05.299073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:16:05.299073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:16:05.299073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:16:05.299073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:16:05.299073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:16:05.299073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:16:05.299073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:16:05.299073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:16:05.299073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:16:05.299073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:16:05.299073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:16:05.299073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:16:05.299073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:16:05.299981 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:16:05.299981 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:16:05.299981 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:16:05.299981 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 541/1089] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:16:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:16:05.307449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cb59e-56e9-478d-bbdf-544efe7e57aa None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:05.359890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:05.423932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cb59e-56e9-478d-bbdf-544efe7e57aa None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:05.463801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3729c0d-54d5-4a58-a4ee-bfb55ffdd6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:05.464409 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3729c0d-54d5-4a58-a4ee-bfb55ffdd6ac None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:05.464690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3729c0d-54d5-4a58-a4ee-bfb55ffdd6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:05.464965 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3729c0d-54d5-4a58-a4ee-bfb55ffdd6ac None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:05.465653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3729c0d-54d5-4a58-a4ee-bfb55ffdd6ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:05.465960 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3729c0d-54d5-4a58-a4ee-bfb55ffdd6ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:05.469341 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3729c0d-54d5-4a58-a4ee-bfb55ffdd6ac None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:05.483706 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 549/1090] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:05.489493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0448d77-fadf-4596-9780-36995f3309b6 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:05.581533 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc753ab-f88a-40e0-b36e-8fe987fac392 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:05.581718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc753ab-f88a-40e0-b36e-8fe987fac392 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:05.581977 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc753ab-f88a-40e0-b36e-8fe987fac392 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:05.583295 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 550/1091] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:16:05.589576 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369425ae-5b01-48e6-99d0-e89f41a00c27 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:05.589853 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369425ae-5b01-48e6-99d0-e89f41a00c27 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:05.590125 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369425ae-5b01-48e6-99d0-e89f41a00c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:05.598783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0448d77-fadf-4596-9780-36995f3309b6 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:05.610380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-369425ae-5b01-48e6-99d0-e89f41a00c27 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:16:05.611593 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-369425ae-5b01-48e6-99d0-e89f41a00c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:16:05.639710 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41320d71-fd05-4e46-aece-7e58d5b0fca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:05.640691 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41320d71-fd05-4e46-aece-7e58d5b0fca8 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:05.641181 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41320d71-fd05-4e46-aece-7e58d5b0fca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:05.641637 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41320d71-fd05-4e46-aece-7e58d5b0fca8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:05.652824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41320d71-fd05-4e46-aece-7e58d5b0fca8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:05.654631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41320d71-fd05-4e46-aece-7e58d5b0fca8 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:05.657758 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:05.670307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-41320d71-fd05-4e46-aece-7e58d5b0fca8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 14:16:05.670307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:16:05.670307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:16:05.670307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:16:05.670307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:16:05.670307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:16:05.670307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:16:05.670307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:16:05.670307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:16:05.670307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:16:05.670307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:16:05.670307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:16:05.670307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:16:05.670307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:16:05.670307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:16:05.670307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:16:05.671583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:16:05.671583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:16:05.671583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:16:05.671583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:16:05.671583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:16:05.671583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:16:05.671583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:16:05.671583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:16:05.671583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:16:05.671583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:16:05.671583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:16:05.671583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:16:05.671583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:16:05.671583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:16:05.671583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:16:05.671583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:16:05.671583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:16:05.671583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:16:05.672584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:16:05.672584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:16:05.672584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:16:05.672584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:16:05.672584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:16:05.672584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:16:05.672584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:16:05.672584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:16:05.672584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 14:16:05.672584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:16:05.672584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 542/1092] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Sep 5 14:16:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:16:05.678017 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41320d71-fd05-4e46-aece-7e58d5b0fca8 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:05.694624 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 551/1093] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:16:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 14:16:05.793879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41320d71-fd05-4e46-aece-7e58d5b0fca8 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:05.832623 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415f825-cc51-4ee3-8688-20d9f85210b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:05.833168 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415f825-cc51-4ee3-8688-20d9f85210b4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:05.833447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415f825-cc51-4ee3-8688-20d9f85210b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:05.833716 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415f825-cc51-4ee3-8688-20d9f85210b4 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:05.834434 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415f825-cc51-4ee3-8688-20d9f85210b4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:05.834738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415f825-cc51-4ee3-8688-20d9f85210b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:05.836338 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415f825-cc51-4ee3-8688-20d9f85210b4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:05.853619 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 543/1094] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Sep 5 14:16:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:16:05.859302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369425ae-5b01-48e6-99d0-e89f41a00c27 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:05.892759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:05.959020 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369425ae-5b01-48e6-99d0-e89f41a00c27 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:05.982303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415f825-cc51-4ee3-8688-20d9f85210b4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:05.993449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5baee8-97ed-4a5f-8c47-5b248d65074b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:05.994062 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5baee8-97ed-4a5f-8c47-5b248d65074b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:05.994345 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5baee8-97ed-4a5f-8c47-5b248d65074b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:05.994624 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5baee8-97ed-4a5f-8c47-5b248d65074b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:06.042413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:06.062065 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5baee8-97ed-4a5f-8c47-5b248d65074b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:06.063529 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5baee8-97ed-4a5f-8c47-5b248d65074b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:06.083675 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415f825-cc51-4ee3-8688-20d9f85210b4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:06.097576 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:06.120045 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a49e95-2c75-4721-b327-055dd6d18e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:06.120673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a49e95-2c75-4721-b327-055dd6d18e16 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:06.120953 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a49e95-2c75-4721-b327-055dd6d18e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:06.121252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a49e95-2c75-4721-b327-055dd6d18e16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:06.132166 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a49e95-2c75-4721-b327-055dd6d18e16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:16:06.137542 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-78a49e95-2c75-4721-b327-055dd6d18e16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:16:06.137542 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:16:06.137542 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:16:06.137542 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:16:06.137542 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:16:06.137542 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:16:06.137542 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:16:06.137542 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:16:06.137542 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:16:06.137542 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:16:06.137542 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:16:06.137542 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:16:06.137542 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:16:06.137542 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:16:06.137542 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:16:06.137542 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:16:06.138504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:16:06.138504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:16:06.138504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:16:06.138504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:16:06.138504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:16:06.138504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:16:06.138504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:16:06.138504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:16:06.138504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:16:06.138504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:16:06.138504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:16:06.138504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:16:06.138504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:16:06.138504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:16:06.138504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:16:06.138504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:16:06.139555 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:16:06.139555 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:16:06.139555 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:16:06.139555 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:16:06.139555 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:16:06.139555 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:16:06.139555 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:16:06.139555 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:16:06.139555 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:16:06.139555 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:16:06.139555 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:16:06.139555 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:16:06.139555 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 544/1095] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:16:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:16:06.144622 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a49e95-2c75-4721-b327-055dd6d18e16 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:06.165114 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 552/1096] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:16:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 14:16:06.170892 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5baee8-97ed-4a5f-8c47-5b248d65074b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:06.246352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a49e95-2c75-4721-b327-055dd6d18e16 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:06.263666 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:06.271354 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5baee8-97ed-4a5f-8c47-5b248d65074b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:06.280365 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90791d3-1d34-44cd-87e4-652f484bbaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:06.280972 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90791d3-1d34-44cd-87e4-652f484bbaeb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:06.281285 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90791d3-1d34-44cd-87e4-652f484bbaeb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:06.281562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90791d3-1d34-44cd-87e4-652f484bbaeb None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:06.282229 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90791d3-1d34-44cd-87e4-652f484bbaeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:06.282535 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90791d3-1d34-44cd-87e4-652f484bbaeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:06.283900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90791d3-1d34-44cd-87e4-652f484bbaeb None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:06.292908 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 545/1097] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:16:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:16:06.298560 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90791d3-1d34-44cd-87e4-652f484bbaeb None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:06.306305 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e822f3-6267-4315-89ee-0f5ac2070b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:06.306927 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e822f3-6267-4315-89ee-0f5ac2070b37 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:06.307203 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e822f3-6267-4315-89ee-0f5ac2070b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:06.307471 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e822f3-6267-4315-89ee-0f5ac2070b37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:06.309368 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:06.318292 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e822f3-6267-4315-89ee-0f5ac2070b37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:06.319856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e822f3-6267-4315-89ee-0f5ac2070b37 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:06.333491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-92e822f3-6267-4315-89ee-0f5ac2070b37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:16:06.333491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:16:06.333491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:16:06.333491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:16:06.333491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:16:06.333491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:16:06.333491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:16:06.333491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:16:06.333491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:16:06.333491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:16:06.333491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:16:06.333491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:16:06.333491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:16:06.333491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:16:06.333491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:16:06.333491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:16:06.334526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:16:06.334526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:16:06.334526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:16:06.334526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:16:06.334526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:16:06.334526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:16:06.334526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:16:06.334526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:16:06.334526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:16:06.334526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:16:06.334526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:16:06.334526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:16:06.334526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:16:06.334526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:16:06.334526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:16:06.334526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:16:06.334526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:16:06.335570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:16:06.335570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:16:06.335570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:16:06.335570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 553/1098] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:16:06.340369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e822f3-6267-4315-89ee-0f5ac2070b37 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:06.396637 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90791d3-1d34-44cd-87e4-652f484bbaeb None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:06.432385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fa4ff-75a0-4866-80fe-8f1c5a264ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:06.433011 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fa4ff-75a0-4866-80fe-8f1c5a264ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:06.433320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fa4ff-75a0-4866-80fe-8f1c5a264ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:06.433589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fa4ff-75a0-4866-80fe-8f1c5a264ab4 None admin] PATH_INFO: `/v3/users/8cbf44c561884fb6b546b9951205b710` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:06.434720 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fa4ff-75a0-4866-80fe-8f1c5a264ab4 None admin] RBAC: Authorizing `identity:get_user(user_id=8cbf44c561884fb6b546b9951205b710)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:06.436141 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fa4ff-75a0-4866-80fe-8f1c5a264ab4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:06.437740 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 546/1099] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:16:06 2022] GET /identity/v3/users/8cbf44c561884fb6b546b9951205b710 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:06.443255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e822f3-6267-4315-89ee-0f5ac2070b37 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:06.443700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fa4ff-75a0-4866-80fe-8f1c5a264ab4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:06.478062 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba25ac1-53da-4e56-969a-843913bc2bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:06.478665 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba25ac1-53da-4e56-969a-843913bc2bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:06.478945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba25ac1-53da-4e56-969a-843913bc2bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:06.479226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba25ac1-53da-4e56-969a-843913bc2bb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:06.479863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba25ac1-53da-4e56-969a-843913bc2bb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:06.480168 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba25ac1-53da-4e56-969a-843913bc2bb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:06.481582 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba25ac1-53da-4e56-969a-843913bc2bb6 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:06.492570 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:06.494320 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 554/1100] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:16:06.499495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba25ac1-53da-4e56-969a-843913bc2bb6 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:06.543477 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fa4ff-75a0-4866-80fe-8f1c5a264ab4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:06.548453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:06.577256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430c66e-4b30-4dda-839a-ce86616bdb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:06.577862 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430c66e-4b30-4dda-839a-ce86616bdb47 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:06.578137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430c66e-4b30-4dda-839a-ce86616bdb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:06.578405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430c66e-4b30-4dda-839a-ce86616bdb47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:06.604154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba25ac1-53da-4e56-969a-843913bc2bb6 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:06.637959 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb5688-d274-4a23-ae2e-3790aa3e4e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:06.638588 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb5688-d274-4a23-ae2e-3790aa3e4e8d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:06.638877 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb5688-d274-4a23-ae2e-3790aa3e4e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:06.639153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb5688-d274-4a23-ae2e-3790aa3e4e8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:06.645788 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb5688-d274-4a23-ae2e-3790aa3e4e8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:06.647248 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb5688-d274-4a23-ae2e-3790aa3e4e8d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:06.647365 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430c66e-4b30-4dda-839a-ce86616bdb47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:06.649373 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430c66e-4b30-4dda-839a-ce86616bdb47 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:06.659066 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-a4fb5688-d274-4a23-ae2e-3790aa3e4e8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:16:06.659066 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:16:06.659066 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:16:06.659066 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:16:06.659066 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:16:06.659066 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:16:06.659066 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:16:06.659066 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:16:06.659066 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:16:06.659066 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:16:06.659066 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:16:06.659066 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:16:06.659066 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:16:06.659066 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:16:06.659066 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:16:06.660035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:16:06.660035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:16:06.660035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:16:06.660035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:16:06.660035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:16:06.660035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:16:06.660035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:16:06.660035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:16:06.660035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:16:06.660035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:16:06.660035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:16:06.660035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:16:06.660035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:16:06.660035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:16:06.660035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:16:06.660035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:16:06.660035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:16:06.661411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:16:06.661411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:16:06.661411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:16:06.661411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:16:06.661411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:16:06.661411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:16:06.661411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:16:06.661411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:16:06.661411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 555/1101] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:16:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:16:06.666965 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb5688-d274-4a23-ae2e-3790aa3e4e8d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:06.700022 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:06.751738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 547/1102] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:16:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 14:16:06.757763 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430c66e-4b30-4dda-839a-ce86616bdb47 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:06.765644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb5688-d274-4a23-ae2e-3790aa3e4e8d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:06.773598 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:06.809159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfefd9-1f94-411a-9cb6-62ec2ddb8d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:06.809769 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfefd9-1f94-411a-9cb6-62ec2ddb8d42 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:06.810046 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfefd9-1f94-411a-9cb6-62ec2ddb8d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:06.810315 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfefd9-1f94-411a-9cb6-62ec2ddb8d42 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:06.811020 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfefd9-1f94-411a-9cb6-62ec2ddb8d42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:06.811326 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfefd9-1f94-411a-9cb6-62ec2ddb8d42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:06.812763 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfefd9-1f94-411a-9cb6-62ec2ddb8d42 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:06.824895 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 556/1103] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:16:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:06.830859 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfefd9-1f94-411a-9cb6-62ec2ddb8d42 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:06.863305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430c66e-4b30-4dda-839a-ce86616bdb47 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:06.897339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a838e-a09f-4e0f-9094-1ed304ca4650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:06.898507 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a838e-a09f-4e0f-9094-1ed304ca4650 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:06.898792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a838e-a09f-4e0f-9094-1ed304ca4650 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:06.899061 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a838e-a09f-4e0f-9094-1ed304ca4650 None admin] PATH_INFO: `/v3/projects/6924c4e125a84486963fbedaa25eba86` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:06.900178 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a838e-a09f-4e0f-9094-1ed304ca4650 None admin] RBAC: Authorizing `identity:get_project(project_id=6924c4e125a84486963fbedaa25eba86)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:06.901639 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a838e-a09f-4e0f-9094-1ed304ca4650 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:06.903258 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 548/1104] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:16:06 2022] GET /identity/v3/projects/6924c4e125a84486963fbedaa25eba86 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:16:06.909317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a838e-a09f-4e0f-9094-1ed304ca4650 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:06.928145 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:06.932074 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfefd9-1f94-411a-9cb6-62ec2ddb8d42 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:06.968115 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95932903-76c9-4832-9d2e-bb72b5d0dda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:06.968728 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95932903-76c9-4832-9d2e-bb72b5d0dda8 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:06.969040 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95932903-76c9-4832-9d2e-bb72b5d0dda8 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:06.969361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95932903-76c9-4832-9d2e-bb72b5d0dda8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:06.970090 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95932903-76c9-4832-9d2e-bb72b5d0dda8 None admin] RBAC: Adding query filter params (role.id=599c4ddaf84948b2822c11b41782ebe2, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=d5515accf3b64006bc41422265a641bc) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:06.970400 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95932903-76c9-4832-9d2e-bb72b5d0dda8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:06.971848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95932903-76c9-4832-9d2e-bb72b5d0dda8 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:06.978703 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 557/1105] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:16:06 2022] GET /identity/v3/role_assignments?user.id=d5515accf3b64006bc41422265a641bc&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=599c4ddaf84948b2822c11b41782ebe2 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:16:07.011060 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a838e-a09f-4e0f-9094-1ed304ca4650 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:07.047345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b0850-b033-4b24-9782-4e7b968d2b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:07.047959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b0850-b033-4b24-9782-4e7b968d2b16 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:07.048234 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b0850-b033-4b24-9782-4e7b968d2b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:07.048504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b0850-b033-4b24-9782-4e7b968d2b16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:07.049263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b0850-b033-4b24-9782-4e7b968d2b16 None admin] RBAC: Adding query filter params (role.id=f22e6e660eab44c5be25e3dee1e3042c, scope.project.id=6924c4e125a84486963fbedaa25eba86, user.id=8cbf44c561884fb6b546b9951205b710) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:07.049569 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b0850-b033-4b24-9782-4e7b968d2b16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:07.051265 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b0850-b033-4b24-9782-4e7b968d2b16 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:07.057840 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 549/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:16:06 2022] GET /identity/v3/role_assignments?user.id=8cbf44c561884fb6b546b9951205b710&scope.project.id=6924c4e125a84486963fbedaa25eba86&role.id=f22e6e660eab44c5be25e3dee1e3042c => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:16:09.011112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f4cae-6b57-4e30-88c1-57a160e049f3 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:09.011683 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f4cae-6b57-4e30-88c1-57a160e049f3 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:09.011683 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f4cae-6b57-4e30-88c1-57a160e049f3 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:09.012982 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 558/1107] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:16:09.018032 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82850b-80f6-411e-8415-1fe314e4bf87 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:09.018422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82850b-80f6-411e-8415-1fe314e4bf87 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:09.018586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82850b-80f6-411e-8415-1fe314e4bf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:09.036874 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ce82850b-80f6-411e-8415-1fe314e4bf87 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:16:09.038100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ce82850b-80f6-411e-8415-1fe314e4bf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:16:09.102922 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 550/1108] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:16:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:16:09.372852 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f4cae-6b57-4e30-88c1-57a160e049f3 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:09.404555 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:09.477331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f4cae-6b57-4e30-88c1-57a160e049f3 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:09.511226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8e09c-e1c1-4a20-bd07-2846a6e24608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:09.511848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8e09c-e1c1-4a20-bd07-2846a6e24608 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:09.512192 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8e09c-e1c1-4a20-bd07-2846a6e24608 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:09.512478 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8e09c-e1c1-4a20-bd07-2846a6e24608 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:09.513617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8e09c-e1c1-4a20-bd07-2846a6e24608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:09.515058 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8e09c-e1c1-4a20-bd07-2846a6e24608 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:09.516593 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 559/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:16:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:09.522254 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82850b-80f6-411e-8415-1fe314e4bf87 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:09.534517 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:09.619589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82850b-80f6-411e-8415-1fe314e4bf87 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:09.653127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c35577-7260-4c83-9c85-3336a0eb6414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:09.653676 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c35577-7260-4c83-9c85-3336a0eb6414 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:09.653949 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c35577-7260-4c83-9c85-3336a0eb6414 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:09.654215 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c35577-7260-4c83-9c85-3336a0eb6414 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:09.654877 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c35577-7260-4c83-9c85-3336a0eb6414 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:09.656364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c35577-7260-4c83-9c85-3336a0eb6414 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:09.779866 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 551/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 5 14:16:09 2022] POST /identity/v3/users => generated 286 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:16:11.723665 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a83de-09f9-4c52-b30b-f2fff5b5b973 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:11.724191 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a83de-09f9-4c52-b30b-f2fff5b5b973 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:11.724191 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a83de-09f9-4c52-b30b-f2fff5b5b973 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:11.726640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 560/1111] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:16:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:16:11.731297 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fa564-492e-4179-b0f2-d36bfe523155 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:11.731690 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fa564-492e-4179-b0f2-d36bfe523155 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:11.731851 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fa564-492e-4179-b0f2-d36bfe523155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:11.750894 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-858fa564-492e-4179-b0f2-d36bfe523155 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:16:11.752062 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-858fa564-492e-4179-b0f2-d36bfe523155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:16:11.810531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:11.817693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 552/1112] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:16:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:16:12.086017 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a83de-09f9-4c52-b30b-f2fff5b5b973 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:12.182939 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:12.187540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a83de-09f9-4c52-b30b-f2fff5b5b973 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:12.222768 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abe727-4c93-4f7f-9648-0f9b3fe5197f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:12.223388 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abe727-4c93-4f7f-9648-0f9b3fe5197f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:12.223666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abe727-4c93-4f7f-9648-0f9b3fe5197f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:12.223936 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abe727-4c93-4f7f-9648-0f9b3fe5197f None admin] PATH_INFO: `/v3/roles/a1ffbcf6f60f4aea99c7eb1dbcb34582` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:12.225346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abe727-4c93-4f7f-9648-0f9b3fe5197f None admin] RBAC: Authorizing `identity:get_role(role_id=a1ffbcf6f60f4aea99c7eb1dbcb34582)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:12.227818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abe727-4c93-4f7f-9648-0f9b3fe5197f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:12.229141 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 561/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:16:12 2022] GET /identity/v3/roles/a1ffbcf6f60f4aea99c7eb1dbcb34582 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:12.234946 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fa564-492e-4179-b0f2-d36bfe523155 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:12.330287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fa564-492e-4179-b0f2-d36bfe523155 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:12.363939 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561b831-8ecb-492a-8e98-f285b4133263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:12.364492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561b831-8ecb-492a-8e98-f285b4133263 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:12.364769 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561b831-8ecb-492a-8e98-f285b4133263 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:12.365037 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561b831-8ecb-492a-8e98-f285b4133263 None admin] PATH_INFO: `/v3/users/489fa39ac89945528243afca8722eb90` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:12.378006 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561b831-8ecb-492a-8e98-f285b4133263 None admin] RBAC: Authorizing `identity:get_user(user_id=489fa39ac89945528243afca8722eb90)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:12.379433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561b831-8ecb-492a-8e98-f285b4133263 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:12.381017 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 553/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:16:12 2022] GET /identity/v3/users/489fa39ac89945528243afca8722eb90 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:12.387966 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abe727-4c93-4f7f-9648-0f9b3fe5197f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:12.487699 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abe727-4c93-4f7f-9648-0f9b3fe5197f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:12.523083 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36f97c-497a-4d62-aa82-9c7ba98434ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:12.523683 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36f97c-497a-4d62-aa82-9c7ba98434ec None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:12.523951 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36f97c-497a-4d62-aa82-9c7ba98434ec None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:12.524224 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36f97c-497a-4d62-aa82-9c7ba98434ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:12.557809 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:12.591129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36f97c-497a-4d62-aa82-9c7ba98434ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:12.592566 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36f97c-497a-4d62-aa82-9c7ba98434ec None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:12.691328 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 562/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:16:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 14:16:12.697913 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561b831-8ecb-492a-8e98-f285b4133263 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:12.752120 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:12.795035 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561b831-8ecb-492a-8e98-f285b4133263 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:12.832248 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722f3b6-55d1-4ffe-b114-15cd587e1d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:12.832888 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722f3b6-55d1-4ffe-b114-15cd587e1d3b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:12.833199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722f3b6-55d1-4ffe-b114-15cd587e1d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:12.833615 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722f3b6-55d1-4ffe-b114-15cd587e1d3b None admin] PATH_INFO: `/v3/projects/6924c4e125a84486963fbedaa25eba86` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:12.834772 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722f3b6-55d1-4ffe-b114-15cd587e1d3b None admin] RBAC: Authorizing `identity:get_project(project_id=6924c4e125a84486963fbedaa25eba86)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:12.836230 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722f3b6-55d1-4ffe-b114-15cd587e1d3b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:12.837874 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 554/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:16:12 2022] GET /identity/v3/projects/6924c4e125a84486963fbedaa25eba86 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:12.844047 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36f97c-497a-4d62-aa82-9c7ba98434ec None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:12.906948 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:12.939842 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36f97c-497a-4d62-aa82-9c7ba98434ec None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:12.972442 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316bf99-a8b8-4231-9a6a-1d58e4bf8380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:12.972974 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316bf99-a8b8-4231-9a6a-1d58e4bf8380 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:12.973274 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316bf99-a8b8-4231-9a6a-1d58e4bf8380 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:12.973542 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316bf99-a8b8-4231-9a6a-1d58e4bf8380 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:12.974251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316bf99-a8b8-4231-9a6a-1d58e4bf8380 None admin] RBAC: Adding query filter params (role.id=a1ffbcf6f60f4aea99c7eb1dbcb34582, scope.project.id=6924c4e125a84486963fbedaa25eba86, user.id=489fa39ac89945528243afca8722eb90) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:12.974551 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316bf99-a8b8-4231-9a6a-1d58e4bf8380 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:12.975992 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316bf99-a8b8-4231-9a6a-1d58e4bf8380 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:12.981112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 563/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:16:12 2022] GET /identity/v3/role_assignments?user.id=489fa39ac89945528243afca8722eb90&scope.project.id=6924c4e125a84486963fbedaa25eba86&role.id=a1ffbcf6f60f4aea99c7eb1dbcb34582 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:14.870359 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faeeff-b34a-4c25-bdfb-bb06e20e802e None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:14.870915 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faeeff-b34a-4c25-bdfb-bb06e20e802e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:14.870915 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faeeff-b34a-4c25-bdfb-bb06e20e802e None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:14.872216 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 555/1118] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:16:14.877259 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf28a21-d3c7-4668-8859-0c1ec79fe4c9 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:14.877683 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf28a21-d3c7-4668-8859-0c1ec79fe4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:14.877829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf28a21-d3c7-4668-8859-0c1ec79fe4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:14.896141 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-faf28a21-d3c7-4668-8859-0c1ec79fe4c9 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:16:14.897377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-faf28a21-d3c7-4668-8859-0c1ec79fe4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:16:14.961760 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 564/1119] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:16:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:16:15.231285 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4faeeff-b34a-4c25-bdfb-bb06e20e802e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:15.331706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4faeeff-b34a-4c25-bdfb-bb06e20e802e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:15.353943 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:15.365043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e14b2b-695d-4470-bc85-475073df4b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:15.368260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e14b2b-695d-4470-bc85-475073df4b9b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:15.368260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e14b2b-695d-4470-bc85-475073df4b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:15.368260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e14b2b-695d-4470-bc85-475073df4b9b None admin] PATH_INFO: `/v3/roles/a1ffbcf6f60f4aea99c7eb1dbcb34582` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:15.368520 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e14b2b-695d-4470-bc85-475073df4b9b None admin] RBAC: Authorizing `identity:get_role(role_id=a1ffbcf6f60f4aea99c7eb1dbcb34582)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:15.369704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e14b2b-695d-4470-bc85-475073df4b9b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:15.371044 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 556/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:16:15 2022] GET /identity/v3/roles/a1ffbcf6f60f4aea99c7eb1dbcb34582 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:15.377021 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf28a21-d3c7-4668-8859-0c1ec79fe4c9 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:15.434705 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:15.476743 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf28a21-d3c7-4668-8859-0c1ec79fe4c9 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:15.510056 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d74498-2662-4d62-8d09-f974e62005a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:15.510675 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d74498-2662-4d62-8d09-f974e62005a2 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:15.510952 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d74498-2662-4d62-8d09-f974e62005a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:15.511255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d74498-2662-4d62-8d09-f974e62005a2 None admin] PATH_INFO: `/v3/users/489fa39ac89945528243afca8722eb90` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:15.512374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d74498-2662-4d62-8d09-f974e62005a2 None admin] RBAC: Authorizing `identity:get_user(user_id=489fa39ac89945528243afca8722eb90)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:15.513951 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d74498-2662-4d62-8d09-f974e62005a2 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:15.515562 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 565/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:16:15 2022] GET /identity/v3/users/489fa39ac89945528243afca8722eb90 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:15.521445 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e14b2b-695d-4470-bc85-475073df4b9b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:15.620496 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e14b2b-695d-4470-bc85-475073df4b9b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:15.653203 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a1f60-e2b0-484b-b2cd-6e13a73d49cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:15.653814 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a1f60-e2b0-484b-b2cd-6e13a73d49cf None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:15.654092 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a1f60-e2b0-484b-b2cd-6e13a73d49cf None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:15.654363 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a1f60-e2b0-484b-b2cd-6e13a73d49cf None admin] PATH_INFO: `/v3/projects/6924c4e125a84486963fbedaa25eba86` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:15.655460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a1f60-e2b0-484b-b2cd-6e13a73d49cf None admin] RBAC: Authorizing `identity:get_project(project_id=6924c4e125a84486963fbedaa25eba86)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:15.656878 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a1f60-e2b0-484b-b2cd-6e13a73d49cf None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:15.658495 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 557/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:16:15 2022] GET /identity/v3/projects/6924c4e125a84486963fbedaa25eba86 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:15.664423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d74498-2662-4d62-8d09-f974e62005a2 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:15.762353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d74498-2662-4d62-8d09-f974e62005a2 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:15.787431 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:15.795126 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fbb1d-564f-4f51-949f-32ad7bdeefe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:15.795766 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fbb1d-564f-4f51-949f-32ad7bdeefe4 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:15.796043 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fbb1d-564f-4f51-949f-32ad7bdeefe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:15.796315 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fbb1d-564f-4f51-949f-32ad7bdeefe4 None admin] PATH_INFO: `/v3/projects/6924c4e125a84486963fbedaa25eba86/users/489fa39ac89945528243afca8722eb90/roles/a1ffbcf6f60f4aea99c7eb1dbcb34582` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:15.798448 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fbb1d-564f-4f51-949f-32ad7bdeefe4 None admin] RBAC: Authorizing `identity:create_grant(project_id=6924c4e125a84486963fbedaa25eba86, user_id=489fa39ac89945528243afca8722eb90, role_id=a1ffbcf6f60f4aea99c7eb1dbcb34582)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:15.804301 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fbb1d-564f-4f51-949f-32ad7bdeefe4 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:15.872741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 566/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:16:15 2022] PUT /identity/v3/projects/6924c4e125a84486963fbedaa25eba86/users/489fa39ac89945528243afca8722eb90/roles/a1ffbcf6f60f4aea99c7eb1dbcb34582 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:16:17.801049 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f46074-cc40-4237-a0a3-687ef38353f7 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:17.801622 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f46074-cc40-4237-a0a3-687ef38353f7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:17.801622 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f46074-cc40-4237-a0a3-687ef38353f7 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:17.802937 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 558/1124] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:16:17.809035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a237e2-4067-4cc3-8d6f-b28fe6eca8f9 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:17.809444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a237e2-4067-4cc3-8d6f-b28fe6eca8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:17.809618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a237e2-4067-4cc3-8d6f-b28fe6eca8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:17.827479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-82a237e2-4067-4cc3-8d6f-b28fe6eca8f9 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:16:17.828666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-82a237e2-4067-4cc3-8d6f-b28fe6eca8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:16:17.893689 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 567/1125] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:16:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:16:18.157187 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f46074-cc40-4237-a0a3-687ef38353f7 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:18.216443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:18.258691 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f46074-cc40-4237-a0a3-687ef38353f7 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:18.291113 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da7c68-f67e-4726-9ff7-0f4e81ead01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:18.291731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da7c68-f67e-4726-9ff7-0f4e81ead01e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:18.292009 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da7c68-f67e-4726-9ff7-0f4e81ead01e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:18.292278 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da7c68-f67e-4726-9ff7-0f4e81ead01e None admin] PATH_INFO: `/v3/roles/a1ffbcf6f60f4aea99c7eb1dbcb34582` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:18.293679 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da7c68-f67e-4726-9ff7-0f4e81ead01e None admin] RBAC: Authorizing `identity:get_role(role_id=a1ffbcf6f60f4aea99c7eb1dbcb34582)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:18.295025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da7c68-f67e-4726-9ff7-0f4e81ead01e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:18.296331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 559/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:16:18 2022] GET /identity/v3/roles/a1ffbcf6f60f4aea99c7eb1dbcb34582 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:18.302378 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a237e2-4067-4cc3-8d6f-b28fe6eca8f9 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:18.397148 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a237e2-4067-4cc3-8d6f-b28fe6eca8f9 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:18.414314 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:18.431129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30118cef-d324-42b1-ba3e-1f4491a28186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:18.431753 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30118cef-d324-42b1-ba3e-1f4491a28186 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:18.432025 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30118cef-d324-42b1-ba3e-1f4491a28186 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:18.432289 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30118cef-d324-42b1-ba3e-1f4491a28186 None admin] PATH_INFO: `/v3/users/489fa39ac89945528243afca8722eb90` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:18.433427 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30118cef-d324-42b1-ba3e-1f4491a28186 None admin] RBAC: Authorizing `identity:get_user(user_id=489fa39ac89945528243afca8722eb90)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:18.434849 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30118cef-d324-42b1-ba3e-1f4491a28186 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:18.436387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 568/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:16:18 2022] GET /identity/v3/users/489fa39ac89945528243afca8722eb90 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:18.441977 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da7c68-f67e-4726-9ff7-0f4e81ead01e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:18.538231 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da7c68-f67e-4726-9ff7-0f4e81ead01e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:18.562772 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:18.571226 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395bdb7-5517-48ac-b299-8fb5fb790794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:18.571865 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395bdb7-5517-48ac-b299-8fb5fb790794 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:18.572139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395bdb7-5517-48ac-b299-8fb5fb790794 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:18.572404 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395bdb7-5517-48ac-b299-8fb5fb790794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:18.636236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395bdb7-5517-48ac-b299-8fb5fb790794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:18.637679 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395bdb7-5517-48ac-b299-8fb5fb790794 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:18.731913 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 560/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:16:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 14:16:18.737852 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30118cef-d324-42b1-ba3e-1f4491a28186 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:18.835843 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30118cef-d324-42b1-ba3e-1f4491a28186 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:18.870002 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16267bb3-ed41-4942-ac98-c05d32c49095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:18.870627 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16267bb3-ed41-4942-ac98-c05d32c49095 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:18.870904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16267bb3-ed41-4942-ac98-c05d32c49095 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:18.871176 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16267bb3-ed41-4942-ac98-c05d32c49095 None admin] PATH_INFO: `/v3/projects/6924c4e125a84486963fbedaa25eba86` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:18.872280 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16267bb3-ed41-4942-ac98-c05d32c49095 None admin] RBAC: Authorizing `identity:get_project(project_id=6924c4e125a84486963fbedaa25eba86)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:18.873831 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16267bb3-ed41-4942-ac98-c05d32c49095 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:18.875446 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 569/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:16:18 2022] GET /identity/v3/projects/6924c4e125a84486963fbedaa25eba86 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:18.882305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395bdb7-5517-48ac-b299-8fb5fb790794 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:18.908093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:18.980047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395bdb7-5517-48ac-b299-8fb5fb790794 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:19.013807 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905618f-af0a-4171-98a0-1c07f907a574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:19.014401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905618f-af0a-4171-98a0-1c07f907a574 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:19.014673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905618f-af0a-4171-98a0-1c07f907a574 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:19.014939 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905618f-af0a-4171-98a0-1c07f907a574 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:19.015642 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905618f-af0a-4171-98a0-1c07f907a574 None admin] RBAC: Adding query filter params (role.id=a1ffbcf6f60f4aea99c7eb1dbcb34582, scope.project.id=6924c4e125a84486963fbedaa25eba86, user.id=489fa39ac89945528243afca8722eb90) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:19.015943 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905618f-af0a-4171-98a0-1c07f907a574 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:19.017386 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905618f-af0a-4171-98a0-1c07f907a574 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:19.023091 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 561/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:16:18 2022] GET /identity/v3/role_assignments?user.id=489fa39ac89945528243afca8722eb90&scope.project.id=6924c4e125a84486963fbedaa25eba86&role.id=a1ffbcf6f60f4aea99c7eb1dbcb34582 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:20.930451 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d2386-614d-4897-87d2-8cbb49e00988 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:20.930978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d2386-614d-4897-87d2-8cbb49e00988 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:20.930978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d2386-614d-4897-87d2-8cbb49e00988 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:20.932304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 570/1131] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:16:20.937322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede732f-6c7f-4c63-8895-ed6925039047 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:20.937689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede732f-6c7f-4c63-8895-ed6925039047 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:20.937861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede732f-6c7f-4c63-8895-ed6925039047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:20.955662 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7ede732f-6c7f-4c63-8895-ed6925039047 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:16:20.956822 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7ede732f-6c7f-4c63-8895-ed6925039047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:16:21.020301 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 562/1132] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:16:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:16:21.293352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d2386-614d-4897-87d2-8cbb49e00988 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:21.349042 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:21.392238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d2386-614d-4897-87d2-8cbb49e00988 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:21.425372 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f84769-bf3e-4a90-86d4-e2f23c56b425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:21.426244 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f84769-bf3e-4a90-86d4-e2f23c56b425 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:21.426520 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f84769-bf3e-4a90-86d4-e2f23c56b425 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:21.426791 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f84769-bf3e-4a90-86d4-e2f23c56b425 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:21.427918 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f84769-bf3e-4a90-86d4-e2f23c56b425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:21.429728 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f84769-bf3e-4a90-86d4-e2f23c56b425 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:21.438083 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 571/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:16:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:21.438193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede732f-6c7f-4c63-8895-ed6925039047 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:21.457796 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:21.534272 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede732f-6c7f-4c63-8895-ed6925039047 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:21.567003 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4a8cd-c123-407a-986c-d1934132e8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:21.567598 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4a8cd-c123-407a-986c-d1934132e8d1 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:21.567872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4a8cd-c123-407a-986c-d1934132e8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:21.568137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4a8cd-c123-407a-986c-d1934132e8d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:21.568771 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4a8cd-c123-407a-986c-d1934132e8d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:21.570809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4a8cd-c123-407a-986c-d1934132e8d1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:21.669176 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 563/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 5 14:16:21 2022] POST /identity/v3/projects => generated 311 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:16:23.585223 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bdf1f-019c-40de-bdce-1e05ca909964 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:23.585780 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bdf1f-019c-40de-bdce-1e05ca909964 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:23.585780 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bdf1f-019c-40de-bdce-1e05ca909964 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:23.587061 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 572/1135] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:16:23.592123 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cec4a8-db89-4273-899b-92f962a4300d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:23.592509 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cec4a8-db89-4273-899b-92f962a4300d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:23.592686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cec4a8-db89-4273-899b-92f962a4300d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:23.610996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-57cec4a8-db89-4273-899b-92f962a4300d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:16:23.612182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-57cec4a8-db89-4273-899b-92f962a4300d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:16:23.677711 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 564/1136] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:16:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:16:23.950074 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bdf1f-019c-40de-bdce-1e05ca909964 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:24.049984 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bdf1f-019c-40de-bdce-1e05ca909964 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:24.072939 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:24.083952 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b57d9b-0b26-4122-a854-f3a9dddacad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:24.085282 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b57d9b-0b26-4122-a854-f3a9dddacad1 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:24.085772 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b57d9b-0b26-4122-a854-f3a9dddacad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:24.086052 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b57d9b-0b26-4122-a854-f3a9dddacad1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:24.087174 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b57d9b-0b26-4122-a854-f3a9dddacad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:24.088600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b57d9b-0b26-4122-a854-f3a9dddacad1 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:24.090160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 573/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:16:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:24.095832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cec4a8-db89-4273-899b-92f962a4300d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:24.098212 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:24.194386 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cec4a8-db89-4273-899b-92f962a4300d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:24.228256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59714a-ad03-4647-98d2-7a17a7af03d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:24.228791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59714a-ad03-4647-98d2-7a17a7af03d8 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:24.229089 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59714a-ad03-4647-98d2-7a17a7af03d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:24.229368 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59714a-ad03-4647-98d2-7a17a7af03d8 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:24.230028 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59714a-ad03-4647-98d2-7a17a7af03d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:24.231454 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59714a-ad03-4647-98d2-7a17a7af03d8 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:24.328824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 565/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 5 14:16:24 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:16:26.269970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e48cc4-5328-4277-bfb0-2ee140e1dae9 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:26.270438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e48cc4-5328-4277-bfb0-2ee140e1dae9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:26.270546 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e48cc4-5328-4277-bfb0-2ee140e1dae9 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:26.271864 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 574/1139] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:16:26.276942 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a8c09-9403-40ec-a2b3-e5dc67ea3a56 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:26.277409 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a8c09-9403-40ec-a2b3-e5dc67ea3a56 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:26.277539 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a8c09-9403-40ec-a2b3-e5dc67ea3a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:26.295850 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-615a8c09-9403-40ec-a2b3-e5dc67ea3a56 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:16:26.297018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-615a8c09-9403-40ec-a2b3-e5dc67ea3a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:16:26.350832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:26.363881 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 566/1140] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:16:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:16:26.630023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e48cc4-5328-4277-bfb0-2ee140e1dae9 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:26.738489 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e48cc4-5328-4277-bfb0-2ee140e1dae9 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:26.771575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63959f1-454e-4f79-ba89-912f3ee8824c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:26.773101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63959f1-454e-4f79-ba89-912f3ee8824c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:26.773405 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63959f1-454e-4f79-ba89-912f3ee8824c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:26.773680 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63959f1-454e-4f79-ba89-912f3ee8824c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:26.783456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63959f1-454e-4f79-ba89-912f3ee8824c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:16:26.788457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-e63959f1-454e-4f79-ba89-912f3ee8824c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:16:26.788457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:16:26.788457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:16:26.788457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:16:26.788457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:16:26.788457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:16:26.788457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:16:26.788457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:16:26.788457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:16:26.788457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:16:26.788457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:16:26.788457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:16:26.788457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:16:26.788457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:16:26.788457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:16:26.788457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:16:26.789634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:16:26.789634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:16:26.789634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:16:26.789634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:16:26.789634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:16:26.789634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:16:26.789634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:16:26.789634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:16:26.789634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:16:26.789634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:16:26.789634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:16:26.789634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:16:26.789634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:16:26.789634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:16:26.789634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:16:26.789634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:16:26.790718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:16:26.790718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:16:26.790718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:16:26.790718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:16:26.790718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:16:26.790718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:16:26.790718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:16:26.790718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:16:26.790718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:16:26.790718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:16:26.790718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:16:26.790718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:16:26.790718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 575/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:16:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:16:26.795638 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a8c09-9403-40ec-a2b3-e5dc67ea3a56 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:26.893309 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a8c09-9403-40ec-a2b3-e5dc67ea3a56 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:26.931761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fddde4-1f5d-4cee-80df-a448be768d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:26.932356 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fddde4-1f5d-4cee-80df-a448be768d20 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:26.932635 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fddde4-1f5d-4cee-80df-a448be768d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:26.932904 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fddde4-1f5d-4cee-80df-a448be768d20 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:26.933597 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fddde4-1f5d-4cee-80df-a448be768d20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:26.933898 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fddde4-1f5d-4cee-80df-a448be768d20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:26.935258 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fddde4-1f5d-4cee-80df-a448be768d20 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:26.943205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 567/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:16:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:26.949835 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63959f1-454e-4f79-ba89-912f3ee8824c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:26.998321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:27.048972 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63959f1-454e-4f79-ba89-912f3ee8824c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:27.083261 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43ea2e-21c3-4a27-bbbf-8842e6db96ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:27.083878 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43ea2e-21c3-4a27-bbbf-8842e6db96ca None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:27.084151 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43ea2e-21c3-4a27-bbbf-8842e6db96ca None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:27.084602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43ea2e-21c3-4a27-bbbf-8842e6db96ca None admin] PATH_INFO: `/v3/users/5e3f2ec486f84e32b1473e677212e01a` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:27.097148 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43ea2e-21c3-4a27-bbbf-8842e6db96ca None admin] RBAC: Authorizing `identity:get_user(user_id=5e3f2ec486f84e32b1473e677212e01a)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:27.098592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43ea2e-21c3-4a27-bbbf-8842e6db96ca None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:27.100182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 576/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:16:26 2022] GET /identity/v3/users/5e3f2ec486f84e32b1473e677212e01a => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:27.106374 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fddde4-1f5d-4cee-80df-a448be768d20 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:27.156212 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:27.206617 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fddde4-1f5d-4cee-80df-a448be768d20 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:27.239195 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84119521-41e8-4022-9e20-46f105653674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:27.239794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84119521-41e8-4022-9e20-46f105653674 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:27.240070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84119521-41e8-4022-9e20-46f105653674 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:27.240338 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84119521-41e8-4022-9e20-46f105653674 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:27.306365 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84119521-41e8-4022-9e20-46f105653674 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:27.307779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84119521-41e8-4022-9e20-46f105653674 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:27.354949 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:27.403240 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 568/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:16:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 14:16:27.409264 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43ea2e-21c3-4a27-bbbf-8842e6db96ca None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:27.506870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43ea2e-21c3-4a27-bbbf-8842e6db96ca None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:27.515713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:27.539665 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4a470-3cee-44e6-a059-04b91f4ba7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:27.540280 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4a470-3cee-44e6-a059-04b91f4ba7fa None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:27.540559 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4a470-3cee-44e6-a059-04b91f4ba7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:27.540831 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4a470-3cee-44e6-a059-04b91f4ba7fa None admin] PATH_INFO: `/v3/projects/c67130498b054c6d84e480804ed3c2be` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:27.541963 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4a470-3cee-44e6-a059-04b91f4ba7fa None admin] RBAC: Authorizing `identity:get_project(project_id=c67130498b054c6d84e480804ed3c2be)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:27.543399 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4a470-3cee-44e6-a059-04b91f4ba7fa None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:27.544990 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 577/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:16:27 2022] GET /identity/v3/projects/c67130498b054c6d84e480804ed3c2be => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:27.551262 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84119521-41e8-4022-9e20-46f105653674 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:27.647739 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84119521-41e8-4022-9e20-46f105653674 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:27.680227 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7edfcf-c328-4b82-b2aa-86a2d5c5d789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:27.680751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7edfcf-c328-4b82-b2aa-86a2d5c5d789 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:27.681025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7edfcf-c328-4b82-b2aa-86a2d5c5d789 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:27.681322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7edfcf-c328-4b82-b2aa-86a2d5c5d789 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:27.682030 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7edfcf-c328-4b82-b2aa-86a2d5c5d789 None admin] RBAC: Adding query filter params (role.id=f22e6e660eab44c5be25e3dee1e3042c, scope.project.id=c67130498b054c6d84e480804ed3c2be, user.id=5e3f2ec486f84e32b1473e677212e01a) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:27.682329 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7edfcf-c328-4b82-b2aa-86a2d5c5d789 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:27.683757 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7edfcf-c328-4b82-b2aa-86a2d5c5d789 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:27.688846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 569/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:16:27 2022] GET /identity/v3/role_assignments?user.id=5e3f2ec486f84e32b1473e677212e01a&scope.project.id=c67130498b054c6d84e480804ed3c2be&role.id=f22e6e660eab44c5be25e3dee1e3042c => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:29.557006 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce24d8-935f-4ec2-a722-2af15985c9e0 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:29.557563 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce24d8-935f-4ec2-a722-2af15985c9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:29.557563 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce24d8-935f-4ec2-a722-2af15985c9e0 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:29.558886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 578/1147] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:16:29.564022 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f89cd-96db-4331-8a4e-11642f65cbe2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:29.564432 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f89cd-96db-4331-8a4e-11642f65cbe2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:29.564565 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f89cd-96db-4331-8a4e-11642f65cbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:29.585238 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-152f89cd-96db-4331-8a4e-11642f65cbe2 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:16:29.586405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-152f89cd-96db-4331-8a4e-11642f65cbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:16:29.595255 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:29.652632 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 570/1148] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:16:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:16:29.922867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce24d8-935f-4ec2-a722-2af15985c9e0 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:30.022255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce24d8-935f-4ec2-a722-2af15985c9e0 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:30.060712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd346d4-4999-4cd0-86fa-9bc85d909923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:30.061354 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd346d4-4999-4cd0-86fa-9bc85d909923 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:30.061629 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd346d4-4999-4cd0-86fa-9bc85d909923 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:30.061897 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd346d4-4999-4cd0-86fa-9bc85d909923 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:30.072456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd346d4-4999-4cd0-86fa-9bc85d909923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:16:30.077284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-7dd346d4-4999-4cd0-86fa-9bc85d909923 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:16:30.077284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:16:30.077284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:16:30.077284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:16:30.077284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:16:30.077284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:16:30.077284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:16:30.077284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:16:30.077284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:16:30.077284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:16:30.077284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:16:30.077284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:16:30.077284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:16:30.077284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:16:30.077284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:16:30.077284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:16:30.078374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:16:30.078374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:16:30.078374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:16:30.078374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:16:30.078374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:16:30.078374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:16:30.078374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:16:30.078374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:16:30.078374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:16:30.078374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:16:30.078374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:16:30.078374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:16:30.078374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:16:30.078374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:16:30.078374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:16:30.078374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:16:30.080502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:16:30.080502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:16:30.080502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:16:30.080502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:16:30.080502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:16:30.080502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:16:30.080502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:16:30.080502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:16:30.080502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:16:30.080502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:16:30.080502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:16:30.080502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:16:30.080502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 579/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:16:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:16:30.084986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f89cd-96db-4331-8a4e-11642f65cbe2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:30.183071 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f89cd-96db-4331-8a4e-11642f65cbe2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:30.216678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e59218-0955-46b7-a407-b3e0250646c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:30.217310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e59218-0955-46b7-a407-b3e0250646c3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:30.217589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e59218-0955-46b7-a407-b3e0250646c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:30.217858 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e59218-0955-46b7-a407-b3e0250646c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:30.218506 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e59218-0955-46b7-a407-b3e0250646c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:30.218802 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e59218-0955-46b7-a407-b3e0250646c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:30.220151 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e59218-0955-46b7-a407-b3e0250646c3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:30.228358 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 571/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:16:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:30.234174 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd346d4-4999-4cd0-86fa-9bc85d909923 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:30.269582 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:30.332933 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd346d4-4999-4cd0-86fa-9bc85d909923 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:30.381751 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637c618-3ad1-40cf-8c3d-f0a781e2730c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:30.382368 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637c618-3ad1-40cf-8c3d-f0a781e2730c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:30.382648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637c618-3ad1-40cf-8c3d-f0a781e2730c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:30.382919 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637c618-3ad1-40cf-8c3d-f0a781e2730c None admin] PATH_INFO: `/v3/users/5e3f2ec486f84e32b1473e677212e01a` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:30.384028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637c618-3ad1-40cf-8c3d-f0a781e2730c None admin] RBAC: Authorizing `identity:get_user(user_id=5e3f2ec486f84e32b1473e677212e01a)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:30.385585 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637c618-3ad1-40cf-8c3d-f0a781e2730c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:30.387267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 580/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:16:30 2022] GET /identity/v3/users/5e3f2ec486f84e32b1473e677212e01a => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:30.393013 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e59218-0955-46b7-a407-b3e0250646c3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:30.402285 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:30.491665 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e59218-0955-46b7-a407-b3e0250646c3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:30.523024 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e7371-1c74-49ef-8591-7e0e3ebf00d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:30.523639 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e7371-1c74-49ef-8591-7e0e3ebf00d2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:30.523914 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e7371-1c74-49ef-8591-7e0e3ebf00d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:30.524182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e7371-1c74-49ef-8591-7e0e3ebf00d2 None admin] PATH_INFO: `/v3/projects/c67130498b054c6d84e480804ed3c2be` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:30.525299 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e7371-1c74-49ef-8591-7e0e3ebf00d2 None admin] RBAC: Authorizing `identity:get_project(project_id=c67130498b054c6d84e480804ed3c2be)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:30.526710 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e7371-1c74-49ef-8591-7e0e3ebf00d2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:30.528285 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 572/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:16:30 2022] GET /identity/v3/projects/c67130498b054c6d84e480804ed3c2be => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:30.534188 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637c618-3ad1-40cf-8c3d-f0a781e2730c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:30.632491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637c618-3ad1-40cf-8c3d-f0a781e2730c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:30.634925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:30.668155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da35495-152e-476d-ab25-be686af01666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:30.668802 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da35495-152e-476d-ab25-be686af01666 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:30.669099 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da35495-152e-476d-ab25-be686af01666 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:30.669371 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da35495-152e-476d-ab25-be686af01666 None admin] PATH_INFO: `/v3/projects/c67130498b054c6d84e480804ed3c2be/users/5e3f2ec486f84e32b1473e677212e01a/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:30.671235 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da35495-152e-476d-ab25-be686af01666 None admin] RBAC: Authorizing `identity:create_grant(project_id=c67130498b054c6d84e480804ed3c2be, user_id=5e3f2ec486f84e32b1473e677212e01a, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:30.672700 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da35495-152e-476d-ab25-be686af01666 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:30.744696 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 581/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:16:30 2022] PUT /identity/v3/projects/c67130498b054c6d84e480804ed3c2be/users/5e3f2ec486f84e32b1473e677212e01a/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:16:32.629919 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb8008-e3a1-4e5f-915f-19c09dce8705 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:32.630467 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb8008-e3a1-4e5f-915f-19c09dce8705 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:32.630467 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb8008-e3a1-4e5f-915f-19c09dce8705 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:32.631843 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 573/1154] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:16:32.637268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f846de1-8629-4114-a9c9-844e93839d81 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:32.637670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f846de1-8629-4114-a9c9-844e93839d81 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:32.637818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f846de1-8629-4114-a9c9-844e93839d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:32.655631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-5f846de1-8629-4114-a9c9-844e93839d81 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:16:32.656797 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5f846de1-8629-4114-a9c9-844e93839d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:16:32.721584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 582/1155] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:16:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:16:32.996960 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb8008-e3a1-4e5f-915f-19c09dce8705 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:33.072230 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:33.096749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb8008-e3a1-4e5f-915f-19c09dce8705 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:33.132242 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3195c4b-f31d-4414-8c9c-d74767ce4551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:33.132851 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3195c4b-f31d-4414-8c9c-d74767ce4551 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:33.133156 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3195c4b-f31d-4414-8c9c-d74767ce4551 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:33.133429 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3195c4b-f31d-4414-8c9c-d74767ce4551 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:33.143541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3195c4b-f31d-4414-8c9c-d74767ce4551 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:16:33.148792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-b3195c4b-f31d-4414-8c9c-d74767ce4551 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:16:33.148792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:16:33.148792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:16:33.148792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:16:33.148792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:16:33.148792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:16:33.148792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:16:33.148792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:16:33.148792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:16:33.148792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:16:33.148792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:16:33.148792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:16:33.148792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:16:33.148792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:16:33.148792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:16:33.148792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:16:33.149921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:16:33.149921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:16:33.149921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:16:33.149921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:16:33.149921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:16:33.149921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:16:33.149921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:16:33.149921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:16:33.149921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:16:33.149921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:16:33.149921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:16:33.149921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:16:33.149921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:16:33.149921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:16:33.149921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:16:33.149921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:16:33.150797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:16:33.150797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:16:33.150797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:16:33.150797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:16:33.150797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:16:33.150797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:16:33.150797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:16:33.150797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:16:33.150797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:16:33.150797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:16:33.150797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:16:33.150797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:16:33.150797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 574/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:16:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:16:33.155988 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f846de1-8629-4114-a9c9-844e93839d81 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:33.247345 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:33.253814 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f846de1-8629-4114-a9c9-844e93839d81 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:33.287534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b3210-b9ba-4279-a258-bd1cdea12bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:33.288112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b3210-b9ba-4279-a258-bd1cdea12bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:33.288389 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b3210-b9ba-4279-a258-bd1cdea12bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:33.288658 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b3210-b9ba-4279-a258-bd1cdea12bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:33.289339 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b3210-b9ba-4279-a258-bd1cdea12bb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:33.289641 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b3210-b9ba-4279-a258-bd1cdea12bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:33.291008 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b3210-b9ba-4279-a258-bd1cdea12bb6 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:33.298642 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 583/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:16:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:33.304756 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3195c4b-f31d-4414-8c9c-d74767ce4551 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:33.403313 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3195c4b-f31d-4414-8c9c-d74767ce4551 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:33.435768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f328484-7d6a-4023-8572-7253e2f1b629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:33.436381 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f328484-7d6a-4023-8572-7253e2f1b629 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:33.436655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f328484-7d6a-4023-8572-7253e2f1b629 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:33.436921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f328484-7d6a-4023-8572-7253e2f1b629 None admin] PATH_INFO: `/v3/users/5e3f2ec486f84e32b1473e677212e01a` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:33.438039 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f328484-7d6a-4023-8572-7253e2f1b629 None admin] RBAC: Authorizing `identity:get_user(user_id=5e3f2ec486f84e32b1473e677212e01a)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:33.439445 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f328484-7d6a-4023-8572-7253e2f1b629 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:33.440974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 575/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:16:33 2022] GET /identity/v3/users/5e3f2ec486f84e32b1473e677212e01a => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:33.447614 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b3210-b9ba-4279-a258-bd1cdea12bb6 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:33.545550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b3210-b9ba-4279-a258-bd1cdea12bb6 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:33.578821 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715a8be-b00d-439e-9869-6fa2fd393e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:33.579417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715a8be-b00d-439e-9869-6fa2fd393e00 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:33.579699 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715a8be-b00d-439e-9869-6fa2fd393e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:33.579972 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715a8be-b00d-439e-9869-6fa2fd393e00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:33.604263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:33.647216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715a8be-b00d-439e-9869-6fa2fd393e00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:33.648667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715a8be-b00d-439e-9869-6fa2fd393e00 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:33.745440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 584/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:16:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 14:16:33.751343 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f328484-7d6a-4023-8572-7253e2f1b629 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:33.754301 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:33.851392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f328484-7d6a-4023-8572-7253e2f1b629 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:33.884103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75e048-d5f9-4d0b-a581-eef760ef44e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:33.884715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75e048-d5f9-4d0b-a581-eef760ef44e6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:33.884993 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75e048-d5f9-4d0b-a581-eef760ef44e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:33.885292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75e048-d5f9-4d0b-a581-eef760ef44e6 None admin] PATH_INFO: `/v3/projects/c67130498b054c6d84e480804ed3c2be` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:33.886387 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75e048-d5f9-4d0b-a581-eef760ef44e6 None admin] RBAC: Authorizing `identity:get_project(project_id=c67130498b054c6d84e480804ed3c2be)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:33.887801 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75e048-d5f9-4d0b-a581-eef760ef44e6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:33.889431 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 576/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:16:33 2022] GET /identity/v3/projects/c67130498b054c6d84e480804ed3c2be => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:33.895430 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715a8be-b00d-439e-9869-6fa2fd393e00 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:33.950411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:33.992456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715a8be-b00d-439e-9869-6fa2fd393e00 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:34.025271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d0aa0-d1e6-48db-80eb-bcee0ce27c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:34.025853 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d0aa0-d1e6-48db-80eb-bcee0ce27c51 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:34.026129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d0aa0-d1e6-48db-80eb-bcee0ce27c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:34.026397 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d0aa0-d1e6-48db-80eb-bcee0ce27c51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:34.027109 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d0aa0-d1e6-48db-80eb-bcee0ce27c51 None admin] RBAC: Adding query filter params (role.id=f22e6e660eab44c5be25e3dee1e3042c, scope.project.id=c67130498b054c6d84e480804ed3c2be, user.id=5e3f2ec486f84e32b1473e677212e01a) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:34.027416 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d0aa0-d1e6-48db-80eb-bcee0ce27c51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:34.028837 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d0aa0-d1e6-48db-80eb-bcee0ce27c51 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:34.034381 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 585/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:16:33 2022] GET /identity/v3/role_assignments?user.id=5e3f2ec486f84e32b1473e677212e01a&scope.project.id=c67130498b054c6d84e480804ed3c2be&role.id=f22e6e660eab44c5be25e3dee1e3042c => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:35.962436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2aaa5-6df6-41a7-a6ad-6a164c2dc457 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:35.962998 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2aaa5-6df6-41a7-a6ad-6a164c2dc457 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:35.962998 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2aaa5-6df6-41a7-a6ad-6a164c2dc457 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:35.964317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 577/1162] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:16:35.969468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fe67c-7665-4816-8fb6-ecfcf0303c3d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:35.969887 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fe67c-7665-4816-8fb6-ecfcf0303c3d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:35.970039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fe67c-7665-4816-8fb6-ecfcf0303c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:35.988294 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-412fe67c-7665-4816-8fb6-ecfcf0303c3d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:16:35.989496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-412fe67c-7665-4816-8fb6-ecfcf0303c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:16:36.054233 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 586/1163] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:16:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:16:36.321258 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2aaa5-6df6-41a7-a6ad-6a164c2dc457 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:36.389999 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:36.420511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2aaa5-6df6-41a7-a6ad-6a164c2dc457 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:36.454282 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258c2c3-d33d-4ca1-98f7-6240616e0ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:36.454872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258c2c3-d33d-4ca1-98f7-6240616e0ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:36.455152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258c2c3-d33d-4ca1-98f7-6240616e0ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:36.455422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258c2c3-d33d-4ca1-98f7-6240616e0ce2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:36.520553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258c2c3-d33d-4ca1-98f7-6240616e0ce2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:36.522627 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258c2c3-d33d-4ca1-98f7-6240616e0ce2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:36.588783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:36.620732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 578/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:16:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 14:16:36.626617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fe67c-7665-4816-8fb6-ecfcf0303c3d None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:36.674925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:36.722377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fe67c-7665-4816-8fb6-ecfcf0303c3d None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:36.759770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede8b27-b6fc-4222-af72-e1115c7c79e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:36.760392 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede8b27-b6fc-4222-af72-e1115c7c79e9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:36.760694 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede8b27-b6fc-4222-af72-e1115c7c79e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:36.760965 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede8b27-b6fc-4222-af72-e1115c7c79e9 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:36.767475 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede8b27-b6fc-4222-af72-e1115c7c79e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:36.768920 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede8b27-b6fc-4222-af72-e1115c7c79e9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:36.781026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-aede8b27-b6fc-4222-af72-e1115c7c79e9 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 05 14:16:36.781026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:16:36.781026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 05 14:16:36.781026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 05 14:16:36.781026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:16:36.781026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:16:36.781026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:16:36.781026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:16:36.781026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 05 14:16:36.781026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:16:36.781026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:16:36.781026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:16:36.781026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:16:36.781026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:16:36.781026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:16:36.781026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:16:36.781026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:16:36.782092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:16:36.782092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:16:36.782092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:16:36.782092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:16:36.782092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:16:36.782092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:16:36.782092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:16:36.782092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:16:36.782092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:16:36.782092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:16:36.782092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:16:36.782092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:16:36.782092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:16:36.782092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:16:36.782092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:16:36.782092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:16:36.783026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:16:36.783026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:16:36.783026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:16:36.783026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:16:36.783026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:16:36.783026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:16:36.783026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:16:36.783026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:16:36.783026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:16:36.783026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:16:36.783026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 05 14:16:36.783026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:16:36.783026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 05 14:16:36.783026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:16:36.783026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 587/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 5 14:16:36 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:16:36.788648 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258c2c3-d33d-4ca1-98f7-6240616e0ce2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:36.885359 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258c2c3-d33d-4ca1-98f7-6240616e0ce2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:36.918834 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c8156-f895-4b97-95fc-593c4def3092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:36.919421 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c8156-f895-4b97-95fc-593c4def3092 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:36.919702 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c8156-f895-4b97-95fc-593c4def3092 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:36.919976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c8156-f895-4b97-95fc-593c4def3092 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:36.920608 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c8156-f895-4b97-95fc-593c4def3092 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:36.920918 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c8156-f895-4b97-95fc-593c4def3092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:36.922308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c8156-f895-4b97-95fc-593c4def3092 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:36.929594 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 579/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Sep 5 14:16:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:38.848510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e2e74-2dec-4755-87b9-9e7b948a03e8 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:38.849098 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e2e74-2dec-4755-87b9-9e7b948a03e8 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:38.849098 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e2e74-2dec-4755-87b9-9e7b948a03e8 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:38.851212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 588/1167] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:16:38.856275 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f32159-fdf7-499b-9a34-cb83d138e1da None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:38.856670 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f32159-fdf7-499b-9a34-cb83d138e1da None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:38.856816 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f32159-fdf7-499b-9a34-cb83d138e1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:38.875181 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-93f32159-fdf7-499b-9a34-cb83d138e1da None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:16:38.876337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-93f32159-fdf7-499b-9a34-cb83d138e1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:16:38.902219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:38.940525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 580/1168] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:16:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 14:16:39.215973 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e2e74-2dec-4755-87b9-9e7b948a03e8 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:39.315098 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e2e74-2dec-4755-87b9-9e7b948a03e8 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:39.325861 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:39.348419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152efeaa-0999-4083-9894-6d0b2b1b165c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:39.349007 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152efeaa-0999-4083-9894-6d0b2b1b165c None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:39.349313 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152efeaa-0999-4083-9894-6d0b2b1b165c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:39.349725 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152efeaa-0999-4083-9894-6d0b2b1b165c None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:39.350401 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152efeaa-0999-4083-9894-6d0b2b1b165c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:39.351797 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152efeaa-0999-4083-9894-6d0b2b1b165c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:39.467828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 589/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Mon Sep 5 14:16:39 2022] POST /identity/v3/domains => generated 267 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:16:41.410604 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b721a-c196-4e2d-9699-99b0f5b25242 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:41.411144 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b721a-c196-4e2d-9699-99b0f5b25242 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:41.411144 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b721a-c196-4e2d-9699-99b0f5b25242 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:41.413107 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 581/1170] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:16:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:16:41.418371 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ac789-6cc6-4a96-9fcb-05bce2045b23 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:41.418786 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ac789-6cc6-4a96-9fcb-05bce2045b23 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:41.418927 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ac789-6cc6-4a96-9fcb-05bce2045b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:41.437566 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-748ac789-6cc6-4a96-9fcb-05bce2045b23 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:16:41.438754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-748ac789-6cc6-4a96-9fcb-05bce2045b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:16:41.503360 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 590/1171] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:16:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:16:41.781465 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b721a-c196-4e2d-9699-99b0f5b25242 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:41.880580 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b721a-c196-4e2d-9699-99b0f5b25242 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:41.913184 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527c130-36ba-4779-9f59-bbfe7a9cb529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:41.913790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527c130-36ba-4779-9f59-bbfe7a9cb529 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:41.914065 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527c130-36ba-4779-9f59-bbfe7a9cb529 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:41.914331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527c130-36ba-4779-9f59-bbfe7a9cb529 None admin] PATH_INFO: `/v3/domains/17ffdfe405b4495b97b408f526af0c4f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:41.924193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527c130-36ba-4779-9f59-bbfe7a9cb529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=17ffdfe405b4495b97b408f526af0c4f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:41.925915 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527c130-36ba-4779-9f59-bbfe7a9cb529 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:41.928084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 582/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Sep 5 14:16:41 2022] GET /identity/v3/domains/17ffdfe405b4495b97b408f526af0c4f => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:41.933931 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ac789-6cc6-4a96-9fcb-05bce2045b23 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:42.041537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:42.048774 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ac789-6cc6-4a96-9fcb-05bce2045b23 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:42.089129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10406317-0267-413c-8e4b-0cfd11f2a0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:42.089841 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10406317-0267-413c-8e4b-0cfd11f2a0c3 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:42.090219 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10406317-0267-413c-8e4b-0cfd11f2a0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:42.090571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10406317-0267-413c-8e4b-0cfd11f2a0c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:42.091311 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10406317-0267-413c-8e4b-0cfd11f2a0c3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:42.092824 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10406317-0267-413c-8e4b-0cfd11f2a0c3 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:42.182650 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 591/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 5 14:16:41 2022] POST /identity/v3/projects => generated 361 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:16:44.123456 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4a782-e973-42bc-b634-b07053b72b38 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:44.124090 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4a782-e973-42bc-b634-b07053b72b38 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:44.124090 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4a782-e973-42bc-b634-b07053b72b38 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:44.125360 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 583/1174] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:16:44.130468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8cfbb-e7cd-4de6-86fc-a2ce8ed1efe2 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:44.131082 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8cfbb-e7cd-4de6-86fc-a2ce8ed1efe2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:44.131082 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8cfbb-e7cd-4de6-86fc-a2ce8ed1efe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:44.149520 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-bca8cfbb-e7cd-4de6-86fc-a2ce8ed1efe2 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:16:44.150704 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-bca8cfbb-e7cd-4de6-86fc-a2ce8ed1efe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:16:44.215776 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 592/1175] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:16:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:16:44.486905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4a782-e973-42bc-b634-b07053b72b38 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:44.512737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:44.588394 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4a782-e973-42bc-b634-b07053b72b38 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:44.621176 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5c828-2a24-4ef6-a40d-ccc73740867e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:44.621789 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5c828-2a24-4ef6-a40d-ccc73740867e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:44.622069 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5c828-2a24-4ef6-a40d-ccc73740867e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:44.622343 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5c828-2a24-4ef6-a40d-ccc73740867e None admin] PATH_INFO: `/v3/domains/17ffdfe405b4495b97b408f526af0c4f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:44.623444 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5c828-2a24-4ef6-a40d-ccc73740867e None admin] RBAC: Authorizing `identity:get_domain(domain_id=17ffdfe405b4495b97b408f526af0c4f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:44.624864 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5c828-2a24-4ef6-a40d-ccc73740867e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:44.626435 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 584/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Sep 5 14:16:44 2022] GET /identity/v3/domains/17ffdfe405b4495b97b408f526af0c4f => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:44.632885 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8cfbb-e7cd-4de6-86fc-a2ce8ed1efe2 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:44.713210 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:44.730585 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8cfbb-e7cd-4de6-86fc-a2ce8ed1efe2 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:44.764160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7526daf-1d99-46b2-b127-9953fe6aa129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:44.764757 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7526daf-1d99-46b2-b127-9953fe6aa129 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:44.765036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7526daf-1d99-46b2-b127-9953fe6aa129 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:44.765406 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7526daf-1d99-46b2-b127-9953fe6aa129 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:44.766048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7526daf-1d99-46b2-b127-9953fe6aa129 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:44.767471 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7526daf-1d99-46b2-b127-9953fe6aa129 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:44.864611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 593/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 5 14:16:44 2022] POST /identity/v3/users => generated 311 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:16:46.794062 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb4dc8-542f-4af3-9bf0-879c5342d42f None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:46.794624 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb4dc8-542f-4af3-9bf0-879c5342d42f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:46.794624 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb4dc8-542f-4af3-9bf0-879c5342d42f None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:46.795912 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 585/1178] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:16:46.801393 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7767ec-132c-45f5-a273-9ae1b90ce4da None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:46.801779 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7767ec-132c-45f5-a273-9ae1b90ce4da None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:46.801940 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7767ec-132c-45f5-a273-9ae1b90ce4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:46.820888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-1f7767ec-132c-45f5-a273-9ae1b90ce4da None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:16:46.822138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1f7767ec-132c-45f5-a273-9ae1b90ce4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:16:46.886492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 594/1179] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:16:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:16:47.162450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb4dc8-542f-4af3-9bf0-879c5342d42f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:47.253757 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:47.263110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb4dc8-542f-4af3-9bf0-879c5342d42f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:47.296594 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e301fd2-a004-4b7b-9709-3159716ccf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:47.297235 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e301fd2-a004-4b7b-9709-3159716ccf97 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:47.297514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e301fd2-a004-4b7b-9709-3159716ccf97 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:47.297782 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e301fd2-a004-4b7b-9709-3159716ccf97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:47.307845 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e301fd2-a004-4b7b-9709-3159716ccf97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:16:47.312463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-7e301fd2-a004-4b7b-9709-3159716ccf97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:16:47.312463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:16:47.312463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:16:47.312463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:16:47.312463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:16:47.312463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:16:47.312463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:16:47.312463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:16:47.312463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:16:47.312463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:16:47.312463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:16:47.312463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:16:47.312463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:16:47.312463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:16:47.312463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:16:47.312463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:16:47.313678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:16:47.313678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:16:47.313678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:16:47.313678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:16:47.313678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:16:47.313678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:16:47.313678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:16:47.313678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:16:47.313678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:16:47.313678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:16:47.313678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:16:47.313678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:16:47.313678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:16:47.313678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:16:47.313678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:16:47.313678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:16:47.314602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:16:47.314602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:16:47.314602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:16:47.314602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:16:47.314602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:16:47.314602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:16:47.314602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:16:47.314602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:16:47.314602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:16:47.314602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:16:47.314602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:16:47.314602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:16:47.314602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 586/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:16:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:16:47.319826 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7767ec-132c-45f5-a273-9ae1b90ce4da None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:47.389030 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:47.511896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7767ec-132c-45f5-a273-9ae1b90ce4da None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:47.545265 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721cb9e-88a7-449f-8b1c-1ca7a9860cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:47.545866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721cb9e-88a7-449f-8b1c-1ca7a9860cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:47.546146 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721cb9e-88a7-449f-8b1c-1ca7a9860cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:47.546418 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721cb9e-88a7-449f-8b1c-1ca7a9860cf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:47.547073 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721cb9e-88a7-449f-8b1c-1ca7a9860cf4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:47.547375 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721cb9e-88a7-449f-8b1c-1ca7a9860cf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:47.548746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721cb9e-88a7-449f-8b1c-1ca7a9860cf4 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:47.556884 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 595/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:16:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:47.562751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e301fd2-a004-4b7b-9709-3159716ccf97 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:47.659501 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e301fd2-a004-4b7b-9709-3159716ccf97 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:47.691444 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a7cf9-5e4a-4065-9100-41068d747ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:47.692044 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a7cf9-5e4a-4065-9100-41068d747ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:47.692317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a7cf9-5e4a-4065-9100-41068d747ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:47.692583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a7cf9-5e4a-4065-9100-41068d747ca7 None admin] PATH_INFO: `/v3/users/9447903beaff4c08a12f303a681e2b1e` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:47.706348 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a7cf9-5e4a-4065-9100-41068d747ca7 None admin] RBAC: Authorizing `identity:get_user(user_id=9447903beaff4c08a12f303a681e2b1e)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:47.707997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a7cf9-5e4a-4065-9100-41068d747ca7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:47.710317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 587/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:16:47 2022] GET /identity/v3/users/9447903beaff4c08a12f303a681e2b1e => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:47.717276 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721cb9e-88a7-449f-8b1c-1ca7a9860cf4 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:47.814951 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721cb9e-88a7-449f-8b1c-1ca7a9860cf4 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:47.842607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:47.847906 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c28e94-ceb8-49e6-917a-a16550909a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:47.848498 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c28e94-ceb8-49e6-917a-a16550909a6c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:47.848776 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c28e94-ceb8-49e6-917a-a16550909a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:47.849644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c28e94-ceb8-49e6-917a-a16550909a6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:47.916797 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c28e94-ceb8-49e6-917a-a16550909a6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:47.918280 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c28e94-ceb8-49e6-917a-a16550909a6c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:48.013550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 596/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:16:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 14:16:48.019534 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a7cf9-5e4a-4065-9100-41068d747ca7 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:48.032084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:48.116782 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a7cf9-5e4a-4065-9100-41068d747ca7 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:48.149471 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a134e23-e979-4f52-a56d-3a41db2da8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:48.150083 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a134e23-e979-4f52-a56d-3a41db2da8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:48.150358 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a134e23-e979-4f52-a56d-3a41db2da8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:48.150624 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a134e23-e979-4f52-a56d-3a41db2da8d8 None admin] PATH_INFO: `/v3/projects/dcec41f18e974115a73c0aa097dbb781` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:48.151709 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a134e23-e979-4f52-a56d-3a41db2da8d8 None admin] RBAC: Authorizing `identity:get_project(project_id=dcec41f18e974115a73c0aa097dbb781)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:48.153140 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a134e23-e979-4f52-a56d-3a41db2da8d8 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:48.154707 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 588/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:16:48 2022] GET /identity/v3/projects/dcec41f18e974115a73c0aa097dbb781 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:48.160897 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c28e94-ceb8-49e6-917a-a16550909a6c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:48.190071 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:48.259391 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c28e94-ceb8-49e6-917a-a16550909a6c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:48.292742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb260a-edd3-4c13-aeee-7f258968a4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:48.293371 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb260a-edd3-4c13-aeee-7f258968a4bb None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:48.293650 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb260a-edd3-4c13-aeee-7f258968a4bb None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:48.293922 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb260a-edd3-4c13-aeee-7f258968a4bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:48.294640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb260a-edd3-4c13-aeee-7f258968a4bb None admin] RBAC: Adding query filter params (role.id=f22e6e660eab44c5be25e3dee1e3042c, scope.project.id=dcec41f18e974115a73c0aa097dbb781, user.id=9447903beaff4c08a12f303a681e2b1e) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:48.294946 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb260a-edd3-4c13-aeee-7f258968a4bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:48.296374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb260a-edd3-4c13-aeee-7f258968a4bb None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:48.301916 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 597/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:16:48 2022] GET /identity/v3/role_assignments?user.id=9447903beaff4c08a12f303a681e2b1e&scope.project.id=dcec41f18e974115a73c0aa097dbb781&role.id=f22e6e660eab44c5be25e3dee1e3042c => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:50.162623 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf5fbd-1b34-409f-85da-06dca55e5b0b None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:50.163152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf5fbd-1b34-409f-85da-06dca55e5b0b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:50.163152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf5fbd-1b34-409f-85da-06dca55e5b0b None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:50.164472 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 589/1186] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:16:50.169539 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcf384-cee9-4f77-94e8-7138dde736b9 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:50.169952 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcf384-cee9-4f77-94e8-7138dde736b9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:50.170081 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcf384-cee9-4f77-94e8-7138dde736b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:50.188711 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-50fcf384-cee9-4f77-94e8-7138dde736b9 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:16:50.189912 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-50fcf384-cee9-4f77-94e8-7138dde736b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:16:50.256505 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 598/1187] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:16:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:16:50.533996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf5fbd-1b34-409f-85da-06dca55e5b0b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:50.613395 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:50.635424 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf5fbd-1b34-409f-85da-06dca55e5b0b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:50.669035 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fec4c2-2b9d-4d15-8792-7434bf35f8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:50.669677 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fec4c2-2b9d-4d15-8792-7434bf35f8ef None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:50.669956 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fec4c2-2b9d-4d15-8792-7434bf35f8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:50.670227 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fec4c2-2b9d-4d15-8792-7434bf35f8ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:50.680632 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fec4c2-2b9d-4d15-8792-7434bf35f8ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:16:50.685320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-c6fec4c2-2b9d-4d15-8792-7434bf35f8ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:16:50.685320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:16:50.685320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:16:50.685320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:16:50.685320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:16:50.685320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:16:50.685320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:16:50.685320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:16:50.685320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:16:50.685320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:16:50.685320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:16:50.685320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:16:50.685320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:16:50.685320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:16:50.685320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:16:50.685320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:16:50.686420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:16:50.686420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:16:50.686420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:16:50.686420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:16:50.686420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:16:50.686420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:16:50.686420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:16:50.686420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:16:50.686420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:16:50.686420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:16:50.686420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:16:50.686420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:16:50.686420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:16:50.686420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:16:50.686420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:16:50.686420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:16:50.687456 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:16:50.687456 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:16:50.687456 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:16:50.687456 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:16:50.687456 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:16:50.687456 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:16:50.687456 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:16:50.687456 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:16:50.687456 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:16:50.687456 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:16:50.687456 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:16:50.687456 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:16:50.687456 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 590/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:16:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:16:50.692355 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcf384-cee9-4f77-94e8-7138dde736b9 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:50.717225 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:50.788955 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcf384-cee9-4f77-94e8-7138dde736b9 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:50.822390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f2691-db8d-465d-992d-877b62a0d2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:50.822984 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f2691-db8d-465d-992d-877b62a0d2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:50.823266 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f2691-db8d-465d-992d-877b62a0d2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:50.823540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f2691-db8d-465d-992d-877b62a0d2d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:50.824198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f2691-db8d-465d-992d-877b62a0d2d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:50.824502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f2691-db8d-465d-992d-877b62a0d2d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:50.825907 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f2691-db8d-465d-992d-877b62a0d2d8 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:50.834309 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 599/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:16:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:50.840098 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fec4c2-2b9d-4d15-8792-7434bf35f8ef None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:50.937157 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fec4c2-2b9d-4d15-8792-7434bf35f8ef None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:50.970113 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8999cd2-e6a0-4138-8a3b-4abecd68d7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:50.970726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8999cd2-e6a0-4138-8a3b-4abecd68d7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:50.970999 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8999cd2-e6a0-4138-8a3b-4abecd68d7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:50.971266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8999cd2-e6a0-4138-8a3b-4abecd68d7f6 None admin] PATH_INFO: `/v3/users/9447903beaff4c08a12f303a681e2b1e` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:50.972358 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8999cd2-e6a0-4138-8a3b-4abecd68d7f6 None admin] RBAC: Authorizing `identity:get_user(user_id=9447903beaff4c08a12f303a681e2b1e)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:50.973788 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8999cd2-e6a0-4138-8a3b-4abecd68d7f6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:50.975593 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 591/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:16:50 2022] GET /identity/v3/users/9447903beaff4c08a12f303a681e2b1e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:50.981417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f2691-db8d-465d-992d-877b62a0d2d8 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:51.072087 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:51.086553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f2691-db8d-465d-992d-877b62a0d2d8 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:51.119342 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c194c8-f038-47f3-a094-3fff437a3397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:51.119958 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c194c8-f038-47f3-a094-3fff437a3397 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:51.120231 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c194c8-f038-47f3-a094-3fff437a3397 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:51.120495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c194c8-f038-47f3-a094-3fff437a3397 None admin] PATH_INFO: `/v3/projects/dcec41f18e974115a73c0aa097dbb781` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:51.121611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c194c8-f038-47f3-a094-3fff437a3397 None admin] RBAC: Authorizing `identity:get_project(project_id=dcec41f18e974115a73c0aa097dbb781)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:51.123038 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c194c8-f038-47f3-a094-3fff437a3397 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:51.124628 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 600/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:16:50 2022] GET /identity/v3/projects/dcec41f18e974115a73c0aa097dbb781 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:51.131045 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8999cd2-e6a0-4138-8a3b-4abecd68d7f6 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:51.140357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:51.228213 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8999cd2-e6a0-4138-8a3b-4abecd68d7f6 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:51.261183 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250592a-ad1d-4ea6-b28e-8c29a1cef7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:51.261822 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250592a-ad1d-4ea6-b28e-8c29a1cef7a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:51.262095 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250592a-ad1d-4ea6-b28e-8c29a1cef7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:51.262364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250592a-ad1d-4ea6-b28e-8c29a1cef7a7 None admin] PATH_INFO: `/v3/projects/dcec41f18e974115a73c0aa097dbb781/users/9447903beaff4c08a12f303a681e2b1e/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:51.264205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250592a-ad1d-4ea6-b28e-8c29a1cef7a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=dcec41f18e974115a73c0aa097dbb781, user_id=9447903beaff4c08a12f303a681e2b1e, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:51.265651 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250592a-ad1d-4ea6-b28e-8c29a1cef7a7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:51.363372 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 592/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:16:51 2022] PUT /identity/v3/projects/dcec41f18e974115a73c0aa097dbb781/users/9447903beaff4c08a12f303a681e2b1e/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:16:53.230129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478f3e3-7d65-4d4c-8583-9f08dbe45227 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:53.230678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478f3e3-7d65-4d4c-8583-9f08dbe45227 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:53.230678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478f3e3-7d65-4d4c-8583-9f08dbe45227 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:53.232284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 601/1193] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:16:53.237113 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81a9f2-2dac-44bb-98c7-4db2c18d3481 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:53.237498 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81a9f2-2dac-44bb-98c7-4db2c18d3481 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:53.237656 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81a9f2-2dac-44bb-98c7-4db2c18d3481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:53.256844 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1c81a9f2-2dac-44bb-98c7-4db2c18d3481 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:16:53.258048 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1c81a9f2-2dac-44bb-98c7-4db2c18d3481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:16:53.314815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:53.322480 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 593/1194] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:16:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:16:53.599788 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478f3e3-7d65-4d4c-8583-9f08dbe45227 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:53.711503 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478f3e3-7d65-4d4c-8583-9f08dbe45227 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:53.749580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947ba01-2677-4cc3-90c2-4d26c0d84fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:53.750212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947ba01-2677-4cc3-90c2-4d26c0d84fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:53.750490 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947ba01-2677-4cc3-90c2-4d26c0d84fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:53.750760 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947ba01-2677-4cc3-90c2-4d26c0d84fb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:53.762538 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947ba01-2677-4cc3-90c2-4d26c0d84fb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:16:53.767324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-1947ba01-2677-4cc3-90c2-4d26c0d84fb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:16:53.767324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:16:53.767324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:16:53.767324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:16:53.767324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:16:53.767324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:16:53.767324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:16:53.767324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:16:53.767324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:16:53.767324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:16:53.767324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:16:53.767324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:16:53.767324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:16:53.767324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:16:53.767324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:16:53.767324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:16:53.768468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:16:53.768468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:16:53.768468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:16:53.768468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:16:53.768468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:16:53.768468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:16:53.768468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:16:53.768468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:16:53.768468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:16:53.768468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:16:53.768468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:16:53.768468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:16:53.768468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:16:53.768468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:16:53.768468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:16:53.768468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:16:53.769395 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:16:53.769395 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:16:53.769395 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:16:53.769395 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:16:53.769395 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:16:53.769395 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:16:53.769395 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:16:53.769395 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:16:53.769395 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:16:53.769395 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:16:53.769395 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:16:53.769395 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:16:53.769395 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 602/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:16:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:16:53.775259 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81a9f2-2dac-44bb-98c7-4db2c18d3481 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:53.871718 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81a9f2-2dac-44bb-98c7-4db2c18d3481 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:53.904488 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8e419-616d-4617-9632-b8f4a8b3016b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:53.905094 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8e419-616d-4617-9632-b8f4a8b3016b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:53.905378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8e419-616d-4617-9632-b8f4a8b3016b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:53.905650 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8e419-616d-4617-9632-b8f4a8b3016b None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:53.906305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8e419-616d-4617-9632-b8f4a8b3016b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:53.906606 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8e419-616d-4617-9632-b8f4a8b3016b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:53.907962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8e419-616d-4617-9632-b8f4a8b3016b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:53.915763 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 594/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:16:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:53.921409 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947ba01-2677-4cc3-90c2-4d26c0d84fb9 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:53.937847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:54.018787 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947ba01-2677-4cc3-90c2-4d26c0d84fb9 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:54.052774 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05817211-2641-4122-891d-f06862fa0990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:54.053433 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05817211-2641-4122-891d-f06862fa0990 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:54.053710 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05817211-2641-4122-891d-f06862fa0990 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:54.053975 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05817211-2641-4122-891d-f06862fa0990 None admin] PATH_INFO: `/v3/users/9447903beaff4c08a12f303a681e2b1e` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:54.055301 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05817211-2641-4122-891d-f06862fa0990 None admin] RBAC: Authorizing `identity:get_user(user_id=9447903beaff4c08a12f303a681e2b1e)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:54.056736 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05817211-2641-4122-891d-f06862fa0990 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:54.058333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 603/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Sep 5 14:16:53 2022] GET /identity/v3/users/9447903beaff4c08a12f303a681e2b1e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:54.064295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8e419-616d-4617-9632-b8f4a8b3016b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:54.124091 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:54.165796 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8e419-616d-4617-9632-b8f4a8b3016b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:54.198449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ec6da-78cb-4bb9-b16b-cea0070252c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:54.199043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ec6da-78cb-4bb9-b16b-cea0070252c2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:54.199363 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ec6da-78cb-4bb9-b16b-cea0070252c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:54.199640 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ec6da-78cb-4bb9-b16b-cea0070252c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:54.265266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ec6da-78cb-4bb9-b16b-cea0070252c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:54.266682 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ec6da-78cb-4bb9-b16b-cea0070252c2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:54.320650 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:54.360582 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 595/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:16:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 14:16:54.366633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05817211-2641-4122-891d-f06862fa0990 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:54.447361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:16:54.465733 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05817211-2641-4122-891d-f06862fa0990 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:54.502231 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9aabf1-cd1b-413f-9632-34ca17571b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:54.502851 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aabf1-cd1b-413f-9632-34ca17571b24 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:54.503129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aabf1-cd1b-413f-9632-34ca17571b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:54.503401 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aabf1-cd1b-413f-9632-34ca17571b24 None admin] PATH_INFO: `/v3/projects/dcec41f18e974115a73c0aa097dbb781` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:54.504501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9aabf1-cd1b-413f-9632-34ca17571b24 None admin] RBAC: Authorizing `identity:get_project(project_id=dcec41f18e974115a73c0aa097dbb781)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:54.506695 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9aabf1-cd1b-413f-9632-34ca17571b24 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:54.508299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 604/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Sep 5 14:16:54 2022] GET /identity/v3/projects/dcec41f18e974115a73c0aa097dbb781 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:16:54.514371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ec6da-78cb-4bb9-b16b-cea0070252c2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:16:54.611506 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ec6da-78cb-4bb9-b16b-cea0070252c2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:16:54.644519 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f9f55-20ce-450c-a00f-6cbe9d5b1f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:16:54.645122 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f9f55-20ce-450c-a00f-6cbe9d5b1f21 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:16:54.645400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f9f55-20ce-450c-a00f-6cbe9d5b1f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:16:54.645760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f9f55-20ce-450c-a00f-6cbe9d5b1f21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:16:54.646501 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f9f55-20ce-450c-a00f-6cbe9d5b1f21 None admin] RBAC: Adding query filter params (role.id=f22e6e660eab44c5be25e3dee1e3042c, scope.project.id=dcec41f18e974115a73c0aa097dbb781, user.id=9447903beaff4c08a12f303a681e2b1e) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:16:54.646804 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f9f55-20ce-450c-a00f-6cbe9d5b1f21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:16:54.648215 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f9f55-20ce-450c-a00f-6cbe9d5b1f21 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:16:54.653715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 596/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:16:54 2022] GET /identity/v3/role_assignments?user.id=9447903beaff4c08a12f303a681e2b1e&scope.project.id=dcec41f18e974115a73c0aa097dbb781&role.id=f22e6e660eab44c5be25e3dee1e3042c => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:17:04.498103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=25 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:17:04.651196 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:13.573582 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ffe8f-d29a-4bdf-915d-18408bd7fe84 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:13.574165 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ffe8f-d29a-4bdf-915d-18408bd7fe84 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:13.574165 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ffe8f-d29a-4bdf-915d-18408bd7fe84 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:13.575509 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 605/1201] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:18:13.580534 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c07d5-7c01-40f2-ab68-d87f9409689d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:13.580916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c07d5-7c01-40f2-ab68-d87f9409689d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:13.581126 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c07d5-7c01-40f2-ab68-d87f9409689d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:13.606550 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f94c07d5-7c01-40f2-ab68-d87f9409689d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:18:13.607730 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f94c07d5-7c01-40f2-ab68-d87f9409689d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:18:13.675165 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 597/1202] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:18:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:18:13.951882 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ffe8f-d29a-4bdf-915d-18408bd7fe84 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:14.049496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ffe8f-d29a-4bdf-915d-18408bd7fe84 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:14.082501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aafdd9-5796-45ea-9202-fb6aa03b9187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:14.083107 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aafdd9-5796-45ea-9202-fb6aa03b9187 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:14.083383 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aafdd9-5796-45ea-9202-fb6aa03b9187 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:14.083653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aafdd9-5796-45ea-9202-fb6aa03b9187 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:14.093488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aafdd9-5796-45ea-9202-fb6aa03b9187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:14.094920 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aafdd9-5796-45ea-9202-fb6aa03b9187 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:14.109438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-34aafdd9-5796-45ea-9202-fb6aa03b9187 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:14.109438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:14.109438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:14.109438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:14.109438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:14.109438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:14.109438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:14.109438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:14.109438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:14.109438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:14.109438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:14.109438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:14.109438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:18:14.109438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:18:14.109438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:18:14.109438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:18:14.110691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:14.110691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:14.110691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:14.110691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:14.110691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:14.110691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:14.110691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:14.110691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:14.110691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:14.110691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:14.110691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:14.110691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:14.110691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:14.110691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:14.110691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:14.110691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:14.110691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:18:14.111800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:18:14.111800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:14.111800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:18:14.111800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 606/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:18:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:14.117140 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c07d5-7c01-40f2-ab68-d87f9409689d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:14.214388 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c07d5-7c01-40f2-ab68-d87f9409689d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:14.243976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:14.249595 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522902c1-ad83-4ae6-82ff-a0f83ada235a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:14.250191 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522902c1-ad83-4ae6-82ff-a0f83ada235a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:14.250468 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522902c1-ad83-4ae6-82ff-a0f83ada235a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:14.250735 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522902c1-ad83-4ae6-82ff-a0f83ada235a None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:14.251407 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522902c1-ad83-4ae6-82ff-a0f83ada235a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:14.251698 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522902c1-ad83-4ae6-82ff-a0f83ada235a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:14.253045 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522902c1-ad83-4ae6-82ff-a0f83ada235a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:14.263937 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 598/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:14.269949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aafdd9-5796-45ea-9202-fb6aa03b9187 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:14.321746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:14.367823 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aafdd9-5796-45ea-9202-fb6aa03b9187 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:14.400720 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6da64-7237-4ce8-9499-8361db04ce5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:14.401339 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6da64-7237-4ce8-9499-8361db04ce5b None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:14.401620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6da64-7237-4ce8-9499-8361db04ce5b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:14.401893 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6da64-7237-4ce8-9499-8361db04ce5b None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:14.402608 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6da64-7237-4ce8-9499-8361db04ce5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:14.404630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6da64-7237-4ce8-9499-8361db04ce5b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:14.505991 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 607/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Sep 5 14:18:14 2022] POST /identity/v3/users => generated 251 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:18:16.425712 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cfb3f-68b7-42c2-b015-d93aedce9b08 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:16.426290 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cfb3f-68b7-42c2-b015-d93aedce9b08 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:16.426290 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cfb3f-68b7-42c2-b015-d93aedce9b08 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:16.427604 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 599/1206] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:18:16.433684 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f8bb8-7d43-4160-9767-6a74c1f2b528 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:16.436299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f8bb8-7d43-4160-9767-6a74c1f2b528 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:16.436299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f8bb8-7d43-4160-9767-6a74c1f2b528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:16.453292 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-5a0f8bb8-7d43-4160-9767-6a74c1f2b528 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:18:16.454492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5a0f8bb8-7d43-4160-9767-6a74c1f2b528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:18:16.520086 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 608/1207] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:18:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:18:16.794920 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cfb3f-68b7-42c2-b015-d93aedce9b08 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:16.895781 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cfb3f-68b7-42c2-b015-d93aedce9b08 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:16.930824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612bdb7-b31b-4bda-bfe3-d6b43643dcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:16.931445 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612bdb7-b31b-4bda-bfe3-d6b43643dcb1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:16.931726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612bdb7-b31b-4bda-bfe3-d6b43643dcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:16.931999 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612bdb7-b31b-4bda-bfe3-d6b43643dcb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:16.941959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612bdb7-b31b-4bda-bfe3-d6b43643dcb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:18:16.947413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-2612bdb7-b31b-4bda-bfe3-d6b43643dcb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:18:16.947413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:16.947413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:16.947413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:16.947413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:16.947413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:16.947413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:16.947413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:16.947413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:16.947413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:16.947413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:16.947413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:16.947413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:18:16.947413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:18:16.947413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:18:16.947413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:18:16.948401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:18:16.948401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:18:16.948401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:18:16.948401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:18:16.948401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:16.948401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:16.948401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:16.948401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:16.948401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:16.948401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:16.948401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:16.948401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:16.948401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:16.948401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:16.948401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:16.948401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:16.949563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:16.949563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:16.949563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:16.949563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:16.949563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:18:16.949563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:18:16.949563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:18:16.949563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:18:16.949563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:18:16.949563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:18:16.949563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:18:16.949563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:16.949563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 600/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:18:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:16.954592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f8bb8-7d43-4160-9767-6a74c1f2b528 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:16.994091 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:17.052827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f8bb8-7d43-4160-9767-6a74c1f2b528 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:17.087045 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f9840-caa8-4808-acb4-0d39d604e007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:17.087643 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f9840-caa8-4808-acb4-0d39d604e007 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:17.087956 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f9840-caa8-4808-acb4-0d39d604e007 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:17.088192 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f9840-caa8-4808-acb4-0d39d604e007 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:17.088844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f9840-caa8-4808-acb4-0d39d604e007 None admin] RBAC: Adding query filter params (name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:17.089179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f9840-caa8-4808-acb4-0d39d604e007 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:17.090561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f9840-caa8-4808-acb4-0d39d604e007 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:17.098122 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 609/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 5 14:18:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:17.104578 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612bdb7-b31b-4bda-bfe3-d6b43643dcb1 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:17.154942 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:17.204330 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612bdb7-b31b-4bda-bfe3-d6b43643dcb1 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:17.238104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7430666-be0e-4cdc-bd7b-7e1cb75d5911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:17.238972 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7430666-be0e-4cdc-bd7b-7e1cb75d5911 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:17.238972 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7430666-be0e-4cdc-bd7b-7e1cb75d5911 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:17.239243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7430666-be0e-4cdc-bd7b-7e1cb75d5911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:17.249609 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7430666-be0e-4cdc-bd7b-7e1cb75d5911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:17.251076 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7430666-be0e-4cdc-bd7b-7e1cb75d5911 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:17.266980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-b7430666-be0e-4cdc-bd7b-7e1cb75d5911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:17.266980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:17.266980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:17.266980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:17.266980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:17.266980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:17.266980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:17.266980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:17.266980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:17.266980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:17.266980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:17.266980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:17.266980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:18:17.266980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:18:17.266980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:18:17.266980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:18:17.272192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:17.272192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:17.272192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:17.272192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:17.272192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:17.272192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:17.272192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:17.272192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:17.272192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:17.272192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:17.272192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:17.272192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:17.272192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:17.272192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:17.272192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:17.272192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:17.272192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:18:17.274108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:18:17.274108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:17.274108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:17.274108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 601/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:18:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:17.275180 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f9840-caa8-4808-acb4-0d39d604e007 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:17.374142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:17.376942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f9840-caa8-4808-acb4-0d39d604e007 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:17.411011 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb62eb-2a8b-4b32-84a8-f8f7184f6d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:17.411583 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb62eb-2a8b-4b32-84a8-f8f7184f6d90 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:17.411863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb62eb-2a8b-4b32-84a8-f8f7184f6d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:17.412132 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb62eb-2a8b-4b32-84a8-f8f7184f6d90 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:17.412765 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb62eb-2a8b-4b32-84a8-f8f7184f6d90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:17.413161 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb62eb-2a8b-4b32-84a8-f8f7184f6d90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:17.414961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb62eb-2a8b-4b32-84a8-f8f7184f6d90 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:17.425913 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 610/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:17.432475 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7430666-be0e-4cdc-bd7b-7e1cb75d5911 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:17.533680 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7430666-be0e-4cdc-bd7b-7e1cb75d5911 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:17.535166 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:17.568698 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78277160-3fe6-4f98-9e38-a07ded675152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:17.570012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78277160-3fe6-4f98-9e38-a07ded675152 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:17.570745 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78277160-3fe6-4f98-9e38-a07ded675152 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:17.571021 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78277160-3fe6-4f98-9e38-a07ded675152 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:17.578185 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78277160-3fe6-4f98-9e38-a07ded675152 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:17.579615 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78277160-3fe6-4f98-9e38-a07ded675152 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:17.591336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-78277160-3fe6-4f98-9e38-a07ded675152 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 14:18:17.591336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:17.591336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:17.591336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:17.591336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:17.591336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:17.591336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:17.591336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:17.591336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:17.591336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:17.591336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:17.591336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:17.591336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:18:17.591336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:18:17.591336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:18:17.591336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:18:17.598015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:17.598015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:17.598015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:18:17.598015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:18:17.598015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:18:17.598015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:18:17.598015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:17.598015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:17.598015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:17.598015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:17.598015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:17.598015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:17.598015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:17.598015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:17.598015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:17.598015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:17.598015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:17.598015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:17.599340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:17.599340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:17.599340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:18:17.599340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:18:17.599340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:18:17.599340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:18:17.599340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:18:17.599340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:18:17.599340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 14:18:17.599340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:17.599340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 602/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:18:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:17.600042 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb62eb-2a8b-4b32-84a8-f8f7184f6d90 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:17.699825 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb62eb-2a8b-4b32-84a8-f8f7184f6d90 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:17.732487 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7aded-0791-4c2c-aaa0-c2436fcdacb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:17.733108 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7aded-0791-4c2c-aaa0-c2436fcdacb3 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:17.733390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7aded-0791-4c2c-aaa0-c2436fcdacb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:17.733661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7aded-0791-4c2c-aaa0-c2436fcdacb3 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:17.734382 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7aded-0791-4c2c-aaa0-c2436fcdacb3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:17.734686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7aded-0791-4c2c-aaa0-c2436fcdacb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:17.736122 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7aded-0791-4c2c-aaa0-c2436fcdacb3 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:17.753406 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 611/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Sep 5 14:18:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:17.759889 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78277160-3fe6-4f98-9e38-a07ded675152 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:17.858608 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78277160-3fe6-4f98-9e38-a07ded675152 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:17.891893 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec6fb0-be30-4a0f-a558-b4b440c848b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:17.892489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec6fb0-be30-4a0f-a558-b4b440c848b8 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:17.892764 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec6fb0-be30-4a0f-a558-b4b440c848b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:17.893034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec6fb0-be30-4a0f-a558-b4b440c848b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:17.921923 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:17.958875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec6fb0-be30-4a0f-a558-b4b440c848b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:17.960311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec6fb0-be30-4a0f-a558-b4b440c848b8 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:18.055525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 603/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:18:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 14:18:18.061706 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7aded-0791-4c2c-aaa0-c2436fcdacb3 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:18.080396 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:18.159121 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7aded-0791-4c2c-aaa0-c2436fcdacb3 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:18.217737 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4898065-b70d-414a-9c26-5bfa4c51a064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:18.218000 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4898065-b70d-414a-9c26-5bfa4c51a064 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:18.218280 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4898065-b70d-414a-9c26-5bfa4c51a064 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:18.218553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4898065-b70d-414a-9c26-5bfa4c51a064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:18.229688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4898065-b70d-414a-9c26-5bfa4c51a064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:18.231235 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4898065-b70d-414a-9c26-5bfa4c51a064 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:18.246976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-b4898065-b70d-414a-9c26-5bfa4c51a064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:18.246976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:18.246976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:18.246976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:18.246976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:18.246976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:18.246976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:18.246976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:18.246976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:18.246976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:18.246976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:18.246976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:18.246976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:18:18.246976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:18:18.246976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:18:18.246976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:18:18.248102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:18.248102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:18.248102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:18.248102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:18.248102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:18.248102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:18.248102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:18.248102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:18.248102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:18.248102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:18.248102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:18.248102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:18.248102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:18.248102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:18.248102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:18.248102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:18.248102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:18:18.249023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:18:18.249023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:18.249023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:18:18.249023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 612/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:18:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:18.253808 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec6fb0-be30-4a0f-a558-b4b440c848b8 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:18.315662 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:18.353474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec6fb0-be30-4a0f-a558-b4b440c848b8 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:18.385642 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ecd41-22cf-4208-a4b0-a8d1edfe8641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:18.386237 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ecd41-22cf-4208-a4b0-a8d1edfe8641 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:18.386513 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ecd41-22cf-4208-a4b0-a8d1edfe8641 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:18.386780 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ecd41-22cf-4208-a4b0-a8d1edfe8641 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:18.387406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ecd41-22cf-4208-a4b0-a8d1edfe8641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:18.387704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ecd41-22cf-4208-a4b0-a8d1edfe8641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:18.389099 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ecd41-22cf-4208-a4b0-a8d1edfe8641 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:18.401168 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 604/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:18.412868 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4898065-b70d-414a-9c26-5bfa4c51a064 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:18.478026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:18.508707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4898065-b70d-414a-9c26-5bfa4c51a064 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:18.541687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e198505-78a0-4724-bde4-a6c92b03b695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:18.544495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e198505-78a0-4724-bde4-a6c92b03b695 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:18.544495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e198505-78a0-4724-bde4-a6c92b03b695 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:18.544495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e198505-78a0-4724-bde4-a6c92b03b695 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:18.549872 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e198505-78a0-4724-bde4-a6c92b03b695 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:18.551326 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e198505-78a0-4724-bde4-a6c92b03b695 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:18.562678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-1e198505-78a0-4724-bde4-a6c92b03b695 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:18:18.562678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:18.562678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:18.562678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:18.562678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:18.562678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:18.562678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:18.562678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:18.562678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:18.562678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:18.562678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:18.562678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:18.562678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:18:18.562678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:18:18.562678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:18:18.563759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:18:18.563759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:18.563759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:18.563759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:18.563759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:18.563759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:18.563759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:18.563759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:18.563759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:18.563759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:18.563759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:18.563759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:18.563759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:18.563759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:18.563759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:18.563759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:18.563759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:18.564911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:18:18.564911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:18:18.564911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:18:18.564911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:18:18.564911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:18:18.564911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:18:18.564911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:18:18.564911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:18:18.564911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 613/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:18:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:18.570520 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ecd41-22cf-4208-a4b0-a8d1edfe8641 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:18.671846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ecd41-22cf-4208-a4b0-a8d1edfe8641 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:18.695820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:18.707152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d5eb3-da97-402c-a3df-1b10b17a1d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:18.707776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5eb3-da97-402c-a3df-1b10b17a1d8c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:18.708053 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5eb3-da97-402c-a3df-1b10b17a1d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:18.708328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5eb3-da97-402c-a3df-1b10b17a1d8c None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:18.709000 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d5eb3-da97-402c-a3df-1b10b17a1d8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:18.709333 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d5eb3-da97-402c-a3df-1b10b17a1d8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:18.711520 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d5eb3-da97-402c-a3df-1b10b17a1d8c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:18.722612 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 605/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:18:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:18.728872 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e198505-78a0-4724-bde4-a6c92b03b695 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:18.826537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e198505-78a0-4724-bde4-a6c92b03b695 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:18.855408 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:18.861279 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f5d46-6c1d-4bc0-8f7e-b3336cbf32ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:18.861879 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f5d46-6c1d-4bc0-8f7e-b3336cbf32ee None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:18.862209 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f5d46-6c1d-4bc0-8f7e-b3336cbf32ee None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:18.862477 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f5d46-6c1d-4bc0-8f7e-b3336cbf32ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:18.863194 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f5d46-6c1d-4bc0-8f7e-b3336cbf32ee None admin] RBAC: Adding query filter params (role.id=5351e6d174334a8eaf71e8d2b3c079a7, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=c1880dab32fa424a9356b3fe940d4856) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:18.863497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f5d46-6c1d-4bc0-8f7e-b3336cbf32ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:18.864924 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f5d46-6c1d-4bc0-8f7e-b3336cbf32ee None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:18.870423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 614/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:18:18 2022] GET /identity/v3/role_assignments?user.id=c1880dab32fa424a9356b3fe940d4856&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=5351e6d174334a8eaf71e8d2b3c079a7 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:20.764004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d01f99-29b5-4b9a-8b02-ba627f67bb32 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:20.764549 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d01f99-29b5-4b9a-8b02-ba627f67bb32 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:20.764549 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d01f99-29b5-4b9a-8b02-ba627f67bb32 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:20.765911 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 606/1220] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:18:20.771047 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e636ba6-2bcc-4ede-98c1-2ac8985b46c6 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:20.771451 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e636ba6-2bcc-4ede-98c1-2ac8985b46c6 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:20.771594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e636ba6-2bcc-4ede-98c1-2ac8985b46c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:20.790861 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-4e636ba6-2bcc-4ede-98c1-2ac8985b46c6 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:18:20.792043 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4e636ba6-2bcc-4ede-98c1-2ac8985b46c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:18:20.857840 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 615/1221] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:18:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:18:21.135075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d01f99-29b5-4b9a-8b02-ba627f67bb32 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:21.239151 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d01f99-29b5-4b9a-8b02-ba627f67bb32 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:21.274516 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42efe3-4657-4e72-9424-87120f4138fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:21.275128 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42efe3-4657-4e72-9424-87120f4138fc None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:21.275405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42efe3-4657-4e72-9424-87120f4138fc None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:21.275675 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42efe3-4657-4e72-9424-87120f4138fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:21.285504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42efe3-4657-4e72-9424-87120f4138fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:18:21.291362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-4a42efe3-4657-4e72-9424-87120f4138fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:18:21.291362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:21.291362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:21.291362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:21.291362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:21.291362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:21.291362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:21.291362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:21.291362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:21.291362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:21.291362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:21.291362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:21.291362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:18:21.291362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:18:21.291362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:18:21.291362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:18:21.292476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:18:21.292476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:18:21.292476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:18:21.292476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:18:21.292476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:21.292476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:21.292476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:21.292476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:21.292476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:21.292476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:21.292476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:21.292476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:21.292476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:21.292476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:21.292476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:21.292476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:21.293689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:21.293689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:21.293689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:21.293689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:21.293689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:18:21.293689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:18:21.293689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:18:21.293689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:18:21.293689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:18:21.293689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:18:21.293689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:18:21.293689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:21.293689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 607/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:18:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:21.298512 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e636ba6-2bcc-4ede-98c1-2ac8985b46c6 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:21.399408 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e636ba6-2bcc-4ede-98c1-2ac8985b46c6 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:21.422625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:21.434208 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740b997-c6f8-449d-a644-3e338b9a05fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:21.434806 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740b997-c6f8-449d-a644-3e338b9a05fd None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:21.435081 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740b997-c6f8-449d-a644-3e338b9a05fd None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:21.435351 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740b997-c6f8-449d-a644-3e338b9a05fd None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:21.436002 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740b997-c6f8-449d-a644-3e338b9a05fd None admin] RBAC: Adding query filter params (name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:21.436307 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740b997-c6f8-449d-a644-3e338b9a05fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:21.437710 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740b997-c6f8-449d-a644-3e338b9a05fd None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:21.445463 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 616/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 5 14:18:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:21.451219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42efe3-4657-4e72-9424-87120f4138fc None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:21.496132 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:21.552421 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42efe3-4657-4e72-9424-87120f4138fc None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:21.586716 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06dd48-2499-4af9-b86d-8283ce0654be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:21.587325 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06dd48-2499-4af9-b86d-8283ce0654be None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:21.587604 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06dd48-2499-4af9-b86d-8283ce0654be None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:21.587874 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06dd48-2499-4af9-b86d-8283ce0654be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:21.597355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06dd48-2499-4af9-b86d-8283ce0654be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:21.598781 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06dd48-2499-4af9-b86d-8283ce0654be None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:21.613630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-0b06dd48-2499-4af9-b86d-8283ce0654be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:21.613630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:21.613630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:21.613630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:21.613630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:21.613630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:21.613630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:21.613630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:21.613630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:21.613630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:21.613630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:21.613630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:21.613630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:18:21.613630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:18:21.613630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:18:21.613630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:18:21.614633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:21.614633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:21.614633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:21.614633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:21.614633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:21.614633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:21.614633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:21.614633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:21.614633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:21.614633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:21.614633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:21.614633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:21.614633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:21.614633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:21.614633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:21.614633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:21.614633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:18:21.615821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:18:21.615821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:21.615821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:21.615821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 608/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:18:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:21.620857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740b997-c6f8-449d-a644-3e338b9a05fd None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:21.721964 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740b997-c6f8-449d-a644-3e338b9a05fd None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:21.755019 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830baf3-b8a3-4c86-89d4-093799e37f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:21.755628 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830baf3-b8a3-4c86-89d4-093799e37f2e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:21.755907 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830baf3-b8a3-4c86-89d4-093799e37f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:21.756213 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830baf3-b8a3-4c86-89d4-093799e37f2e None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:21.756881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830baf3-b8a3-4c86-89d4-093799e37f2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:21.757310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830baf3-b8a3-4c86-89d4-093799e37f2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:21.758739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830baf3-b8a3-4c86-89d4-093799e37f2e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:21.771301 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 617/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:18:21.777743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06dd48-2499-4af9-b86d-8283ce0654be None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:21.870244 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:21.876652 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06dd48-2499-4af9-b86d-8283ce0654be None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:21.909835 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4707bb-c506-41d4-8fa1-614b8cd994de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:21.910447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4707bb-c506-41d4-8fa1-614b8cd994de None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:21.910723 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4707bb-c506-41d4-8fa1-614b8cd994de None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:21.910991 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4707bb-c506-41d4-8fa1-614b8cd994de None admin] PATH_INFO: `/v3/users/placement` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:21.918601 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4707bb-c506-41d4-8fa1-614b8cd994de None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:21.920106 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4707bb-c506-41d4-8fa1-614b8cd994de None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:21.931793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-bc4707bb-c506-41d4-8fa1-614b8cd994de None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 14:18:21.931793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:21.931793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:21.931793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:21.931793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:21.931793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:21.931793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:21.931793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:21.931793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:21.931793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:21.931793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:21.931793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:21.931793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:18:21.931793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:18:21.931793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:18:21.931793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:18:21.932832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:21.932832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:21.932832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:18:21.932832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:18:21.932832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:18:21.932832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:18:21.932832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:21.932832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:21.932832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:21.932832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:21.932832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:21.932832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:21.932832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:21.932832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:21.932832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:21.932832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:21.932832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:21.932832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:21.933872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:21.933872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:21.933872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:18:21.933872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:18:21.933872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:18:21.933872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:18:21.933872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:18:21.933872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:18:21.933872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 14:18:21.933872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:21.933872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 609/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:18:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:18:21.938701 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830baf3-b8a3-4c86-89d4-093799e37f2e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:21.985243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:22.036914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830baf3-b8a3-4c86-89d4-093799e37f2e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:22.070357 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb5a82-96a2-41db-afea-88a1f3a495d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:22.071161 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb5a82-96a2-41db-afea-88a1f3a495d2 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:22.071443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb5a82-96a2-41db-afea-88a1f3a495d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:22.071714 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb5a82-96a2-41db-afea-88a1f3a495d2 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:22.072429 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb5a82-96a2-41db-afea-88a1f3a495d2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:22.072732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb5a82-96a2-41db-afea-88a1f3a495d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:22.074205 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cb5a82-96a2-41db-afea-88a1f3a495d2 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:22.090972 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 618/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Sep 5 14:18:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:22.096725 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4707bb-c506-41d4-8fa1-614b8cd994de None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:22.196232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4707bb-c506-41d4-8fa1-614b8cd994de None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:22.230664 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc484d-1d7e-44c5-ae7f-9ae1fe590966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:22.231267 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc484d-1d7e-44c5-ae7f-9ae1fe590966 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:22.231544 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc484d-1d7e-44c5-ae7f-9ae1fe590966 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:22.232206 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc484d-1d7e-44c5-ae7f-9ae1fe590966 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:22.242203 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc484d-1d7e-44c5-ae7f-9ae1fe590966 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:22.243584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc484d-1d7e-44c5-ae7f-9ae1fe590966 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:22.257749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-10cc484d-1d7e-44c5-ae7f-9ae1fe590966 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:22.257749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:22.257749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:22.257749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:22.257749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:22.257749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:22.257749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:22.257749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:22.257749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:22.257749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:22.257749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:22.257749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:22.257749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:18:22.257749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:18:22.257749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:18:22.257749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:18:22.258776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:22.258776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:22.258776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:22.258776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:22.258776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:22.258776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:22.258776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:22.258776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:22.258776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:22.258776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:22.258776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:22.258776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:22.258776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:22.258776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:22.258776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:22.258776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:22.258776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:18:22.259863 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:18:22.259863 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:22.259863 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:22.259863 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 610/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:18:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:22.264652 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb5a82-96a2-41db-afea-88a1f3a495d2 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:22.364583 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb5a82-96a2-41db-afea-88a1f3a495d2 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:22.367526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:22.398052 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42401948-9b71-4b2b-a264-c71c18e47a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:22.398658 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42401948-9b71-4b2b-a264-c71c18e47a96 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:22.399825 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42401948-9b71-4b2b-a264-c71c18e47a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:22.399825 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42401948-9b71-4b2b-a264-c71c18e47a96 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:22.399825 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42401948-9b71-4b2b-a264-c71c18e47a96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:22.400096 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42401948-9b71-4b2b-a264-c71c18e47a96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:22.401502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42401948-9b71-4b2b-a264-c71c18e47a96 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:22.412170 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 619/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:22.417971 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc484d-1d7e-44c5-ae7f-9ae1fe590966 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:22.427566 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:22.517160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc484d-1d7e-44c5-ae7f-9ae1fe590966 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:22.549336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04876f3f-32db-45e4-af6b-05164354c93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:22.550219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04876f3f-32db-45e4-af6b-05164354c93b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:22.550497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04876f3f-32db-45e4-af6b-05164354c93b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:22.550769 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04876f3f-32db-45e4-af6b-05164354c93b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:22.558731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04876f3f-32db-45e4-af6b-05164354c93b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:22.560160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04876f3f-32db-45e4-af6b-05164354c93b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:22.571339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-04876f3f-32db-45e4-af6b-05164354c93b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:18:22.571339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:22.571339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:22.571339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:22.571339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:22.571339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:22.571339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:22.571339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:22.571339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:22.571339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:22.571339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:22.571339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:22.571339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:18:22.571339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:18:22.571339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:18:22.572400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:18:22.572400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:22.572400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:22.572400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:22.572400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:22.572400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:22.572400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:22.572400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:22.572400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:22.572400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:22.572400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:22.572400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:22.572400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:22.572400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:22.572400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:22.572400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:22.572400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:22.573377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:18:22.573377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:18:22.573377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:18:22.573377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:18:22.573377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:18:22.573377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:18:22.573377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:18:22.573377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:22.573377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 611/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:18:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:22.578347 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42401948-9b71-4b2b-a264-c71c18e47a96 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:22.679223 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42401948-9b71-4b2b-a264-c71c18e47a96 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:22.713643 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ae862-3b11-4f7a-bc1d-f13114cd535c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:22.714242 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ae862-3b11-4f7a-bc1d-f13114cd535c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:22.714520 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ae862-3b11-4f7a-bc1d-f13114cd535c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:22.714789 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ae862-3b11-4f7a-bc1d-f13114cd535c None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:22.715473 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ae862-3b11-4f7a-bc1d-f13114cd535c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:22.715774 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ae862-3b11-4f7a-bc1d-f13114cd535c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:22.717399 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ae862-3b11-4f7a-bc1d-f13114cd535c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:22.729166 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 620/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:18:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:22.735257 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04876f3f-32db-45e4-af6b-05164354c93b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:22.800680 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:22.833780 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04876f3f-32db-45e4-af6b-05164354c93b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:22.865885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38bb24-49cc-4643-8713-a541db48e765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:22.866622 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38bb24-49cc-4643-8713-a541db48e765 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:22.866977 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38bb24-49cc-4643-8713-a541db48e765 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:22.867252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38bb24-49cc-4643-8713-a541db48e765 None admin] PATH_INFO: `/v3/projects/975f49bcc95643fe876cc03d0d731423/users/c1880dab32fa424a9356b3fe940d4856/roles/5351e6d174334a8eaf71e8d2b3c079a7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:22.881334 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38bb24-49cc-4643-8713-a541db48e765 None admin] RBAC: Authorizing `identity:create_grant(project_id=975f49bcc95643fe876cc03d0d731423, user_id=c1880dab32fa424a9356b3fe940d4856, role_id=5351e6d174334a8eaf71e8d2b3c079a7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:22.883594 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38bb24-49cc-4643-8713-a541db48e765 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:22.968731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 612/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:18:22 2022] PUT /identity/v3/projects/975f49bcc95643fe876cc03d0d731423/users/c1880dab32fa424a9356b3fe940d4856/roles/5351e6d174334a8eaf71e8d2b3c079a7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:18:24.908423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac28cef-567e-4fed-be9d-2e91a83607b8 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:24.908973 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac28cef-567e-4fed-be9d-2e91a83607b8 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:24.908973 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac28cef-567e-4fed-be9d-2e91a83607b8 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:24.910384 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 621/1233] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:18:24.916455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca65830-f4e0-467f-9f9d-ace29f878d6a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:24.916879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca65830-f4e0-467f-9f9d-ace29f878d6a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:24.916990 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca65830-f4e0-467f-9f9d-ace29f878d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:24.935253 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5ca65830-f4e0-467f-9f9d-ace29f878d6a None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:18:24.936491 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5ca65830-f4e0-467f-9f9d-ace29f878d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:18:25.001991 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 613/1234] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:18:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 14:18:25.274614 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac28cef-567e-4fed-be9d-2e91a83607b8 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:25.300128 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:25.375960 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac28cef-567e-4fed-be9d-2e91a83607b8 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:25.411172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9d003-e13c-44bf-889b-e549d03b31a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:25.411791 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9d003-e13c-44bf-889b-e549d03b31a8 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:25.412071 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9d003-e13c-44bf-889b-e549d03b31a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:25.412344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9d003-e13c-44bf-889b-e549d03b31a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:25.422904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9d003-e13c-44bf-889b-e549d03b31a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:18:25.427923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-24d9d003-e13c-44bf-889b-e549d03b31a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:18:25.427923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:25.427923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:25.427923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:25.427923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:25.427923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:25.427923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:25.427923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:25.427923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:25.427923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:25.427923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:25.427923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:25.427923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:18:25.427923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:18:25.427923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:18:25.427923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:18:25.429036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:18:25.429036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:18:25.429036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:18:25.429036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:18:25.429036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:25.429036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:25.429036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:25.429036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:25.429036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:25.429036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:25.429036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:25.429036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:25.429036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:25.429036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:25.429036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:25.429036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:25.430026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:25.430026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:25.430026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:25.430026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:25.430026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:18:25.430026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:18:25.430026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:18:25.430026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:18:25.430026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:18:25.430026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:18:25.430026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 14:18:25.430026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:18:25.430026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 622/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Sep 5 14:18:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:25.435225 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca65830-f4e0-467f-9f9d-ace29f878d6a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:25.481216 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:25.533063 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca65830-f4e0-467f-9f9d-ace29f878d6a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:25.566235 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e287ab-347a-471c-9dad-68a4f0f9e4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:25.566835 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e287ab-347a-471c-9dad-68a4f0f9e4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:25.567116 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e287ab-347a-471c-9dad-68a4f0f9e4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:25.567449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e287ab-347a-471c-9dad-68a4f0f9e4a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:25.568313 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e287ab-347a-471c-9dad-68a4f0f9e4a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:25.568832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e287ab-347a-471c-9dad-68a4f0f9e4a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:25.570921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e287ab-347a-471c-9dad-68a4f0f9e4a1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:25.578595 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 614/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Sep 5 14:18:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:25.584320 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9d003-e13c-44bf-889b-e549d03b31a8 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:25.673622 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:25.690428 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9d003-e13c-44bf-889b-e549d03b31a8 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:25.724004 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59b715-0b06-4e6e-a517-98a5f3aa47e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:25.724625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59b715-0b06-4e6e-a517-98a5f3aa47e6 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:25.724898 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59b715-0b06-4e6e-a517-98a5f3aa47e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:25.725210 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59b715-0b06-4e6e-a517-98a5f3aa47e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:25.734970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59b715-0b06-4e6e-a517-98a5f3aa47e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:25.736410 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59b715-0b06-4e6e-a517-98a5f3aa47e6 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:25.750337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-1e59b715-0b06-4e6e-a517-98a5f3aa47e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:25.750337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:25.750337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:25.750337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:25.750337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:25.750337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:25.750337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:25.750337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:25.750337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:25.750337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:25.750337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:25.750337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:25.750337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:18:25.750337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:18:25.750337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:18:25.750337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:18:25.751523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:25.751523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:25.751523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:25.751523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:25.751523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:25.751523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:25.751523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:25.751523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:25.751523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:25.751523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:25.751523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:25.751523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:25.751523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:25.751523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:25.751523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:25.751523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:25.751523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:18:25.752744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:18:25.752744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:25.752744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:18:25.752744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 623/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:18:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:25.758036 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e287ab-347a-471c-9dad-68a4f0f9e4a1 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:25.856787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e287ab-347a-471c-9dad-68a4f0f9e4a1 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:25.865571 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:25.891353 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d7fc8-6218-4173-a8d3-86d5a38d35ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:25.895678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d7fc8-6218-4173-a8d3-86d5a38d35ef None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:25.895678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d7fc8-6218-4173-a8d3-86d5a38d35ef None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:25.895678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d7fc8-6218-4173-a8d3-86d5a38d35ef None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:25.895678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d7fc8-6218-4173-a8d3-86d5a38d35ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:25.895678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d7fc8-6218-4173-a8d3-86d5a38d35ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:25.895678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d7fc8-6218-4173-a8d3-86d5a38d35ef None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:25.906790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 615/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:25.912479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59b715-0b06-4e6e-a517-98a5f3aa47e6 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:26.013021 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59b715-0b06-4e6e-a517-98a5f3aa47e6 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:26.046570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410e4ac-bdb0-40c6-846f-c0ee27c9599f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:26.047193 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410e4ac-bdb0-40c6-846f-c0ee27c9599f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:26.047521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410e4ac-bdb0-40c6-846f-c0ee27c9599f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:26.047801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410e4ac-bdb0-40c6-846f-c0ee27c9599f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:26.050759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:26.056314 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410e4ac-bdb0-40c6-846f-c0ee27c9599f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:26.057811 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410e4ac-bdb0-40c6-846f-c0ee27c9599f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:26.068590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-0410e4ac-bdb0-40c6-846f-c0ee27c9599f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 14:18:26.068590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:26.068590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:26.068590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:26.068590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:26.068590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:26.068590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:26.068590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:26.068590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:26.068590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:26.068590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:26.068590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:26.068590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:18:26.068590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:18:26.068590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:18:26.068590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:18:26.070465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:26.070465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:26.070465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:18:26.070465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:18:26.070465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:18:26.070465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:18:26.070465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:26.070465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:26.070465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:26.070465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:26.070465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:26.070465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:26.070465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:26.070465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:26.070465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:26.070465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:26.070465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:26.070465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:26.071571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:26.071571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:26.071571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:18:26.071571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:18:26.071571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:18:26.071571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:18:26.071571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:18:26.071571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:18:26.071571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 14:18:26.071571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:18:26.071571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 624/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:18:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:26.076276 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d7fc8-6218-4173-a8d3-86d5a38d35ef None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:26.173072 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d7fc8-6218-4173-a8d3-86d5a38d35ef None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:26.207539 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19aa9f-1692-42ea-a3da-eb3736a0d29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:26.208170 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19aa9f-1692-42ea-a3da-eb3736a0d29c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:26.208447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19aa9f-1692-42ea-a3da-eb3736a0d29c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:26.208715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19aa9f-1692-42ea-a3da-eb3736a0d29c None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:26.209492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19aa9f-1692-42ea-a3da-eb3736a0d29c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:26.210419 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19aa9f-1692-42ea-a3da-eb3736a0d29c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:26.211837 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19aa9f-1692-42ea-a3da-eb3736a0d29c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:26.228695 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 616/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Sep 5 14:18:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:26.234826 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410e4ac-bdb0-40c6-846f-c0ee27c9599f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:26.335659 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410e4ac-bdb0-40c6-846f-c0ee27c9599f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:26.368433 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf646f-72f4-4d70-9389-becd462d1268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:26.369028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf646f-72f4-4d70-9389-becd462d1268 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:26.369337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf646f-72f4-4d70-9389-becd462d1268 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:26.369604 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf646f-72f4-4d70-9389-becd462d1268 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:26.437252 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:26.443666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf646f-72f4-4d70-9389-becd462d1268 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:26.445239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf646f-72f4-4d70-9389-becd462d1268 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:26.540930 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 625/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:18:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 14:18:26.546795 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19aa9f-1692-42ea-a3da-eb3736a0d29c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:26.579163 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:26.652770 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19aa9f-1692-42ea-a3da-eb3736a0d29c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:26.688733 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b647b36-c82c-4beb-ba24-a01388ae78be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:26.689319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b647b36-c82c-4beb-ba24-a01388ae78be None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:26.689604 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b647b36-c82c-4beb-ba24-a01388ae78be None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:26.689874 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b647b36-c82c-4beb-ba24-a01388ae78be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:26.703722 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b647b36-c82c-4beb-ba24-a01388ae78be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:26.705265 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b647b36-c82c-4beb-ba24-a01388ae78be None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:26.720160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-8b647b36-c82c-4beb-ba24-a01388ae78be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:26.720160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:26.720160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:26.720160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:26.720160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:26.720160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:26.720160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:26.720160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:26.720160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:26.720160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:26.720160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:26.720160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:26.720160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:18:26.720160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:18:26.720160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:18:26.720160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:18:26.721319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:26.721319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:26.721319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:26.721319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:26.721319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:26.721319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:26.721319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:26.721319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:26.721319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:26.721319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:26.721319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:26.721319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:26.721319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:26.721319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:26.721319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:26.721319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:26.721319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:18:26.722376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:18:26.722376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:26.722376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:26.722376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 617/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:26.727618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf646f-72f4-4d70-9389-becd462d1268 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:26.819382 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:26.824997 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf646f-72f4-4d70-9389-becd462d1268 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:26.858875 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493dab7-1b07-4fe0-874a-a8ffada2b6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:26.859465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493dab7-1b07-4fe0-874a-a8ffada2b6f9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:26.859739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493dab7-1b07-4fe0-874a-a8ffada2b6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:26.860011 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493dab7-1b07-4fe0-874a-a8ffada2b6f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:26.860638 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493dab7-1b07-4fe0-874a-a8ffada2b6f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:26.860934 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493dab7-1b07-4fe0-874a-a8ffada2b6f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:26.862321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493dab7-1b07-4fe0-874a-a8ffada2b6f9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:26.872934 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 626/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:26.878642 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b647b36-c82c-4beb-ba24-a01388ae78be None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:26.957984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:26.979576 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b647b36-c82c-4beb-ba24-a01388ae78be None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:27.012150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0171db-14c8-4a14-8de7-baef47581cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:27.012767 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0171db-14c8-4a14-8de7-baef47581cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:27.013045 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0171db-14c8-4a14-8de7-baef47581cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:27.013394 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0171db-14c8-4a14-8de7-baef47581cc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:27.019784 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0171db-14c8-4a14-8de7-baef47581cc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:27.021261 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0171db-14c8-4a14-8de7-baef47581cc5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:27.033100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-ee0171db-14c8-4a14-8de7-baef47581cc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:18:27.033100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:27.033100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:27.033100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:27.033100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:27.033100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:27.033100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:27.033100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:27.033100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:27.033100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:27.033100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:27.033100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:27.033100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:18:27.033100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:18:27.033100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:18:27.042406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:18:27.042406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:27.042406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:27.042406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:27.042406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:27.042406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:27.042406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:27.042406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:27.042406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:27.042406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:27.042406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:27.042406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:27.042406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:27.042406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:27.042406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:27.042406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:27.042406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:27.043530 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:18:27.043530 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:18:27.043530 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:18:27.043530 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:18:27.043530 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:18:27.043530 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:18:27.043530 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:18:27.043530 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:27.043530 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 618/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:18:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:27.044151 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493dab7-1b07-4fe0-874a-a8ffada2b6f9 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:27.138399 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493dab7-1b07-4fe0-874a-a8ffada2b6f9 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:27.171742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3614e1-6d7c-4538-a837-4d52016378c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:27.172344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3614e1-6d7c-4538-a837-4d52016378c0 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:27.172611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3614e1-6d7c-4538-a837-4d52016378c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:27.172878 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3614e1-6d7c-4538-a837-4d52016378c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:27.173592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3614e1-6d7c-4538-a837-4d52016378c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:27.173894 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3614e1-6d7c-4538-a837-4d52016378c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:27.175640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3614e1-6d7c-4538-a837-4d52016378c0 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:27.187629 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 627/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:18:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:27.193738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0171db-14c8-4a14-8de7-baef47581cc5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:27.295207 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0171db-14c8-4a14-8de7-baef47581cc5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:27.328240 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90103cbd-6fa7-41fe-b9d8-4736f0a27759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:27.328830 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90103cbd-6fa7-41fe-b9d8-4736f0a27759 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:27.329136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90103cbd-6fa7-41fe-b9d8-4736f0a27759 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:27.329405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90103cbd-6fa7-41fe-b9d8-4736f0a27759 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:27.330157 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90103cbd-6fa7-41fe-b9d8-4736f0a27759 None admin] RBAC: Adding query filter params (role.id=5351e6d174334a8eaf71e8d2b3c079a7, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=c1880dab32fa424a9356b3fe940d4856) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:27.335473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90103cbd-6fa7-41fe-b9d8-4736f0a27759 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:27.335473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90103cbd-6fa7-41fe-b9d8-4736f0a27759 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:27.338366 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 619/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:18:27 2022] GET /identity/v3/role_assignments?user.id=c1880dab32fa424a9356b3fe940d4856&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=5351e6d174334a8eaf71e8d2b3c079a7 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:29.282732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3524a-a98b-4d5b-8ace-f85926876c7d None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:29.283403 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3524a-a98b-4d5b-8ace-f85926876c7d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:29.283403 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3524a-a98b-4d5b-8ace-f85926876c7d None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:29.284708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 628/1247] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:18:29.289764 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cce1b-1da2-42cb-a484-9ee3b6188daf None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:29.290159 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cce1b-1da2-42cb-a484-9ee3b6188daf None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:29.290313 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cce1b-1da2-42cb-a484-9ee3b6188daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:29.296517 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:29.309396 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c03cce1b-1da2-42cb-a484-9ee3b6188daf None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:18:29.310566 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c03cce1b-1da2-42cb-a484-9ee3b6188daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:18:29.376903 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 620/1248] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:18:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:18:29.642298 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3524a-a98b-4d5b-8ace-f85926876c7d None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:29.660650 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:29.747839 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3524a-a98b-4d5b-8ace-f85926876c7d None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:29.782789 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f47a89-72d2-42ae-874b-dd12fa93b077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:29.783415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f47a89-72d2-42ae-874b-dd12fa93b077 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:29.783695 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f47a89-72d2-42ae-874b-dd12fa93b077 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:29.783989 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f47a89-72d2-42ae-874b-dd12fa93b077 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:29.794530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f47a89-72d2-42ae-874b-dd12fa93b077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:18:29.799358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-36f47a89-72d2-42ae-874b-dd12fa93b077 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:18:29.799358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:29.799358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:29.799358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:29.799358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:29.799358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:29.799358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:29.799358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:29.799358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:29.799358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:29.799358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:29.799358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:29.799358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:18:29.799358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:18:29.799358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:18:29.799358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:18:29.800620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:18:29.800620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:18:29.800620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:18:29.800620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:18:29.800620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:29.800620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:29.800620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:29.800620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:29.800620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:29.800620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:29.800620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:29.800620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:29.800620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:29.800620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:29.800620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:29.800620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:29.801530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:29.801530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:29.801530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:29.801530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:29.801530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:18:29.801530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:18:29.801530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:18:29.801530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:18:29.801530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:18:29.801530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:18:29.801530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:18:29.801530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:18:29.801530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 629/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:18:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:29.807958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cce1b-1da2-42cb-a484-9ee3b6188daf None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:29.902061 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cce1b-1da2-42cb-a484-9ee3b6188daf None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:29.930724 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:29.935328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f4c90-a70c-4513-9dab-b456ce51af45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:29.935916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f4c90-a70c-4513-9dab-b456ce51af45 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:29.936190 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f4c90-a70c-4513-9dab-b456ce51af45 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:29.936457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f4c90-a70c-4513-9dab-b456ce51af45 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:29.937128 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f4c90-a70c-4513-9dab-b456ce51af45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:29.937430 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f4c90-a70c-4513-9dab-b456ce51af45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:29.938789 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f4c90-a70c-4513-9dab-b456ce51af45 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:29.946701 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 621/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:18:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:29.952512 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f47a89-72d2-42ae-874b-dd12fa93b077 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:30.041590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:30.064190 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f47a89-72d2-42ae-874b-dd12fa93b077 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:30.097941 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2030f-f55a-4538-afd4-f5a0dee2c1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:30.098607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2030f-f55a-4538-afd4-f5a0dee2c1af None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:30.098884 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2030f-f55a-4538-afd4-f5a0dee2c1af None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:30.099162 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2030f-f55a-4538-afd4-f5a0dee2c1af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:30.110404 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2030f-f55a-4538-afd4-f5a0dee2c1af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:30.111891 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2030f-f55a-4538-afd4-f5a0dee2c1af None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:30.126456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-53e2030f-f55a-4538-afd4-f5a0dee2c1af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:30.126456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:30.126456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:30.126456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:30.126456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:30.126456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:30.126456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:30.126456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:30.126456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:30.126456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:30.126456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:30.126456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:30.126456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:18:30.126456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:18:30.126456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:18:30.126456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:18:30.127516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:30.127516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:30.127516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:30.127516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:30.127516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:30.127516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:30.127516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:30.127516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:30.127516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:30.127516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:30.127516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:30.127516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:30.127516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:30.127516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:30.127516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:30.127516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:30.127516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:18:30.128623 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:18:30.128623 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:30.128623 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:18:30.128623 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 630/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:18:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:30.133557 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f4c90-a70c-4513-9dab-b456ce51af45 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:30.231509 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f4c90-a70c-4513-9dab-b456ce51af45 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:30.264285 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea3cb8-7e0e-4edd-83d5-631e817ec1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:30.264876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea3cb8-7e0e-4edd-83d5-631e817ec1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:30.265178 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea3cb8-7e0e-4edd-83d5-631e817ec1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:30.265450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea3cb8-7e0e-4edd-83d5-631e817ec1e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:30.266076 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea3cb8-7e0e-4edd-83d5-631e817ec1e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:30.266376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea3cb8-7e0e-4edd-83d5-631e817ec1e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:30.267723 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea3cb8-7e0e-4edd-83d5-631e817ec1e6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:30.279653 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 622/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:30.285482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2030f-f55a-4538-afd4-f5a0dee2c1af None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:30.394817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2030f-f55a-4538-afd4-f5a0dee2c1af None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:30.420628 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:30.428483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c25ce4-f0f2-481e-8306-130b6bc06e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:30.429140 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c25ce4-f0f2-481e-8306-130b6bc06e66 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:30.429420 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c25ce4-f0f2-481e-8306-130b6bc06e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:30.433777 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c25ce4-f0f2-481e-8306-130b6bc06e66 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:30.437657 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c25ce4-f0f2-481e-8306-130b6bc06e66 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:30.439082 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c25ce4-f0f2-481e-8306-130b6bc06e66 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:30.450425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-32c25ce4-f0f2-481e-8306-130b6bc06e66 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 14:18:30.450425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:30.450425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:30.450425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:30.450425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:30.450425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:30.450425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:30.450425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:30.450425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:30.450425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:30.450425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:30.450425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:30.450425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:18:30.450425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:18:30.450425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:18:30.450425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:18:30.451549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:30.451549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:30.451549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:18:30.451549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:18:30.451549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:18:30.451549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:18:30.451549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:30.451549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:30.451549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:30.451549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:30.451549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:30.451549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:30.451549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:30.451549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:30.451549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:30.451549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:30.451549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:30.451549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:30.452723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:30.452723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:30.452723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:18:30.452723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:18:30.452723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:18:30.452723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:18:30.452723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:18:30.452723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:18:30.452723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 14:18:30.452723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:18:30.452723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 631/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:18:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:30.457450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea3cb8-7e0e-4edd-83d5-631e817ec1e6 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:30.513706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:30.558725 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea3cb8-7e0e-4edd-83d5-631e817ec1e6 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:30.592655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1d002-e86f-434a-9611-3ea50b8415ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:30.593325 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1d002-e86f-434a-9611-3ea50b8415ac None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:30.593605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1d002-e86f-434a-9611-3ea50b8415ac None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:30.593875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1d002-e86f-434a-9611-3ea50b8415ac None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:30.594588 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1d002-e86f-434a-9611-3ea50b8415ac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:30.594890 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1d002-e86f-434a-9611-3ea50b8415ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:30.596321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1d002-e86f-434a-9611-3ea50b8415ac None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:30.613326 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 623/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Sep 5 14:18:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:30.619632 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c25ce4-f0f2-481e-8306-130b6bc06e66 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:30.723579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c25ce4-f0f2-481e-8306-130b6bc06e66 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:30.756184 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f3848-7cff-4815-87af-51b7754d87ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:30.757532 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f3848-7cff-4815-87af-51b7754d87ab None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:30.757806 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f3848-7cff-4815-87af-51b7754d87ab None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:30.758072 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f3848-7cff-4815-87af-51b7754d87ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:30.811687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:30.824615 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f3848-7cff-4815-87af-51b7754d87ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:30.826095 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f3848-7cff-4815-87af-51b7754d87ab None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:30.922333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 632/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:18:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 14:18:30.929211 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1d002-e86f-434a-9611-3ea50b8415ac None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:31.030280 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1d002-e86f-434a-9611-3ea50b8415ac None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:31.043584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:31.064675 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed1899-8690-4ad0-b372-ef68c9eaf938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:31.065260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed1899-8690-4ad0-b372-ef68c9eaf938 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:31.065539 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed1899-8690-4ad0-b372-ef68c9eaf938 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:31.065809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed1899-8690-4ad0-b372-ef68c9eaf938 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:31.075447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed1899-8690-4ad0-b372-ef68c9eaf938 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:31.076868 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed1899-8690-4ad0-b372-ef68c9eaf938 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:31.090833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-c8ed1899-8690-4ad0-b372-ef68c9eaf938 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:31.090833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:31.090833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:31.090833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:31.090833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:31.090833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:31.090833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:31.090833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:31.090833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:31.090833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:31.090833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:31.090833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:31.090833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:18:31.090833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:18:31.090833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:18:31.090833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:18:31.096541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:31.096541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:31.096541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:31.096541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:31.096541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:31.096541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:31.096541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:31.096541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:31.096541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:31.096541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:31.096541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:31.096541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:31.096541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:31.096541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:31.096541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:31.096541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:31.096541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:18:31.097756 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:18:31.097756 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:31.097756 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:31.097756 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 624/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:31.098022 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f3848-7cff-4815-87af-51b7754d87ab None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:31.183397 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:31.194964 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f3848-7cff-4815-87af-51b7754d87ab None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:31.228148 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7ce2c-aa12-437d-9b78-80546acdb630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:31.228753 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7ce2c-aa12-437d-9b78-80546acdb630 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:31.229030 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7ce2c-aa12-437d-9b78-80546acdb630 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:31.229326 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7ce2c-aa12-437d-9b78-80546acdb630 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:31.229962 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7ce2c-aa12-437d-9b78-80546acdb630 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:31.230259 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7ce2c-aa12-437d-9b78-80546acdb630 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:31.231627 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7ce2c-aa12-437d-9b78-80546acdb630 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:31.243226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 633/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:18:31.248863 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed1899-8690-4ad0-b372-ef68c9eaf938 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:31.351881 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed1899-8690-4ad0-b372-ef68c9eaf938 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:31.384142 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133a286-b369-449b-99f0-8c79d906717d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:31.384785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133a286-b369-449b-99f0-8c79d906717d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:31.385078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133a286-b369-449b-99f0-8c79d906717d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:31.385357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133a286-b369-449b-99f0-8c79d906717d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:31.392011 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133a286-b369-449b-99f0-8c79d906717d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:31.393525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133a286-b369-449b-99f0-8c79d906717d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:31.405426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-0133a286-b369-449b-99f0-8c79d906717d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:18:31.405426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:31.405426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:31.405426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:31.405426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:31.405426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:31.405426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:31.405426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:31.405426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:31.405426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:31.405426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:31.405426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:31.405426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:18:31.405426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:18:31.405426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:18:31.407736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:18:31.407736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:31.407736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:31.407736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:31.407736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:31.407736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:31.407736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:31.407736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:31.407736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:31.407736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:31.407736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:31.407736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:31.407736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:31.407736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:31.407736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:31.407736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:31.407736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:31.408836 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:18:31.408836 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:18:31.408836 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:18:31.408836 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:18:31.408836 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:18:31.408836 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:18:31.408836 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:18:31.408836 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:31.408836 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 625/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:18:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:31.413642 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7ce2c-aa12-437d-9b78-80546acdb630 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:31.513767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7ce2c-aa12-437d-9b78-80546acdb630 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:31.546743 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10e2d6-a307-4fbf-afc9-9d86b5f8ee12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:31.547336 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10e2d6-a307-4fbf-afc9-9d86b5f8ee12 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:31.547611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10e2d6-a307-4fbf-afc9-9d86b5f8ee12 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:31.547878 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10e2d6-a307-4fbf-afc9-9d86b5f8ee12 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:31.548561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10e2d6-a307-4fbf-afc9-9d86b5f8ee12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:31.548863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10e2d6-a307-4fbf-afc9-9d86b5f8ee12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:31.550585 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10e2d6-a307-4fbf-afc9-9d86b5f8ee12 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:31.562334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 634/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:18:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:31.568754 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133a286-b369-449b-99f0-8c79d906717d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:31.595012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:31.670001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133a286-b369-449b-99f0-8c79d906717d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:31.716687 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3634ad-ac59-4b6f-93cf-324afc630596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:31.717567 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3634ad-ac59-4b6f-93cf-324afc630596 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:31.718024 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3634ad-ac59-4b6f-93cf-324afc630596 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:31.718292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3634ad-ac59-4b6f-93cf-324afc630596 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:31.719007 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3634ad-ac59-4b6f-93cf-324afc630596 None admin] RBAC: Adding query filter params (role.id=f22e6e660eab44c5be25e3dee1e3042c, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=c1880dab32fa424a9356b3fe940d4856) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:31.719315 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3634ad-ac59-4b6f-93cf-324afc630596 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:31.720831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3634ad-ac59-4b6f-93cf-324afc630596 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:31.726956 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 626/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:18:31 2022] GET /identity/v3/role_assignments?user.id=c1880dab32fa424a9356b3fe940d4856&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=f22e6e660eab44c5be25e3dee1e3042c => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:33.596376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea69812-964d-42e3-91d2-cb7f63bc3d44 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:33.596906 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea69812-964d-42e3-91d2-cb7f63bc3d44 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:33.596906 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea69812-964d-42e3-91d2-cb7f63bc3d44 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:33.598259 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 635/1261] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:18:33.603348 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd41873-f651-483e-80de-252a3ee6f90c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:33.603750 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd41873-f651-483e-80de-252a3ee6f90c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:33.603896 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd41873-f651-483e-80de-252a3ee6f90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:33.623022 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4dd41873-f651-483e-80de-252a3ee6f90c None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:18:33.624221 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4dd41873-f651-483e-80de-252a3ee6f90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:18:33.695338 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 627/1262] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:18:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:18:33.980140 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea69812-964d-42e3-91d2-cb7f63bc3d44 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:33.991911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:34.082161 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea69812-964d-42e3-91d2-cb7f63bc3d44 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:34.116597 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ad664-8cc4-4202-9f2a-86e3442f6f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:34.119908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ad664-8cc4-4202-9f2a-86e3442f6f87 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:34.119908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ad664-8cc4-4202-9f2a-86e3442f6f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:34.119908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ad664-8cc4-4202-9f2a-86e3442f6f87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:34.129434 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ad664-8cc4-4202-9f2a-86e3442f6f87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:18:34.134708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-195ad664-8cc4-4202-9f2a-86e3442f6f87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:18:34.134708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:34.134708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:34.134708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:34.134708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:34.134708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:34.134708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:34.134708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:34.134708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:34.134708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:34.134708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:34.134708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:34.134708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:18:34.134708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:18:34.134708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:18:34.134708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:18:34.135857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:18:34.135857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:18:34.135857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:18:34.135857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:18:34.135857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:34.135857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:34.135857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:34.135857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:34.135857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:34.135857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:34.135857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:34.135857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:34.135857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:34.135857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:34.135857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:34.135857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:34.136978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:34.136978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:34.136978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:34.136978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:34.136978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:18:34.136978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:18:34.136978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:18:34.136978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:18:34.136978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:18:34.136978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:18:34.136978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:18:34.136978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:18:34.136978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 636/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:18:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:34.141734 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd41873-f651-483e-80de-252a3ee6f90c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:34.160150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:34.240296 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd41873-f651-483e-80de-252a3ee6f90c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:34.275634 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24926bf-99ba-4208-aaf9-11308b5043e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:34.276276 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24926bf-99ba-4208-aaf9-11308b5043e8 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:34.276555 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24926bf-99ba-4208-aaf9-11308b5043e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:34.276825 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24926bf-99ba-4208-aaf9-11308b5043e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:34.277509 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24926bf-99ba-4208-aaf9-11308b5043e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:34.277810 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24926bf-99ba-4208-aaf9-11308b5043e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:34.279167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24926bf-99ba-4208-aaf9-11308b5043e8 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:34.287220 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 628/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:18:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:34.293709 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ad664-8cc4-4202-9f2a-86e3442f6f87 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:34.359688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:34.391864 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ad664-8cc4-4202-9f2a-86e3442f6f87 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:34.424950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c2d20-d056-415a-a75e-4e0c3522e0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:34.425585 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c2d20-d056-415a-a75e-4e0c3522e0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:34.425858 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c2d20-d056-415a-a75e-4e0c3522e0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:34.426123 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c2d20-d056-415a-a75e-4e0c3522e0d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:34.436126 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c2d20-d056-415a-a75e-4e0c3522e0d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:34.437599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c2d20-d056-415a-a75e-4e0c3522e0d7 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:34.451159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-496c2d20-d056-415a-a75e-4e0c3522e0d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:34.451159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:34.451159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:34.451159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:34.451159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:34.451159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:34.451159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:34.451159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:34.451159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:34.451159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:34.451159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:34.451159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:34.451159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:18:34.451159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:18:34.451159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:18:34.451159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:18:34.452288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:34.452288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:34.452288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:34.452288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:34.452288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:34.452288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:34.452288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:34.452288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:34.452288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:34.452288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:34.452288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:34.452288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:34.452288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:34.452288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:34.452288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:34.452288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:34.452288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:18:34.453317 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:18:34.453317 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:34.453317 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:18:34.453317 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 637/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:34.458013 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24926bf-99ba-4208-aaf9-11308b5043e8 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:34.540165 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:34.559559 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24926bf-99ba-4208-aaf9-11308b5043e8 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:34.592384 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c34d7-9a94-4c79-ae26-1550ff05e81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:34.592979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c34d7-9a94-4c79-ae26-1550ff05e81e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:34.593290 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c34d7-9a94-4c79-ae26-1550ff05e81e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:34.593559 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c34d7-9a94-4c79-ae26-1550ff05e81e None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:34.594186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c34d7-9a94-4c79-ae26-1550ff05e81e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:34.594487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c34d7-9a94-4c79-ae26-1550ff05e81e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:34.595837 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c34d7-9a94-4c79-ae26-1550ff05e81e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:34.607348 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 629/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:34.613209 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c2d20-d056-415a-a75e-4e0c3522e0d7 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:34.713285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c2d20-d056-415a-a75e-4e0c3522e0d7 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:34.733288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:34.747006 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a1ad7-ccc2-4246-94a4-b2ceef8841ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:34.747635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a1ad7-ccc2-4246-94a4-b2ceef8841ed None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:34.747915 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a1ad7-ccc2-4246-94a4-b2ceef8841ed None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:34.748188 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a1ad7-ccc2-4246-94a4-b2ceef8841ed None admin] PATH_INFO: `/v3/users/placement` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:34.755669 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a1ad7-ccc2-4246-94a4-b2ceef8841ed None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:34.757744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a1ad7-ccc2-4246-94a4-b2ceef8841ed None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:34.768697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-517a1ad7-ccc2-4246-94a4-b2ceef8841ed None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 14:18:34.768697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:34.768697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:34.768697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:34.768697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:34.768697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:34.768697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:34.768697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:34.768697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:34.768697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:34.768697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:34.768697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:34.768697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:18:34.768697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:18:34.768697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:18:34.768697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:18:34.770101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:34.770101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:34.770101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:18:34.770101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:18:34.770101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:18:34.770101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:18:34.770101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:34.770101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:34.770101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:34.770101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:34.770101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:34.770101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:34.770101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:34.770101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:34.770101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:34.770101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:34.770101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:34.770101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:34.771491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:34.771491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:34.771491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:18:34.771491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:18:34.771491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:18:34.771491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:18:34.771491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:18:34.771491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:18:34.771491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 14:18:34.771491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:18:34.771491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 638/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:18:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:34.777104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c34d7-9a94-4c79-ae26-1550ff05e81e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:34.876254 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c34d7-9a94-4c79-ae26-1550ff05e81e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:34.909767 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8826ae-eee1-4cf2-a26c-f8c5cf1fdf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:34.910360 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8826ae-eee1-4cf2-a26c-f8c5cf1fdf37 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:34.910636 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8826ae-eee1-4cf2-a26c-f8c5cf1fdf37 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:34.910905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8826ae-eee1-4cf2-a26c-f8c5cf1fdf37 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:34.911615 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8826ae-eee1-4cf2-a26c-f8c5cf1fdf37 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:34.911917 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8826ae-eee1-4cf2-a26c-f8c5cf1fdf37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:34.913397 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8826ae-eee1-4cf2-a26c-f8c5cf1fdf37 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:34.922229 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:34.930582 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 630/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Sep 5 14:18:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:34.936230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a1ad7-ccc2-4246-94a4-b2ceef8841ed None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:35.036134 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a1ad7-ccc2-4246-94a4-b2ceef8841ed None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:35.069886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b1221-74c1-4554-acb0-f0fc6763860b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:35.070501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b1221-74c1-4554-acb0-f0fc6763860b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:35.070776 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b1221-74c1-4554-acb0-f0fc6763860b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:35.071046 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b1221-74c1-4554-acb0-f0fc6763860b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:35.081299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b1221-74c1-4554-acb0-f0fc6763860b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:35.082744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b1221-74c1-4554-acb0-f0fc6763860b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:35.096550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-f84b1221-74c1-4554-acb0-f0fc6763860b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:35.096550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:35.096550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:35.096550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:35.096550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:35.096550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:35.096550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:35.096550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:35.096550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:35.096550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:35.096550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:35.096550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:35.096550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:18:35.096550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:18:35.096550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:18:35.096550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:18:35.097681 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:35.097681 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:35.097681 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:35.097681 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:35.097681 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:35.097681 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:35.097681 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:35.097681 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:35.097681 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:35.097681 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:35.097681 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:35.097681 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:35.097681 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:35.097681 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:35.097681 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:35.097681 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:35.097681 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:18:35.098779 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:18:35.098779 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:35.098779 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:18:35.098779 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 639/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:35.104158 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8826ae-eee1-4cf2-a26c-f8c5cf1fdf37 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:35.215282 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8826ae-eee1-4cf2-a26c-f8c5cf1fdf37 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:35.249841 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d0599-7c42-4f3a-a5e0-048d2d1b6d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:35.250561 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d0599-7c42-4f3a-a5e0-048d2d1b6d27 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:35.250764 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d0599-7c42-4f3a-a5e0-048d2d1b6d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:35.251035 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d0599-7c42-4f3a-a5e0-048d2d1b6d27 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:35.251668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d0599-7c42-4f3a-a5e0-048d2d1b6d27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:35.251969 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d0599-7c42-4f3a-a5e0-048d2d1b6d27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:35.253421 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d0599-7c42-4f3a-a5e0-048d2d1b6d27 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:35.265192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 631/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:35.270997 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b1221-74c1-4554-acb0-f0fc6763860b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:35.306048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:35.374415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b1221-74c1-4554-acb0-f0fc6763860b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:35.408272 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5cb08-1526-4001-89a5-eed856befb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:35.408934 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5cb08-1526-4001-89a5-eed856befb3c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:35.409199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5cb08-1526-4001-89a5-eed856befb3c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:35.409466 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5cb08-1526-4001-89a5-eed856befb3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:35.416559 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5cb08-1526-4001-89a5-eed856befb3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:35.418024 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5cb08-1526-4001-89a5-eed856befb3c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:35.429661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-9ca5cb08-1526-4001-89a5-eed856befb3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:18:35.429661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:35.429661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:35.429661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:35.429661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:35.429661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:35.429661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:35.429661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:35.429661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:35.429661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:35.429661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:35.429661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:35.429661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:18:35.429661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:18:35.429661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:18:35.430742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:18:35.430742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:35.430742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:35.430742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:35.430742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:35.430742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:35.430742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:35.430742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:35.430742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:35.430742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:35.430742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:35.430742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:35.430742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:35.430742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:35.430742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:35.430742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:35.430742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:35.432118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:18:35.432118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:18:35.432118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:18:35.432118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:18:35.432118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:18:35.432118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:18:35.432118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:18:35.432118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:18:35.432118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 640/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:18:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:35.436795 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d0599-7c42-4f3a-a5e0-048d2d1b6d27 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:35.494228 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:35.534721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d0599-7c42-4f3a-a5e0-048d2d1b6d27 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:35.568937 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85252c9-9011-4f17-af24-ce624844fe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:35.569553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85252c9-9011-4f17-af24-ce624844fe8f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:35.569826 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85252c9-9011-4f17-af24-ce624844fe8f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:35.570092 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85252c9-9011-4f17-af24-ce624844fe8f None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:35.570765 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85252c9-9011-4f17-af24-ce624844fe8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:35.571065 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85252c9-9011-4f17-af24-ce624844fe8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:35.572487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85252c9-9011-4f17-af24-ce624844fe8f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:35.583907 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 632/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:18:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:35.590026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5cb08-1526-4001-89a5-eed856befb3c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:35.682113 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:35.690590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5cb08-1526-4001-89a5-eed856befb3c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:35.726429 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37c389-be22-4467-a001-36d4b6776483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:35.727402 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37c389-be22-4467-a001-36d4b6776483 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:35.727402 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37c389-be22-4467-a001-36d4b6776483 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:35.727697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37c389-be22-4467-a001-36d4b6776483 None admin] PATH_INFO: `/v3/projects/975f49bcc95643fe876cc03d0d731423/users/c1880dab32fa424a9356b3fe940d4856/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:35.729465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37c389-be22-4467-a001-36d4b6776483 None admin] RBAC: Authorizing `identity:create_grant(project_id=975f49bcc95643fe876cc03d0d731423, user_id=c1880dab32fa424a9356b3fe940d4856, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:35.730889 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37c389-be22-4467-a001-36d4b6776483 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:35.843009 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 641/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Sep 5 14:18:35 2022] PUT /identity/v3/projects/975f49bcc95643fe876cc03d0d731423/users/c1880dab32fa424a9356b3fe940d4856/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:18:37.740883 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68eb1d-f4b6-463d-a72c-e8d254fe1bcc None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:37.741479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68eb1d-f4b6-463d-a72c-e8d254fe1bcc None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:37.741479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68eb1d-f4b6-463d-a72c-e8d254fe1bcc None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:37.742798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 633/1274] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:18:37.748340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee3f71-4591-450c-b6d1-a723a0276853 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:37.748785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee3f71-4591-450c-b6d1-a723a0276853 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:37.748899 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee3f71-4591-450c-b6d1-a723a0276853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:37.767607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-e9ee3f71-4591-450c-b6d1-a723a0276853 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:18:37.768796 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e9ee3f71-4591-450c-b6d1-a723a0276853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:18:37.836903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 642/1275] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:18:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:18:38.112505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68eb1d-f4b6-463d-a72c-e8d254fe1bcc None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:38.211943 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68eb1d-f4b6-463d-a72c-e8d254fe1bcc None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:38.229518 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:38.245904 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb287df0-8059-4ec2-9763-e46a6c7552c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:38.246523 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb287df0-8059-4ec2-9763-e46a6c7552c5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:38.246798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb287df0-8059-4ec2-9763-e46a6c7552c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:38.247063 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb287df0-8059-4ec2-9763-e46a6c7552c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:38.256677 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb287df0-8059-4ec2-9763-e46a6c7552c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 14:18:38.261628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-fb287df0-8059-4ec2-9763-e46a6c7552c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:18:38.261628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:38.261628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:38.261628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:38.261628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:38.261628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:38.261628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:38.261628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:38.261628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:38.261628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:38.261628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:38.261628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:38.261628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 14:18:38.261628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 14:18:38.261628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 14:18:38.261628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 14:18:38.266487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 14:18:38.266487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 14:18:38.266487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 14:18:38.266487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 14:18:38.266487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:38.266487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:38.266487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:38.266487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:38.266487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:38.266487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:38.266487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:38.266487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:38.266487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:38.266487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:38.266487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:38.266487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:38.267533 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:38.267533 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:38.267533 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:38.267533 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:38.267533 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 14:18:38.267533 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 14:18:38.267533 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 14:18:38.267533 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 14:18:38.267533 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 14:18:38.267533 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 14:18:38.267533 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 14:18:38.267533 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:38.267533 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 634/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Sep 5 14:18:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:38.269039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee3f71-4591-450c-b6d1-a723a0276853 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:38.350279 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:38.369049 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee3f71-4591-450c-b6d1-a723a0276853 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:38.402351 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971d1fc-7abd-417f-a39a-fb499e2027bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:38.402945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971d1fc-7abd-417f-a39a-fb499e2027bc None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:38.403220 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971d1fc-7abd-417f-a39a-fb499e2027bc None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:38.403489 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971d1fc-7abd-417f-a39a-fb499e2027bc None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:38.404166 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971d1fc-7abd-417f-a39a-fb499e2027bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:38.404471 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971d1fc-7abd-417f-a39a-fb499e2027bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:38.405877 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971d1fc-7abd-417f-a39a-fb499e2027bc None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:38.413553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 643/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Sep 5 14:18:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:38.419630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb287df0-8059-4ec2-9763-e46a6c7552c5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:38.516846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb287df0-8059-4ec2-9763-e46a6c7552c5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:38.554938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f061f-e52c-4abd-a326-53961053d60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:38.555566 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f061f-e52c-4abd-a326-53961053d60a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:38.555840 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f061f-e52c-4abd-a326-53961053d60a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:38.556108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f061f-e52c-4abd-a326-53961053d60a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:38.565856 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f061f-e52c-4abd-a326-53961053d60a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:38.567351 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f061f-e52c-4abd-a326-53961053d60a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:38.583050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-688f061f-e52c-4abd-a326-53961053d60a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:38.583050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:38.583050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:38.583050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:38.583050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:38.583050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:38.583050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:38.583050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:38.583050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:38.583050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:38.583050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:38.583050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:38.583050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:18:38.583050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:18:38.583050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:18:38.583050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:18:38.584355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:38.584355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:38.584355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:38.584355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:38.584355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:38.584355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:38.584355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:38.584355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:38.584355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:38.584355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:38.584355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:38.584355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:38.584355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:38.584355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:38.584355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:38.584355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:38.584355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:18:38.585499 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:18:38.585499 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:38.585499 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:38.585499 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 635/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:38.591035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971d1fc-7abd-417f-a39a-fb499e2027bc None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:38.689414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971d1fc-7abd-417f-a39a-fb499e2027bc None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:38.722626 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb235ac0-154a-443c-9190-62a2e72da35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:38.723218 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb235ac0-154a-443c-9190-62a2e72da35f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:38.723492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb235ac0-154a-443c-9190-62a2e72da35f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:38.723782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb235ac0-154a-443c-9190-62a2e72da35f None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:38.724411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb235ac0-154a-443c-9190-62a2e72da35f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:38.724709 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb235ac0-154a-443c-9190-62a2e72da35f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:38.726118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb235ac0-154a-443c-9190-62a2e72da35f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:38.737723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 644/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:38.744194 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f061f-e52c-4abd-a326-53961053d60a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:38.774908 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:38.843228 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f061f-e52c-4abd-a326-53961053d60a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:38.877756 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4fedb-3f53-4bf2-91fe-797cf0f4fc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:38.878368 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4fedb-3f53-4bf2-91fe-797cf0f4fc85 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:38.878641 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4fedb-3f53-4bf2-91fe-797cf0f4fc85 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:38.878908 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4fedb-3f53-4bf2-91fe-797cf0f4fc85 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:38.886697 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4fedb-3f53-4bf2-91fe-797cf0f4fc85 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:38.888176 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4fedb-3f53-4bf2-91fe-797cf0f4fc85 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:38.900586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-ecf4fedb-3f53-4bf2-91fe-797cf0f4fc85 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 14:18:38.900586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:38.900586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:38.900586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:38.900586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:38.900586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:38.900586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:38.900586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:38.900586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:38.900586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:38.900586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:38.900586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:38.900586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 14:18:38.900586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 14:18:38.900586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 14:18:38.900586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 14:18:38.901732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:38.901732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:38.901732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 14:18:38.901732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:18:38.901732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 14:18:38.901732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 14:18:38.901732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:38.901732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:38.901732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:38.901732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:38.901732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:38.901732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:38.901732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:38.901732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:38.901732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:38.901732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:38.901732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:38.901732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:38.902885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:38.902885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:38.902885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 14:18:38.902885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 14:18:38.902885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 14:18:38.902885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 14:18:38.902885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 14:18:38.902885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 14:18:38.902885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 14:18:38.902885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:38.902885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 636/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:18:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:38.907876 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb235ac0-154a-443c-9190-62a2e72da35f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:38.911803 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:39.004171 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb235ac0-154a-443c-9190-62a2e72da35f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:39.041548 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99f05c-8983-4578-9b58-1b2814049e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:39.042198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99f05c-8983-4578-9b58-1b2814049e83 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:39.042479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99f05c-8983-4578-9b58-1b2814049e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:39.042748 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99f05c-8983-4578-9b58-1b2814049e83 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:39.043559 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99f05c-8983-4578-9b58-1b2814049e83 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:39.043870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99f05c-8983-4578-9b58-1b2814049e83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:39.045316 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99f05c-8983-4578-9b58-1b2814049e83 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:39.062409 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 645/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Sep 5 14:18:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:39.068244 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4fedb-3f53-4bf2-91fe-797cf0f4fc85 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:39.159503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:39.169324 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4fedb-3f53-4bf2-91fe-797cf0f4fc85 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:39.202317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426adea6-1f5e-488d-96a2-84609299a892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:39.202915 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426adea6-1f5e-488d-96a2-84609299a892 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:39.203199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426adea6-1f5e-488d-96a2-84609299a892 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:39.203470 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426adea6-1f5e-488d-96a2-84609299a892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:39.272967 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426adea6-1f5e-488d-96a2-84609299a892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:39.275011 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426adea6-1f5e-488d-96a2-84609299a892 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:39.361844 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:39.371649 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 637/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Sep 5 14:18:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 14:18:39.377671 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99f05c-8983-4578-9b58-1b2814049e83 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:39.438276 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:39.476262 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99f05c-8983-4578-9b58-1b2814049e83 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:39.509664 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b36cb8-9463-4570-8220-01ef346af714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:39.510277 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b36cb8-9463-4570-8220-01ef346af714 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:39.510550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b36cb8-9463-4570-8220-01ef346af714 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:39.510815 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b36cb8-9463-4570-8220-01ef346af714 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:39.520800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b36cb8-9463-4570-8220-01ef346af714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:39.522263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b36cb8-9463-4570-8220-01ef346af714 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:39.536417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-78b36cb8-9463-4570-8220-01ef346af714 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:39.536417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:39.536417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:39.536417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:39.536417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:39.536417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:39.536417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:39.536417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:39.536417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:39.536417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:39.536417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:39.536417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:39.536417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 14:18:39.536417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 14:18:39.536417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 14:18:39.536417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 14:18:39.537575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:39.537575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:39.537575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:39.537575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:39.537575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:39.537575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:39.537575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:39.537575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:39.537575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:39.537575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:39.537575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:39.537575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:39.537575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:39.537575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:39.537575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:39.537575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:39.537575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 14:18:39.538686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 14:18:39.538686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 14:18:39.538686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:18:39.538686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 646/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:18:39.543495 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426adea6-1f5e-488d-96a2-84609299a892 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:39.641211 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426adea6-1f5e-488d-96a2-84609299a892 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:39.675187 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362acc5a-8b3b-4064-9caf-a8c9d1d73dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:39.675789 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362acc5a-8b3b-4064-9caf-a8c9d1d73dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:39.676061 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362acc5a-8b3b-4064-9caf-a8c9d1d73dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:39.676334 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362acc5a-8b3b-4064-9caf-a8c9d1d73dd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:39.676956 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362acc5a-8b3b-4064-9caf-a8c9d1d73dd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:39.677279 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362acc5a-8b3b-4064-9caf-a8c9d1d73dd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:39.678631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362acc5a-8b3b-4064-9caf-a8c9d1d73dd4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:39.690168 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 638/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Sep 5 14:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:39.696877 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b36cb8-9463-4570-8220-01ef346af714 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:39.800663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b36cb8-9463-4570-8220-01ef346af714 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:39.814382 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:39.834137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f868f55-839a-4ffe-8c9e-ff23342296a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:39.834750 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f868f55-839a-4ffe-8c9e-ff23342296a1 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:39.835023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f868f55-839a-4ffe-8c9e-ff23342296a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:39.835289 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f868f55-839a-4ffe-8c9e-ff23342296a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:39.842482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f868f55-839a-4ffe-8c9e-ff23342296a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:39.843974 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f868f55-839a-4ffe-8c9e-ff23342296a1 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:39.855881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-1f868f55-839a-4ffe-8c9e-ff23342296a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:18:39.855881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:39.855881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:39.855881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:39.855881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:39.855881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:39.855881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:39.855881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:39.855881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:39.855881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:39.855881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:39.855881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:39.855881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 14:18:39.855881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 14:18:39.855881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 14:18:39.861817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 14:18:39.861817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:39.861817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:39.861817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:39.861817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:39.861817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:39.861817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:39.861817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:39.861817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:39.861817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:39.861817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:39.861817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:39.861817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:39.861817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:39.861817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:39.861817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:39.861817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:39.862831 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 14:18:39.862831 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 14:18:39.862831 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 14:18:39.862831 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 14:18:39.862831 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 14:18:39.862831 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 14:18:39.862831 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 14:18:39.862831 dv-cinder-842905-3-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Sep 05 14:18:39.862831 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 647/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Sep 5 14:18:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 14:18:39.863425 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362acc5a-8b3b-4064-9caf-a8c9d1d73dd4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:39.912433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:39.968427 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362acc5a-8b3b-4064-9caf-a8c9d1d73dd4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:40.001856 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6aad6-8170-4f00-a065-be4edfd8cac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:40.002450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6aad6-8170-4f00-a065-be4edfd8cac2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:40.002727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6aad6-8170-4f00-a065-be4edfd8cac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:40.002997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6aad6-8170-4f00-a065-be4edfd8cac2 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:40.003666 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6aad6-8170-4f00-a065-be4edfd8cac2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:40.003966 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6aad6-8170-4f00-a065-be4edfd8cac2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:40.005433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6aad6-8170-4f00-a065-be4edfd8cac2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:40.017981 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 639/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Sep 5 14:18:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:40.024176 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f868f55-839a-4ffe-8c9e-ff23342296a1 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:40.125770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f868f55-839a-4ffe-8c9e-ff23342296a1 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:40.158032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56315103-ba38-4303-ad28-fba2a4e7145e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:40.158624 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56315103-ba38-4303-ad28-fba2a4e7145e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:40.158899 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56315103-ba38-4303-ad28-fba2a4e7145e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:40.159168 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56315103-ba38-4303-ad28-fba2a4e7145e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:40.159879 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56315103-ba38-4303-ad28-fba2a4e7145e None admin] RBAC: Adding query filter params (role.id=f22e6e660eab44c5be25e3dee1e3042c, scope.project.id=975f49bcc95643fe876cc03d0d731423, user.id=c1880dab32fa424a9356b3fe940d4856) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:40.160181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56315103-ba38-4303-ad28-fba2a4e7145e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:40.161664 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56315103-ba38-4303-ad28-fba2a4e7145e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:40.167758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 648/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Sep 5 14:18:40 2022] GET /identity/v3/role_assignments?user.id=c1880dab32fa424a9356b3fe940d4856&scope.project.id=975f49bcc95643fe876cc03d0d731423&role.id=f22e6e660eab44c5be25e3dee1e3042c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:42.123033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0ac19-0671-4c81-9bff-9a209c8ca502 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:42.123559 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0ac19-0671-4c81-9bff-9a209c8ca502 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:42.123559 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0ac19-0671-4c81-9bff-9a209c8ca502 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:42.124901 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 640/1288] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:18:42.130128 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2c534-7058-49c5-a63f-adbc296c30da None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:42.134316 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2c534-7058-49c5-a63f-adbc296c30da None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:42.134316 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2c534-7058-49c5-a63f-adbc296c30da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:42.149355 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-e4f2c534-7058-49c5-a63f-adbc296c30da None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:18:42.150573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e4f2c534-7058-49c5-a63f-adbc296c30da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:18:42.181688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:42.217312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 649/1289] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:18:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:18:42.485174 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0ac19-0671-4c81-9bff-9a209c8ca502 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:42.586262 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0ac19-0671-4c81-9bff-9a209c8ca502 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:42.596668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:42.619827 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4ab68-37b1-44ef-aeed-74a3f6db792b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:42.620438 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ab68-37b1-44ef-aeed-74a3f6db792b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:42.620713 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ab68-37b1-44ef-aeed-74a3f6db792b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:42.620980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ab68-37b1-44ef-aeed-74a3f6db792b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:42.621702 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4ab68-37b1-44ef-aeed-74a3f6db792b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:42.623068 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4ab68-37b1-44ef-aeed-74a3f6db792b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:42.631787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-21a4ab68-37b1-44ef-aeed-74a3f6db792b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 14:18:42.631787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:42.631787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:18:42.631787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:18:42.631787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:18:42.631787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:18:42.631787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:18:42.631787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:18:42.631787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 14:18:42.631787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:42.631787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:18:42.631787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:42.631787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:42.631787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:42.631787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:42.631787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:42.631787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:42.634586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:42.634586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:42.634586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:42.634586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:42.634586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:42.634586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:42.634586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:18:42.634586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:18:42.634586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:18:42.634586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:18:42.634586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:42.634586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:42.634586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:42.634586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:42.634586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:42.634586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:42.635474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:42.635474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:42.635474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:42.635474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:42.635474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:42.635474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:42.635474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:42.635474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:42.635474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:42.635474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:42.635474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:18:42.635474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:18:42.635474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 14:18:42.635474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:42.635474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 641/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 5 14:18:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:42.639264 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2c534-7058-49c5-a63f-adbc296c30da None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:42.741308 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2c534-7058-49c5-a63f-adbc296c30da None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:42.775059 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63395db-0ccf-4c6a-ba49-54ed06db0f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:42.775664 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63395db-0ccf-4c6a-ba49-54ed06db0f9b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:42.775944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63395db-0ccf-4c6a-ba49-54ed06db0f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:42.776217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63395db-0ccf-4c6a-ba49-54ed06db0f9b None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:42.776844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63395db-0ccf-4c6a-ba49-54ed06db0f9b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:42.777177 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63395db-0ccf-4c6a-ba49-54ed06db0f9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:42.778585 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63395db-0ccf-4c6a-ba49-54ed06db0f9b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:42.783354 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 650/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Sep 5 14:18:42 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:42.790425 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4ab68-37b1-44ef-aeed-74a3f6db792b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:42.890782 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4ab68-37b1-44ef-aeed-74a3f6db792b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:42.924093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f7f64-6b34-4b98-8e91-e65ca54517b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:42.924945 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f7f64-6b34-4b98-8e91-e65ca54517b3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:42.925260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f7f64-6b34-4b98-8e91-e65ca54517b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:42.925534 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f7f64-6b34-4b98-8e91-e65ca54517b3 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:42.926226 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f7f64-6b34-4b98-8e91-e65ca54517b3 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:42.926525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f7f64-6b34-4b98-8e91-e65ca54517b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:42.927877 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f7f64-6b34-4b98-8e91-e65ca54517b3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:42.932532 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 642/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Sep 5 14:18:42 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:18:44.860422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259d475-923c-4b7e-8d14-3f1016e0f277 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:44.860970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259d475-923c-4b7e-8d14-3f1016e0f277 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:44.860970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259d475-923c-4b7e-8d14-3f1016e0f277 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:44.862314 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 651/1293] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:18:44.867574 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5111e-6cbf-4916-ba3a-c7924b9c473e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:44.868044 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5111e-6cbf-4916-ba3a-c7924b9c473e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:44.868138 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5111e-6cbf-4916-ba3a-c7924b9c473e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:44.886063 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-bfe5111e-6cbf-4916-ba3a-c7924b9c473e None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:18:44.887332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bfe5111e-6cbf-4916-ba3a-c7924b9c473e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:18:44.917552 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:44.952529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 643/1294] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:18:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:18:45.224404 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259d475-923c-4b7e-8d14-3f1016e0f277 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:45.255429 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:45.324767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259d475-923c-4b7e-8d14-3f1016e0f277 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:45.365236 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57883f46-4f42-457d-9aff-c371a6653423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:45.365843 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57883f46-4f42-457d-9aff-c371a6653423 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:45.366123 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57883f46-4f42-457d-9aff-c371a6653423 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:45.366420 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57883f46-4f42-457d-9aff-c371a6653423 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:45.367412 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57883f46-4f42-457d-9aff-c371a6653423 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:45.368872 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57883f46-4f42-457d-9aff-c371a6653423 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:45.449400 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 652/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Sep 5 14:18:45 2022] POST /identity/v3/services => generated 246 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:18:47.374403 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee375680-57cf-4aca-a60e-ed07ab437d33 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:47.374975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee375680-57cf-4aca-a60e-ed07ab437d33 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:47.374975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee375680-57cf-4aca-a60e-ed07ab437d33 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:47.376351 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 644/1296] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:18:47.381550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa740d62-1168-45df-bed6-74a8c6881f8d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:47.382000 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa740d62-1168-45df-bed6-74a8c6881f8d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:47.382678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa740d62-1168-45df-bed6-74a8c6881f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:47.401249 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-fa740d62-1168-45df-bed6-74a8c6881f8d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:18:47.402425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fa740d62-1168-45df-bed6-74a8c6881f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:18:47.473634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 653/1297] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:18:47 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 14:18:47.742191 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee375680-57cf-4aca-a60e-ed07ab437d33 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:47.853641 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee375680-57cf-4aca-a60e-ed07ab437d33 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:47.888167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabed490-44b6-44c7-9b4a-fac88a2574c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:47.888784 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabed490-44b6-44c7-9b4a-fac88a2574c9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:47.889089 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabed490-44b6-44c7-9b4a-fac88a2574c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:47.889356 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabed490-44b6-44c7-9b4a-fac88a2574c9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:47.889975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabed490-44b6-44c7-9b4a-fac88a2574c9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:47.891345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabed490-44b6-44c7-9b4a-fac88a2574c9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:47.899938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-dabed490-44b6-44c7-9b4a-fac88a2574c9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 14:18:47.899938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:47.899938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:18:47.899938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:18:47.899938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:18:47.899938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:18:47.899938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:18:47.899938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:18:47.899938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 14:18:47.899938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:47.899938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:18:47.899938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:47.899938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:47.899938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:47.899938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:47.899938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:47.899938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:47.901220 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:47.901220 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:47.901220 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:47.901220 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:47.901220 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:47.901220 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:47.901220 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:18:47.901220 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:18:47.901220 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:18:47.901220 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:18:47.901220 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:47.901220 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:47.901220 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:47.901220 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:47.901220 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:47.901220 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:47.902264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:47.902264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:47.902264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:47.902264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:47.902264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:47.902264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:47.902264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:47.902264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:47.902264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:47.902264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:47.902264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:18:47.902264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:18:47.902264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 14:18:47.902264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:47.902264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 645/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 5 14:18:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:47.907080 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa740d62-1168-45df-bed6-74a8c6881f8d None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:47.925418 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:48.006262 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa740d62-1168-45df-bed6-74a8c6881f8d None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:48.040954 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a7669-9f45-4d59-baf6-8839297f98a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:48.041586 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a7669-9f45-4d59-baf6-8839297f98a5 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:48.041868 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a7669-9f45-4d59-baf6-8839297f98a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:48.042141 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a7669-9f45-4d59-baf6-8839297f98a5 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:48.042767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a7669-9f45-4d59-baf6-8839297f98a5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:48.043072 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a7669-9f45-4d59-baf6-8839297f98a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:48.044448 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a7669-9f45-4d59-baf6-8839297f98a5 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:48.049857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 654/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Sep 5 14:18:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:48.056635 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabed490-44b6-44c7-9b4a-fac88a2574c9 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:48.088331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:48.154165 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabed490-44b6-44c7-9b4a-fac88a2574c9 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:48.188118 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6cb89-ed0d-44f3-803c-5a5b86d7513f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:48.188708 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6cb89-ed0d-44f3-803c-5a5b86d7513f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:48.188984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6cb89-ed0d-44f3-803c-5a5b86d7513f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:48.189278 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6cb89-ed0d-44f3-803c-5a5b86d7513f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:48.189964 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6cb89-ed0d-44f3-803c-5a5b86d7513f None admin] RBAC: Adding query filter params (interface=public, service_id=034036a53a30497a997d3580a5a047e0, region_id=RegionOne) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:48.190268 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6cb89-ed0d-44f3-803c-5a5b86d7513f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:48.191616 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6cb89-ed0d-44f3-803c-5a5b86d7513f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:48.196641 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 646/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Sep 5 14:18:48 2022] GET /identity/v3/endpoints?service_id=034036a53a30497a997d3580a5a047e0&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:48.202356 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a7669-9f45-4d59-baf6-8839297f98a5 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:48.283125 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:48.301615 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a7669-9f45-4d59-baf6-8839297f98a5 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:48.335238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff525db-a16f-4282-b907-cdafbf673822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:48.335828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff525db-a16f-4282-b907-cdafbf673822 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:48.336100 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff525db-a16f-4282-b907-cdafbf673822 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:48.336367 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff525db-a16f-4282-b907-cdafbf673822 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:48.336957 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff525db-a16f-4282-b907-cdafbf673822 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:48.338352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff525db-a16f-4282-b907-cdafbf673822 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:48.344875 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 655/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Sep 5 14:18:48 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:18:50.267411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4002a5-72c0-4c5b-9cdb-da9128f8dc1a None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:50.267893 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4002a5-72c0-4c5b-9cdb-da9128f8dc1a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:50.268005 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4002a5-72c0-4c5b-9cdb-da9128f8dc1a None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:50.269372 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 647/1302] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:18:50.275162 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216c9ae-092f-4520-b34b-5267a05301a6 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:50.275594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216c9ae-092f-4520-b34b-5267a05301a6 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:50.275786 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216c9ae-092f-4520-b34b-5267a05301a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:50.293631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-a216c9ae-092f-4520-b34b-5267a05301a6 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:18:50.294796 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a216c9ae-092f-4520-b34b-5267a05301a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:18:50.360920 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 656/1303] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:18:50 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 14:18:50.630160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4002a5-72c0-4c5b-9cdb-da9128f8dc1a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:50.733833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:50.740341 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4002a5-72c0-4c5b-9cdb-da9128f8dc1a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:50.775827 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8a48f-b977-437a-9a38-152f4124d710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:50.777991 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8a48f-b977-437a-9a38-152f4124d710 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:50.777991 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8a48f-b977-437a-9a38-152f4124d710 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:50.777991 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8a48f-b977-437a-9a38-152f4124d710 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:50.777991 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8a48f-b977-437a-9a38-152f4124d710 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:50.778889 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8a48f-b977-437a-9a38-152f4124d710 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:50.787245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-91a8a48f-b977-437a-9a38-152f4124d710 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 14:18:50.787245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:50.787245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 14:18:50.787245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 14:18:50.787245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 14:18:50.787245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 14:18:50.787245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 14:18:50.787245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:18:50.787245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 14:18:50.787245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:50.787245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 14:18:50.787245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:50.787245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 14:18:50.787245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 14:18:50.787245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 14:18:50.787245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 14:18:50.787245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 14:18:50.788970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 14:18:50.788970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 14:18:50.788970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 14:18:50.788970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 14:18:50.788970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 14:18:50.788970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 14:18:50.788970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 14:18:50.788970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 14:18:50.788970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 14:18:50.788970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 14:18:50.788970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 14:18:50.788970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 14:18:50.788970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 14:18:50.788970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 14:18:50.788970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 14:18:50.788970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 14:18:50.789992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 14:18:50.789992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Sep 05 14:18:50.789992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 14:18:50.789992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Sep 05 14:18:50.789992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 14:18:50.789992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 14:18:50.789992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 14:18:50.789992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Sep 05 14:18:50.789992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 14:18:50.789992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Sep 05 14:18:50.789992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 14:18:50.789992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 14:18:50.789992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 14:18:50.789992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Sep 05 14:18:50.789992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 648/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Sep 5 14:18:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 14:18:50.795547 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216c9ae-092f-4520-b34b-5267a05301a6 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:50.871159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:18:50.893785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216c9ae-092f-4520-b34b-5267a05301a6 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:50.927633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640b277-07ba-44f9-84ee-075fc44364e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:50.928228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640b277-07ba-44f9-84ee-075fc44364e9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:50.928507 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640b277-07ba-44f9-84ee-075fc44364e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:50.928887 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640b277-07ba-44f9-84ee-075fc44364e9 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:50.929632 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640b277-07ba-44f9-84ee-075fc44364e9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:18:50.938189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640b277-07ba-44f9-84ee-075fc44364e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:50.939634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0640b277-07ba-44f9-84ee-075fc44364e9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:50.947023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 657/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Sep 5 14:18:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:18:50.952893 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8a48f-b977-437a-9a38-152f4124d710 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:18:51.056210 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8a48f-b977-437a-9a38-152f4124d710 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:18:51.089251 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a38903-b552-402b-8572-f1e64e266330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:18:51.089846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a38903-b552-402b-8572-f1e64e266330 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:18:51.090134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a38903-b552-402b-8572-f1e64e266330 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:18:51.090398 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a38903-b552-402b-8572-f1e64e266330 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:18:51.091051 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a38903-b552-402b-8572-f1e64e266330 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:18:51.092439 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a38903-b552-402b-8572-f1e64e266330 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:18:51.179064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 649/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:18:50 2022] POST /identity/v3/endpoints => generated 331 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:19:01.042285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=30 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:19:01.174558 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:26:25.753632 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef8308-5b50-45df-b9e2-f9ac09f4f652 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:25.754184 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef8308-5b50-45df-b9e2-f9ac09f4f652 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:25.754184 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef8308-5b50-45df-b9e2-f9ac09f4f652 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:25.761182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b8af5-ea97-40c5-b7dc-c071e4b67106 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:25.761675 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b8af5-ea97-40c5-b7dc-c071e4b67106 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:25.761766 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b8af5-ea97-40c5-b7dc-c071e4b67106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:25.763917 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 658/1307] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:26:25 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:26:25.855685 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-480b8af5-ea97-40c5-b7dc-c071e4b67106 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:26:25.856824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-480b8af5-ea97-40c5-b7dc-c071e4b67106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:26.001761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 650/1308] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:26:26.294729 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab26ea8-abd2-4078-a3a3-365a5332878a None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:26.295408 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab26ea8-abd2-4078-a3a3-365a5332878a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:26.295940 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab26ea8-abd2-4078-a3a3-365a5332878a None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:26.297526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 659/1309] 10.222.0.23 () {54 vars in 965 bytes} [Mon Sep 5 14:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:26:26.305278 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aa7d9-5cf9-4982-aed0-faecbd936c96 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:26.305597 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aa7d9-5cf9-4982-aed0-faecbd936c96 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:26.305875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aa7d9-5cf9-4982-aed0-faecbd936c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:26.392308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e15aa7d9-5cf9-4982-aed0-faecbd936c96 None None] MFA Rules not processed for user `b0ec118e5a114429b3e1c91041f7caf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:26:26.393567 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e15aa7d9-5cf9-4982-aed0-faecbd936c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:26.415476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:26:26.474488 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 651/1310] 10.222.0.23 () {58 vars in 1062 bytes} [Mon Sep 5 14:26:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:26:26.483815 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab26ea8-abd2-4078-a3a3-365a5332878a None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:26:26.485652 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1ab26ea8-abd2-4078-a3a3-365a5332878a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:26.598329 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab26ea8-abd2-4078-a3a3-365a5332878a None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:26:26.675849 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c3420-0916-4ddf-b5bd-e7a74ec1c27e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:26:26.676846 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c3420-0916-4ddf-b5bd-e7a74ec1c27e service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:26.677378 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c3420-0916-4ddf-b5bd-e7a74ec1c27e service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:26.677887 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c3420-0916-4ddf-b5bd-e7a74ec1c27e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:26.679799 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-533c3420-0916-4ddf-b5bd-e7a74ec1c27e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:26.745716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:26:26.811448 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c3420-0916-4ddf-b5bd-e7a74ec1c27e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:26:26.812926 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c3420-0916-4ddf-b5bd-e7a74ec1c27e service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:26:26.834444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 660/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:26:29.094359 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc20571-efed-4ab5-8725-c15bcd0a7806 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:29.094929 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc20571-efed-4ab5-8725-c15bcd0a7806 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:29.094929 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc20571-efed-4ab5-8725-c15bcd0a7806 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:29.096507 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 652/1312] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:26:29.101559 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6598b-fa56-450d-aa7b-6640ce3433b0 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:29.101992 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6598b-fa56-450d-aa7b-6640ce3433b0 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:29.102165 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6598b-fa56-450d-aa7b-6640ce3433b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:29.183981 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-71d6598b-fa56-450d-aa7b-6640ce3433b0 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:26:29.186297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-71d6598b-fa56-450d-aa7b-6640ce3433b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:29.303801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 661/1313] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:26:29.586460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc20571-efed-4ab5-8725-c15bcd0a7806 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:26:29.588056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2cc20571-efed-4ab5-8725-c15bcd0a7806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:29.693412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc20571-efed-4ab5-8725-c15bcd0a7806 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:26:29.761930 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:26:29.764574 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db34bd-bf1b-4f15-a949-bb580da39023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:26:29.765211 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db34bd-bf1b-4f15-a949-bb580da39023 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:29.765524 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db34bd-bf1b-4f15-a949-bb580da39023 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:29.765828 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db34bd-bf1b-4f15-a949-bb580da39023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:29.767497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-60db34bd-bf1b-4f15-a949-bb580da39023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:29.873077 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db34bd-bf1b-4f15-a949-bb580da39023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:26:29.874906 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db34bd-bf1b-4f15-a949-bb580da39023 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:26:29.892742 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 653/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:26:32.366127 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ac2a2-5828-4d34-b541-017710af2de4 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:32.366680 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ac2a2-5828-4d34-b541-017710af2de4 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:32.366680 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ac2a2-5828-4d34-b541-017710af2de4 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:32.367978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 662/1315] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:26:32.374205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d10fb-574b-4378-99b6-0cb73472b94c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:32.374625 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d10fb-574b-4378-99b6-0cb73472b94c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:32.374765 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d10fb-574b-4378-99b6-0cb73472b94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:32.441719 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a25d10fb-574b-4378-99b6-0cb73472b94c None None] MFA Rules not processed for user `93259f28708c46c3b1101160a1a44db1`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:26:32.443168 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a25d10fb-574b-4378-99b6-0cb73472b94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:32.496579 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:26:32.541723 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 654/1316] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:26:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:26:32.837723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b599d12-e96a-4a6a-bb22-a4a502768ab2 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:32.838011 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b599d12-e96a-4a6a-bb22-a4a502768ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:32.838286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b599d12-e96a-4a6a-bb22-a4a502768ab2 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:32.839610 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 663/1317] 10.222.0.23 () {54 vars in 965 bytes} [Mon Sep 5 14:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:26:32.846074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b0eba-a0a6-4b23-8940-b876d239ba45 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:32.846362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b0eba-a0a6-4b23-8940-b876d239ba45 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:32.846634 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b0eba-a0a6-4b23-8940-b876d239ba45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:32.921903 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1a5b0eba-a0a6-4b23-8940-b876d239ba45 None None] MFA Rules not processed for user `b0ec118e5a114429b3e1c91041f7caf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:26:32.923137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1a5b0eba-a0a6-4b23-8940-b876d239ba45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:32.998645 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 655/1318] 10.222.0.23 () {58 vars in 1062 bytes} [Mon Sep 5 14:26:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:26:33.007777 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b599d12-e96a-4a6a-bb22-a4a502768ab2 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:26:33.009467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9b599d12-e96a-4a6a-bb22-a4a502768ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:33.020279 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:26:33.114772 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b599d12-e96a-4a6a-bb22-a4a502768ab2 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:26:33.196577 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04873144-4d59-42ac-b685-d2e010529aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:26:33.197240 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04873144-4d59-42ac-b685-d2e010529aea service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:33.197519 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04873144-4d59-42ac-b685-d2e010529aea service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:33.197792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04873144-4d59-42ac-b685-d2e010529aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:33.199569 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-04873144-4d59-42ac-b685-d2e010529aea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:33.265337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:26:33.312673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04873144-4d59-42ac-b685-d2e010529aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:26:33.314139 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04873144-4d59-42ac-b685-d2e010529aea service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:26:33.332539 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 664/1319] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:26:33 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:26:36.447265 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1aaa5-1da1-451c-b148-315991716dd4 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:36.447786 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1aaa5-1da1-451c-b148-315991716dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:36.447880 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1aaa5-1da1-451c-b148-315991716dd4 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:36.449221 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 656/1320] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:26:36.454408 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ada70e-1b53-47b0-bbdb-a5356bd3cf62 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:36.454777 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ada70e-1b53-47b0-bbdb-a5356bd3cf62 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:36.454949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ada70e-1b53-47b0-bbdb-a5356bd3cf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:36.519636 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-a0ada70e-1b53-47b0-bbdb-a5356bd3cf62 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:26:36.520820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a0ada70e-1b53-47b0-bbdb-a5356bd3cf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:36.614718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 665/1321] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:26:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:26:36.900448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1aaa5-1da1-451c-b148-315991716dd4 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:26:36.902014 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b9b1aaa5-1da1-451c-b148-315991716dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:36.954693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:26:37.009188 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1aaa5-1da1-451c-b148-315991716dd4 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:26:37.082014 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328d6ec-21a3-47fe-9661-ad54f21a46b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:26:37.082617 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328d6ec-21a3-47fe-9661-ad54f21a46b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:37.082895 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328d6ec-21a3-47fe-9661-ad54f21a46b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:37.083164 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328d6ec-21a3-47fe-9661-ad54f21a46b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:37.084815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b328d6ec-21a3-47fe-9661-ad54f21a46b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:37.184038 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:26:37.197969 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328d6ec-21a3-47fe-9661-ad54f21a46b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:26:37.199506 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328d6ec-21a3-47fe-9661-ad54f21a46b9 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:26:37.217933 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 657/1322] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:26:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:26:40.148562 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888241fc-0fd9-4473-9595-eab2fef83bc7 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:40.149157 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888241fc-0fd9-4473-9595-eab2fef83bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:40.149157 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888241fc-0fd9-4473-9595-eab2fef83bc7 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:40.150613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 666/1323] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:26:40.155917 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d6f4a-e738-4c91-9344-5bf913625ed6 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:40.156326 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d6f4a-e738-4c91-9344-5bf913625ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:40.156438 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d6f4a-e738-4c91-9344-5bf913625ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:40.224679 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9f8d6f4a-e738-4c91-9344-5bf913625ed6 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:26:40.225907 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9f8d6f4a-e738-4c91-9344-5bf913625ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:40.325242 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 658/1324] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:26:40.615113 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888241fc-0fd9-4473-9595-eab2fef83bc7 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:26:40.616793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-888241fc-0fd9-4473-9595-eab2fef83bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:40.643945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:26:40.733429 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888241fc-0fd9-4473-9595-eab2fef83bc7 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:26:40.806997 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b8257-4ebd-4877-b861-263e656ccec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:26:40.807600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b8257-4ebd-4877-b861-263e656ccec7 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:40.807876 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b8257-4ebd-4877-b861-263e656ccec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:40.811107 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b8257-4ebd-4877-b861-263e656ccec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:40.811107 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-051b8257-4ebd-4877-b861-263e656ccec7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:40.881798 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:26:40.920374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b8257-4ebd-4877-b861-263e656ccec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:26:40.923129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b8257-4ebd-4877-b861-263e656ccec7 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:26:40.944512 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 667/1325] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:26:42.923156 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e19220-6831-41ca-a168-01d83c6a8ed7 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:42.923709 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e19220-6831-41ca-a168-01d83c6a8ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:42.923850 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e19220-6831-41ca-a168-01d83c6a8ed7 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:42.925227 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 659/1326] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:26:42.930534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e675f6-b52e-47fb-b77c-97a08fd629b9 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:42.930934 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e675f6-b52e-47fb-b77c-97a08fd629b9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:42.931085 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e675f6-b52e-47fb-b77c-97a08fd629b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:42.998188 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-71e675f6-b52e-47fb-b77c-97a08fd629b9 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:26:42.999488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-71e675f6-b52e-47fb-b77c-97a08fd629b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:43.097217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 668/1327] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:26:43.400488 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e19220-6831-41ca-a168-01d83c6a8ed7 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:26:43.402180 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e0e19220-6831-41ca-a168-01d83c6a8ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:43.466725 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:26:43.510472 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e19220-6831-41ca-a168-01d83c6a8ed7 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:26:43.587213 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804db74-0eaa-48d7-92bb-f8d2e7a263fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:26:43.588078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804db74-0eaa-48d7-92bb-f8d2e7a263fc service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:43.588356 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804db74-0eaa-48d7-92bb-f8d2e7a263fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:43.588623 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804db74-0eaa-48d7-92bb-f8d2e7a263fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:43.590563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b804db74-0eaa-48d7-92bb-f8d2e7a263fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:43.715987 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:26:43.718884 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804db74-0eaa-48d7-92bb-f8d2e7a263fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:26:43.720332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804db74-0eaa-48d7-92bb-f8d2e7a263fc service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:26:43.739130 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 660/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:26:45.743312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8e3e1-9849-44ee-83a7-84bb8ca1edae None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:45.743883 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8e3e1-9849-44ee-83a7-84bb8ca1edae None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:45.743883 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8e3e1-9849-44ee-83a7-84bb8ca1edae None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:45.745258 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 669/1329] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:26:45.750582 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43a884-3330-4e62-9f32-ad5aaafc467c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:45.751000 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43a884-3330-4e62-9f32-ad5aaafc467c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:45.751246 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43a884-3330-4e62-9f32-ad5aaafc467c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:45.821448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ab43a884-3330-4e62-9f32-ad5aaafc467c None None] MFA Rules not processed for user `93259f28708c46c3b1101160a1a44db1`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:26:45.822663 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ab43a884-3330-4e62-9f32-ad5aaafc467c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:45.923893 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 661/1330] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:26:45 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:26:46.213537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8e3e1-9849-44ee-83a7-84bb8ca1edae None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:26:46.215149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d5d8e3e1-9849-44ee-83a7-84bb8ca1edae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:46.255379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:26:46.356078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8e3e1-9849-44ee-83a7-84bb8ca1edae None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:26:46.432195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287c64d-fa60-4469-9acd-42c8e7c54825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:26:46.432796 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287c64d-fa60-4469-9acd-42c8e7c54825 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:46.433105 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287c64d-fa60-4469-9acd-42c8e7c54825 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:46.433386 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287c64d-fa60-4469-9acd-42c8e7c54825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:46.435282 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9287c64d-fa60-4469-9acd-42c8e7c54825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:46.514028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:26:46.545255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287c64d-fa60-4469-9acd-42c8e7c54825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:26:46.546824 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287c64d-fa60-4469-9acd-42c8e7c54825 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:26:46.565071 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 670/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:26:46 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:26:48.971993 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1a9de-ab85-4fbc-bb51-f0cc69176be2 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:48.972524 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1a9de-ab85-4fbc-bb51-f0cc69176be2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:48.972524 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1a9de-ab85-4fbc-bb51-f0cc69176be2 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:48.973834 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 662/1332] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:26:48.979108 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d05c07-75ef-45d4-8e1d-bf044c039576 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:48.979530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d05c07-75ef-45d4-8e1d-bf044c039576 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:48.979716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d05c07-75ef-45d4-8e1d-bf044c039576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:49.046964 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-10d05c07-75ef-45d4-8e1d-bf044c039576 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:26:49.048174 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-10d05c07-75ef-45d4-8e1d-bf044c039576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:49.143644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 671/1333] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:26:49.427153 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1a9de-ab85-4fbc-bb51-f0cc69176be2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:26:49.428674 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b8c1a9de-ab85-4fbc-bb51-f0cc69176be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:49.498117 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:26:49.531906 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1a9de-ab85-4fbc-bb51-f0cc69176be2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:26:49.603072 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deda716-3f9f-4d88-af64-c1dcf65dde4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:26:49.603666 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deda716-3f9f-4d88-af64-c1dcf65dde4a service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:49.603938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deda716-3f9f-4d88-af64-c1dcf65dde4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:49.604205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deda716-3f9f-4d88-af64-c1dcf65dde4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:49.605793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0deda716-3f9f-4d88-af64-c1dcf65dde4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:49.718791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deda716-3f9f-4d88-af64-c1dcf65dde4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:26:49.720216 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deda716-3f9f-4d88-af64-c1dcf65dde4a service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:26:49.730001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:26:49.739811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 663/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:26:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:26:51.686172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e5d1f-e857-44dc-8827-137862170a60 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:51.686712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e5d1f-e857-44dc-8827-137862170a60 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:51.686712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e5d1f-e857-44dc-8827-137862170a60 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:51.688065 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 672/1335] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:26:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:26:51.693241 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecf53f-6072-4974-b971-efa0b56b3717 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:51.693652 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecf53f-6072-4974-b971-efa0b56b3717 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:51.693793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecf53f-6072-4974-b971-efa0b56b3717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:51.761973 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b1ecf53f-6072-4974-b971-efa0b56b3717 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:26:51.763403 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b1ecf53f-6072-4974-b971-efa0b56b3717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:51.859157 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 664/1336] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:26:52.148844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e5d1f-e857-44dc-8827-137862170a60 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:26:52.150436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-655e5d1f-e857-44dc-8827-137862170a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:52.191279 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:26:52.255045 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e5d1f-e857-44dc-8827-137862170a60 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:26:52.327537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d104c-cae6-434c-aae8-948ccef35533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:26:52.328151 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d104c-cae6-434c-aae8-948ccef35533 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:52.328427 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d104c-cae6-434c-aae8-948ccef35533 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:52.328699 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d104c-cae6-434c-aae8-948ccef35533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:52.330337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-549d104c-cae6-434c-aae8-948ccef35533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:52.418189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:26:52.445617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d104c-cae6-434c-aae8-948ccef35533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:26:52.447064 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d104c-cae6-434c-aae8-948ccef35533 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:26:52.464913 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 673/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:26:55.171720 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d545b6d-6bbe-4e44-8050-54496a0876e6 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:55.172282 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d545b6d-6bbe-4e44-8050-54496a0876e6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:55.172282 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d545b6d-6bbe-4e44-8050-54496a0876e6 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:55.173627 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 665/1338] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:26:55.178788 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb74b53-75ae-4455-bf10-112969047e1d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:55.179201 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb74b53-75ae-4455-bf10-112969047e1d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:55.179351 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb74b53-75ae-4455-bf10-112969047e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:55.245929 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-4eb74b53-75ae-4455-bf10-112969047e1d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:26:55.247146 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4eb74b53-75ae-4455-bf10-112969047e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:55.353322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 674/1339] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:26:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:26:55.640228 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d545b6d-6bbe-4e44-8050-54496a0876e6 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:26:55.641811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4d545b6d-6bbe-4e44-8050-54496a0876e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:55.715597 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:26:55.742315 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d545b6d-6bbe-4e44-8050-54496a0876e6 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:26:55.815199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af0327-1b89-4dac-9e9a-1e8d36b01e3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:26:55.815796 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af0327-1b89-4dac-9e9a-1e8d36b01e3d service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:26:55.816074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af0327-1b89-4dac-9e9a-1e8d36b01e3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:26:55.816343 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af0327-1b89-4dac-9e9a-1e8d36b01e3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:26:55.817947 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-88af0327-1b89-4dac-9e9a-1e8d36b01e3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:26:55.926598 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af0327-1b89-4dac-9e9a-1e8d36b01e3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:26:55.927950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af0327-1b89-4dac-9e9a-1e8d36b01e3d service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:26:55.947257 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 666/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:26:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:27:00.072559 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55476033-2731-45fc-9e50-15a8b08c4060 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:00.073193 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55476033-2731-45fc-9e50-15a8b08c4060 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:00.073193 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55476033-2731-45fc-9e50-15a8b08c4060 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:00.074469 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 675/1341] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:27:00.080497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadee8fe-3270-4d7c-a8c0-af940734609e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:00.081007 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadee8fe-3270-4d7c-a8c0-af940734609e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:00.081139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadee8fe-3270-4d7c-a8c0-af940734609e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:00.086498 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:00.149764 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-dadee8fe-3270-4d7c-a8c0-af940734609e None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:00.150996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-dadee8fe-3270-4d7c-a8c0-af940734609e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:00.256974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 667/1342] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:27:00.545716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55476033-2731-45fc-9e50-15a8b08c4060 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:27:00.547245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-55476033-2731-45fc-9e50-15a8b08c4060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:00.596301 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:00.651445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55476033-2731-45fc-9e50-15a8b08c4060 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:27:00.725422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60d6f5-514e-4bab-bad7-5682b9eaae02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:27:00.726032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60d6f5-514e-4bab-bad7-5682b9eaae02 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:00.726312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60d6f5-514e-4bab-bad7-5682b9eaae02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:00.726583 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60d6f5-514e-4bab-bad7-5682b9eaae02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:00.728193 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-cd60d6f5-514e-4bab-bad7-5682b9eaae02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:00.821359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:00.837168 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60d6f5-514e-4bab-bad7-5682b9eaae02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:27:00.838605 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60d6f5-514e-4bab-bad7-5682b9eaae02 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:27:00.857381 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 676/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:27:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:27:03.796163 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a36604-7728-4320-8bae-7ad38f50aecb None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:03.796729 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a36604-7728-4320-8bae-7ad38f50aecb None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:03.796729 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a36604-7728-4320-8bae-7ad38f50aecb None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:03.798240 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 668/1344] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:27:03.803404 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34066a-5b5d-4efd-b748-2c19feb6e606 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:03.803846 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34066a-5b5d-4efd-b748-2c19feb6e606 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:03.803980 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34066a-5b5d-4efd-b748-2c19feb6e606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:03.875576 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-bb34066a-5b5d-4efd-b748-2c19feb6e606 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:03.876686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-bb34066a-5b5d-4efd-b748-2c19feb6e606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:03.978077 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 677/1345] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:27:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:27:04.267549 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a36604-7728-4320-8bae-7ad38f50aecb None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:27:04.271911 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-22a36604-7728-4320-8bae-7ad38f50aecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:04.477311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:04.496033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a36604-7728-4320-8bae-7ad38f50aecb None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:27:04.574544 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d5b10-eefd-4fdc-b09d-c444df75e656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:27:04.575170 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d5b10-eefd-4fdc-b09d-c444df75e656 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:04.576191 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d5b10-eefd-4fdc-b09d-c444df75e656 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:04.576670 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d5b10-eefd-4fdc-b09d-c444df75e656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:04.578340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-726d5b10-eefd-4fdc-b09d-c444df75e656 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:04.695074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d5b10-eefd-4fdc-b09d-c444df75e656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:27:04.696500 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d5b10-eefd-4fdc-b09d-c444df75e656 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:27:04.715142 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 669/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:27:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:27:08.956695 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161a8d6-59f6-4565-a4c5-64a02a1e6116 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:08.957276 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161a8d6-59f6-4565-a4c5-64a02a1e6116 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:08.957385 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161a8d6-59f6-4565-a4c5-64a02a1e6116 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:08.958740 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 678/1347] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:27:08.964415 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4572c-c6d7-47fa-a641-2fa34127a3d3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:08.964901 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4572c-c6d7-47fa-a641-2fa34127a3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:08.965021 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4572c-c6d7-47fa-a641-2fa34127a3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:08.980602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:09.038540 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5ef4572c-c6d7-47fa-a641-2fa34127a3d3 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:09.039839 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5ef4572c-c6d7-47fa-a641-2fa34127a3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:09.144150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 670/1348] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:27:09.426482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161a8d6-59f6-4565-a4c5-64a02a1e6116 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:27:09.427929 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2161a8d6-59f6-4565-a4c5-64a02a1e6116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:09.487676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:09.534730 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161a8d6-59f6-4565-a4c5-64a02a1e6116 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:27:09.607889 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b20063-c4e2-4c8c-93fd-c656b8f97633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:27:09.608484 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b20063-c4e2-4c8c-93fd-c656b8f97633 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:09.608762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b20063-c4e2-4c8c-93fd-c656b8f97633 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:09.609033 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b20063-c4e2-4c8c-93fd-c656b8f97633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:09.610659 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a7b20063-c4e2-4c8c-93fd-c656b8f97633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:09.723431 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:09.727195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b20063-c4e2-4c8c-93fd-c656b8f97633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:27:09.728660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b20063-c4e2-4c8c-93fd-c656b8f97633 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:27:09.748520 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 679/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:27:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:27:14.748189 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512c541-1d1a-4660-9ca6-b29174cc7335 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:14.748700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512c541-1d1a-4660-9ca6-b29174cc7335 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:14.748814 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512c541-1d1a-4660-9ca6-b29174cc7335 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:14.752167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 671/1350] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 5 14:27:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:27:14.758241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116534d-d4a2-45e2-b2e4-c320e63671f8 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:14.759037 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116534d-d4a2-45e2-b2e4-c320e63671f8 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:14.759448 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116534d-d4a2-45e2-b2e4-c320e63671f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:14.888917 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-9116534d-d4a2-45e2-b2e4-c320e63671f8 None None] MFA Rules not processed for user `c1880dab32fa424a9356b3fe940d4856`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:14.890640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9116534d-d4a2-45e2-b2e4-c320e63671f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:15.039491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 680/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 5 14:27:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:27:19.142231 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=59 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:19.470616 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad0c38-f9fc-4957-9b91-a345142a2748 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:19.471340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad0c38-f9fc-4957-9b91-a345142a2748 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:19.471618 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad0c38-f9fc-4957-9b91-a345142a2748 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:19.473312 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 672/1352] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 5 14:27:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:27:19.478778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cb57c-e1de-485f-8cd9-1f20a06d5878 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:19.479270 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cb57c-e1de-485f-8cd9-1f20a06d5878 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:19.479550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cb57c-e1de-485f-8cd9-1f20a06d5878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:19.540156 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:19.564585 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-042cb57c-e1de-485f-8cd9-1f20a06d5878 None None] MFA Rules not processed for user `c1880dab32fa424a9356b3fe940d4856`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:19.565855 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-042cb57c-e1de-485f-8cd9-1f20a06d5878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:19.701925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 681/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 5 14:27:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:27:20.984922 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc8269-7835-42a7-91ac-e3d456bcd6ec None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:20.985452 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc8269-7835-42a7-91ac-e3d456bcd6ec None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:20.985452 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc8269-7835-42a7-91ac-e3d456bcd6ec None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:20.986749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 673/1354] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 5 14:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:27:20.991953 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03c5b1-854f-412a-82bc-98f074ad1579 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:20.992391 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03c5b1-854f-412a-82bc-98f074ad1579 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:20.992516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03c5b1-854f-412a-82bc-98f074ad1579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:21.070222 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-2d03c5b1-854f-412a-82bc-98f074ad1579 None None] MFA Rules not processed for user `c1880dab32fa424a9356b3fe940d4856`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:21.071420 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2d03c5b1-854f-412a-82bc-98f074ad1579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:21.114129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:21.182519 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 682/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 5 14:27:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:27:24.606647 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2ddd9-a2c6-4186-9a0c-92250b4341a9 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:24.607193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2ddd9-a2c6-4186-9a0c-92250b4341a9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:24.607300 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2ddd9-a2c6-4186-9a0c-92250b4341a9 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:24.608647 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 674/1356] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:27:24.614203 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b3cfb-6cb7-4c3f-b1db-45165701bfb2 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:24.614644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b3cfb-6cb7-4c3f-b1db-45165701bfb2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:24.614879 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b3cfb-6cb7-4c3f-b1db-45165701bfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:24.697257 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-479b3cfb-6cb7-4c3f-b1db-45165701bfb2 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:24.698467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-479b3cfb-6cb7-4c3f-b1db-45165701bfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:24.831210 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 683/1357] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:27:25.131747 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecc032-6e4b-489a-9435-5ac5448834ba None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:25.132495 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecc032-6e4b-489a-9435-5ac5448834ba None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:25.132992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecc032-6e4b-489a-9435-5ac5448834ba None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:25.135025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 675/1358] 10.222.0.23 () {54 vars in 962 bytes} [Mon Sep 5 14:27:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:27:25.143188 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d542-b22d-42b2-b71e-57d787405264 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:25.144522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d542-b22d-42b2-b71e-57d787405264 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:25.145112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d542-b22d-42b2-b71e-57d787405264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:25.165915 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:25.236607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-a876d542-b22d-42b2-b71e-57d787405264 None None] MFA Rules not processed for user `d5515accf3b64006bc41422265a641bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:25.237928 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a876d542-b22d-42b2-b71e-57d787405264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:25.379168 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 684/1359] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Sep 5 14:27:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:27:25.387226 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecc032-6e4b-489a-9435-5ac5448834ba None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:27:25.389326 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d3ecc032-6e4b-489a-9435-5ac5448834ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:25.567321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecc032-6e4b-489a-9435-5ac5448834ba None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:27:25.645918 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:25.694431 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3d22f-6e5d-40b1-949c-4050fbd77155 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:27:25.695031 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3d22f-6e5d-40b1-949c-4050fbd77155 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:25.695312 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3d22f-6e5d-40b1-949c-4050fbd77155 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:25.695722 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3d22f-6e5d-40b1-949c-4050fbd77155 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:25.697701 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5ac3d22f-6e5d-40b1-949c-4050fbd77155 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:25.797832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3d22f-6e5d-40b1-949c-4050fbd77155 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:27:25.799636 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3d22f-6e5d-40b1-949c-4050fbd77155 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:27:25.820032 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 676/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:27:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:27:28.010361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546eb3d-1992-4e63-b932-e1ae62c24720 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:28.011223 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546eb3d-1992-4e63-b932-e1ae62c24720 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:28.011493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546eb3d-1992-4e63-b932-e1ae62c24720 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:28.013785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 685/1361] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:27:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:27:28.019219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ceed2-7164-4d27-b916-090765cec1f0 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:28.019680 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ceed2-7164-4d27-b916-090765cec1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:28.020101 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ceed2-7164-4d27-b916-090765cec1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:28.097790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ca0ceed2-7164-4d27-b916-090765cec1f0 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:28.098974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ca0ceed2-7164-4d27-b916-090765cec1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:28.139491 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:28.212334 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 677/1362] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:27:28.509235 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546eb3d-1992-4e63-b932-e1ae62c24720 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:27:28.509235 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3546eb3d-1992-4e63-b932-e1ae62c24720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:28.590241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:28.675991 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546eb3d-1992-4e63-b932-e1ae62c24720 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:27:28.806204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b237b3-767c-4334-8793-0c844d3602b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:27:28.806816 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b237b3-767c-4334-8793-0c844d3602b3 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:28.807097 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b237b3-767c-4334-8793-0c844d3602b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:28.807369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b237b3-767c-4334-8793-0c844d3602b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:28.809958 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-89b237b3-767c-4334-8793-0c844d3602b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:28.835309 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:28.908051 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b237b3-767c-4334-8793-0c844d3602b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:27:28.909914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b237b3-767c-4334-8793-0c844d3602b3 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:27:28.931166 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 686/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:27:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:27:31.385425 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a88d5d-e865-4404-81df-d8eb512e1df4 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:31.385996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a88d5d-e865-4404-81df-d8eb512e1df4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:31.385996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a88d5d-e865-4404-81df-d8eb512e1df4 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:31.387358 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 678/1364] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:27:31.392889 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ebe7a-c72e-40f4-aebc-1cb8cf6c37b7 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:31.393383 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ebe7a-c72e-40f4-aebc-1cb8cf6c37b7 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:31.393479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ebe7a-c72e-40f4-aebc-1cb8cf6c37b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:31.467083 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-e03ebe7a-c72e-40f4-aebc-1cb8cf6c37b7 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:31.468293 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e03ebe7a-c72e-40f4-aebc-1cb8cf6c37b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:31.570768 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:31.580519 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 687/1365] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:27:31.868970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01959b-1ae8-4cb1-9112-1ce3c506171e None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:31.869361 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01959b-1ae8-4cb1-9112-1ce3c506171e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:31.869707 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01959b-1ae8-4cb1-9112-1ce3c506171e None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:31.871522 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 679/1366] 10.222.0.23 () {54 vars in 962 bytes} [Mon Sep 5 14:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:27:31.878565 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c222e2-869b-4949-bc1b-341881143a85 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:31.886489 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c222e2-869b-4949-bc1b-341881143a85 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:31.886489 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c222e2-869b-4949-bc1b-341881143a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:31.965560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-01c222e2-869b-4949-bc1b-341881143a85 None None] MFA Rules not processed for user `d5515accf3b64006bc41422265a641bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:31.966818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-01c222e2-869b-4949-bc1b-341881143a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:32.097255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 688/1367] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Sep 5 14:27:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:27:32.105323 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01959b-1ae8-4cb1-9112-1ce3c506171e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:27:32.107631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ed01959b-1ae8-4cb1-9112-1ce3c506171e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:32.276232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01959b-1ae8-4cb1-9112-1ce3c506171e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:27:32.297879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:32.396363 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3f3be-e1f7-45f9-8250-788c275ad996 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:27:32.397006 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3f3be-e1f7-45f9-8250-788c275ad996 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:32.397293 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3f3be-e1f7-45f9-8250-788c275ad996 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:32.397440 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3f3be-e1f7-45f9-8250-788c275ad996 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:32.399008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c1e3f3be-e1f7-45f9-8250-788c275ad996 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:32.497341 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3f3be-e1f7-45f9-8250-788c275ad996 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:27:32.498937 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3f3be-e1f7-45f9-8250-788c275ad996 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:27:32.517676 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 680/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:27:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:27:33.045913 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae8151-d459-44f9-9d87-a24f471d9b20 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:33.046482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae8151-d459-44f9-9d87-a24f471d9b20 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:33.046482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae8151-d459-44f9-9d87-a24f471d9b20 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:33.047930 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 689/1369] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:27:33.053203 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68dcee-fd81-48fd-9d62-9e835dd26bfa None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:33.053484 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68dcee-fd81-48fd-9d62-9e835dd26bfa None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:33.053758 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68dcee-fd81-48fd-9d62-9e835dd26bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:33.087784 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:33.125503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ba68dcee-fd81-48fd-9d62-9e835dd26bfa None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:33.126885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ba68dcee-fd81-48fd-9d62-9e835dd26bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:33.241088 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 681/1370] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:27:33.864915 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c43be-6e3a-4dcf-a2b5-d1da24fd61c5 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:33.865316 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c43be-6e3a-4dcf-a2b5-d1da24fd61c5 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:33.865677 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c43be-6e3a-4dcf-a2b5-d1da24fd61c5 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:33.867345 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 690/1371] 10.222.0.23 () {54 vars in 964 bytes} [Mon Sep 5 14:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:27:33.873346 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6645edf-d2a4-40a8-b37d-ee01c61e794d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:33.873812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6645edf-d2a4-40a8-b37d-ee01c61e794d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:33.873902 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6645edf-d2a4-40a8-b37d-ee01c61e794d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:33.980232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f6645edf-d2a4-40a8-b37d-ee01c61e794d None None] MFA Rules not processed for user `d7e1db2b6f70497ab535e0e9e86ec4ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:33.982212 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f6645edf-d2a4-40a8-b37d-ee01c61e794d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:34.037573 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:34.084518 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 682/1372] 10.222.0.23 () {58 vars in 1061 bytes} [Mon Sep 5 14:27:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:27:34.095853 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c43be-6e3a-4dcf-a2b5-d1da24fd61c5 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:27:34.097424 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f31c43be-6e3a-4dcf-a2b5-d1da24fd61c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:34.173731 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:34.240389 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c43be-6e3a-4dcf-a2b5-d1da24fd61c5 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:27:34.321391 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cdf6b-ae5f-4d09-9223-5cd7bc05bd8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:27:34.321961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cdf6b-ae5f-4d09-9223-5cd7bc05bd8c service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:34.322253 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cdf6b-ae5f-4d09-9223-5cd7bc05bd8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:34.322497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cdf6b-ae5f-4d09-9223-5cd7bc05bd8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:34.324261 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6a0cdf6b-ae5f-4d09-9223-5cd7bc05bd8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:34.445787 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:34.465254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cdf6b-ae5f-4d09-9223-5cd7bc05bd8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:27:34.465254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cdf6b-ae5f-4d09-9223-5cd7bc05bd8c service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:27:34.485651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 691/1373] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:27:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:27:34.681988 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77874477-6284-4538-8551-e58467007b07 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:34.682344 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77874477-6284-4538-8551-e58467007b07 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:34.682550 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77874477-6284-4538-8551-e58467007b07 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:34.684042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 683/1374] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:27:34.689872 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824c69d-e189-4fb2-ada9-6c13396c6ec7 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:34.690251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824c69d-e189-4fb2-ada9-6c13396c6ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:34.690753 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824c69d-e189-4fb2-ada9-6c13396c6ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:34.764661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-1824c69d-e189-4fb2-ada9-6c13396c6ec7 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:34.765916 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1824c69d-e189-4fb2-ada9-6c13396c6ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:34.864359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 692/1375] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:27:35.155207 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77874477-6284-4538-8551-e58467007b07 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:27:35.156745 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-77874477-6284-4538-8551-e58467007b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:35.307375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77874477-6284-4538-8551-e58467007b07 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:27:35.359268 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:35.421249 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af780ea8-fc72-4f73-8c05-052b3e503fa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:27:35.421789 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af780ea8-fc72-4f73-8c05-052b3e503fa7 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:35.422068 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af780ea8-fc72-4f73-8c05-052b3e503fa7 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:35.422341 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af780ea8-fc72-4f73-8c05-052b3e503fa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:35.423934 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-af780ea8-fc72-4f73-8c05-052b3e503fa7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:35.515375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af780ea8-fc72-4f73-8c05-052b3e503fa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:27:35.516977 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af780ea8-fc72-4f73-8c05-052b3e503fa7 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:27:35.535360 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 684/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:27:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:27:37.812579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f960c-3477-4635-8fbe-a36300da2cb6 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:37.813111 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f960c-3477-4635-8fbe-a36300da2cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:37.813111 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f960c-3477-4635-8fbe-a36300da2cb6 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:37.814389 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 693/1377] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:27:37.819432 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d41532-edae-435b-819b-ab23d4b10c06 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:37.819867 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d41532-edae-435b-819b-ab23d4b10c06 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:37.819963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d41532-edae-435b-819b-ab23d4b10c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:37.885156 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e5d41532-edae-435b-819b-ab23d4b10c06 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:37.886269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e5d41532-edae-435b-819b-ab23d4b10c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:37.893377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:37.985896 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 685/1378] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:27:38.280986 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f960c-3477-4635-8fbe-a36300da2cb6 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:27:38.283064 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-362f960c-3477-4635-8fbe-a36300da2cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:38.357892 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:38.446199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f960c-3477-4635-8fbe-a36300da2cb6 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:27:38.567271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2ac06-f05f-4139-8f55-807d0fdb0dfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:27:38.567869 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2ac06-f05f-4139-8f55-807d0fdb0dfe service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:38.568145 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2ac06-f05f-4139-8f55-807d0fdb0dfe service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:38.568415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2ac06-f05f-4139-8f55-807d0fdb0dfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:38.570033 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1de2ac06-f05f-4139-8f55-807d0fdb0dfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:38.590262 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:38.663754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2ac06-f05f-4139-8f55-807d0fdb0dfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:27:38.665424 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2ac06-f05f-4139-8f55-807d0fdb0dfe service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:27:38.685861 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 694/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:27:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:27:40.815743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43624243-64ff-4919-a66b-ae002b9349b9 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:40.816269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43624243-64ff-4919-a66b-ae002b9349b9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:40.816269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43624243-64ff-4919-a66b-ae002b9349b9 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:40.817872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 686/1380] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:27:40.823158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553555a-4f32-4f1c-9354-b32e9cea17d6 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:40.823617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553555a-4f32-4f1c-9354-b32e9cea17d6 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:40.823713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553555a-4f32-4f1c-9354-b32e9cea17d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:40.895457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-5553555a-4f32-4f1c-9354-b32e9cea17d6 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:40.896690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5553555a-4f32-4f1c-9354-b32e9cea17d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:40.996132 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:41.002620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 695/1381] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:27:41.294109 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43624243-64ff-4919-a66b-ae002b9349b9 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:27:41.295603 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-43624243-64ff-4919-a66b-ae002b9349b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:41.444145 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:41.455498 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43624243-64ff-4919-a66b-ae002b9349b9 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:27:41.577170 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146daf1-777e-4980-b12d-33f3ac6d5f6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:27:41.577788 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146daf1-777e-4980-b12d-33f3ac6d5f6f service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:41.578060 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146daf1-777e-4980-b12d-33f3ac6d5f6f service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:41.578334 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146daf1-777e-4980-b12d-33f3ac6d5f6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:41.579994 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5146daf1-777e-4980-b12d-33f3ac6d5f6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:41.675411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146daf1-777e-4980-b12d-33f3ac6d5f6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:27:41.677005 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146daf1-777e-4980-b12d-33f3ac6d5f6f service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:27:41.688517 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:41.696861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 687/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:27:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:27:44.108644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaa486-bc4e-40e6-a0e7-66b85548bfcc None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:44.109232 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaa486-bc4e-40e6-a0e7-66b85548bfcc None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:44.109232 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaa486-bc4e-40e6-a0e7-66b85548bfcc None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:44.110649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 696/1383] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:27:44.116953 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e1798-121c-4957-b910-2f565837cde1 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:44.117474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e1798-121c-4957-b910-2f565837cde1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:44.117586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e1798-121c-4957-b910-2f565837cde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:44.193590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-743e1798-121c-4957-b910-2f565837cde1 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:44.194842 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-743e1798-121c-4957-b910-2f565837cde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:44.302241 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 688/1384] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:27:44.597170 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebaa486-bc4e-40e6-a0e7-66b85548bfcc None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:27:44.598844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-aebaa486-bc4e-40e6-a0e7-66b85548bfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:44.756594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebaa486-bc4e-40e6-a0e7-66b85548bfcc None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:27:44.831715 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:44.879610 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9cbb5f-01fb-4f92-ad11-2bcf158d9390 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:27:44.880137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cbb5f-01fb-4f92-ad11-2bcf158d9390 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:44.880417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cbb5f-01fb-4f92-ad11-2bcf158d9390 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:44.880688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cbb5f-01fb-4f92-ad11-2bcf158d9390 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:44.882345 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4f9cbb5f-01fb-4f92-ad11-2bcf158d9390 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:44.998307 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9cbb5f-01fb-4f92-ad11-2bcf158d9390 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:27:45.000523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9cbb5f-01fb-4f92-ad11-2bcf158d9390 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:27:45.024978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 697/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:27:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:27:47.031779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aeaa7a-cdaf-470b-a37b-e146888c6fc3 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:47.032350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aeaa7a-cdaf-470b-a37b-e146888c6fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:47.032350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aeaa7a-cdaf-470b-a37b-e146888c6fc3 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:47.033693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 689/1386] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:27:47.039417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9952e-9f7c-4059-9a52-f7045322d0fe None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:47.040078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9952e-9f7c-4059-9a52-f7045322d0fe None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:47.040078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9952e-9f7c-4059-9a52-f7045322d0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:47.110180 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-91b9952e-9f7c-4059-9a52-f7045322d0fe None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:47.111408 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-91b9952e-9f7c-4059-9a52-f7045322d0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:47.145424 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:47.211311 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 698/1387] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:27:47.501188 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aeaa7a-cdaf-470b-a37b-e146888c6fc3 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:27:47.503199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f0aeaa7a-cdaf-470b-a37b-e146888c6fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:47.588291 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:47.665821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aeaa7a-cdaf-470b-a37b-e146888c6fc3 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:27:47.795381 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabb13c-402a-4f5c-940a-109677e2056c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:27:47.795986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabb13c-402a-4f5c-940a-109677e2056c service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:47.796261 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabb13c-402a-4f5c-940a-109677e2056c service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:47.796542 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabb13c-402a-4f5c-940a-109677e2056c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:47.798183 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7dabb13c-402a-4f5c-940a-109677e2056c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:47.839894 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:47.905311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dabb13c-402a-4f5c-940a-109677e2056c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:27:47.907339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dabb13c-402a-4f5c-940a-109677e2056c service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:27:47.929047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 690/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:27:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:27:50.076843 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669e2e1-d3b1-401a-afbd-8e43e3ab9585 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:50.077477 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669e2e1-d3b1-401a-afbd-8e43e3ab9585 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:50.077477 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669e2e1-d3b1-401a-afbd-8e43e3ab9585 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:50.078817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 699/1389] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:27:50.084254 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e3594-e76d-4c78-af6b-045570abbc30 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:50.084724 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e3594-e76d-4c78-af6b-045570abbc30 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:50.084832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e3594-e76d-4c78-af6b-045570abbc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:50.151364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f79e3594-e76d-4c78-af6b-045570abbc30 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:50.153311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f79e3594-e76d-4c78-af6b-045570abbc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:50.253035 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 691/1390] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:27:50.545926 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669e2e1-d3b1-401a-afbd-8e43e3ab9585 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:27:50.547541 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1669e2e1-d3b1-401a-afbd-8e43e3ab9585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:50.699783 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669e2e1-d3b1-401a-afbd-8e43e3ab9585 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:27:50.717142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:50.822233 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae6456-f19b-4958-95ca-e8df99d25cfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:27:50.827014 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae6456-f19b-4958-95ca-e8df99d25cfb service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:50.827014 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae6456-f19b-4958-95ca-e8df99d25cfb service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:50.827014 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae6456-f19b-4958-95ca-e8df99d25cfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:50.827014 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-faae6456-f19b-4958-95ca-e8df99d25cfb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:50.888244 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ab9ea-3e8d-48f3-9461-b3e56d13d908 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:50.888546 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ab9ea-3e8d-48f3-9461-b3e56d13d908 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:50.888791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ab9ea-3e8d-48f3-9461-b3e56d13d908 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:50.890313 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 692/1391] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:27:50.895040 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a751586-5fd7-4ec0-b86b-ddfe145ba273 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:50.895312 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a751586-5fd7-4ec0-b86b-ddfe145ba273 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:50.895579 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a751586-5fd7-4ec0-b86b-ddfe145ba273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:50.913278 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:50.925389 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae6456-f19b-4958-95ca-e8df99d25cfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:27:50.927017 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae6456-f19b-4958-95ca-e8df99d25cfb service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:27:50.948187 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 700/1392] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:27:50.970572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1a751586-5fd7-4ec0-b86b-ddfe145ba273 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:50.971797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1a751586-5fd7-4ec0-b86b-ddfe145ba273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:51.076554 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 693/1393] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:27:51.379594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5b3e1-bcc4-437f-afc0-879d3e361aef None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:51.380051 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5b3e1-bcc4-437f-afc0-879d3e361aef None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:51.380152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5b3e1-bcc4-437f-afc0-879d3e361aef None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:51.381487 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 701/1394] 10.222.0.23 () {54 vars in 961 bytes} [Mon Sep 5 14:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:27:51.386960 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8837d34-786f-4921-a851-f79eff3ec990 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:51.387467 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8837d34-786f-4921-a851-f79eff3ec990 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:51.387830 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8837d34-786f-4921-a851-f79eff3ec990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:51.465642 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f8837d34-786f-4921-a851-f79eff3ec990 None None] MFA Rules not processed for user `1a7e9f0daa1c48eca87d92ced265afdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:51.466841 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f8837d34-786f-4921-a851-f79eff3ec990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:51.502391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:51.545867 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 694/1395] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Sep 5 14:27:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:27:51.553570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5b3e1-bcc4-437f-afc0-879d3e361aef None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:27:51.555084 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-bfb5b3e1-bcc4-437f-afc0-879d3e361aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:51.578813 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:51.663509 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5b3e1-bcc4-437f-afc0-879d3e361aef None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:27:51.737847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ede309-c870-4dd3-92ec-fe7834350fc4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a7e9f0daa1c48eca87d92ced265afdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:27:51.738452 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ede309-c870-4dd3-92ec-fe7834350fc4 service glance] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:51.738729 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ede309-c870-4dd3-92ec-fe7834350fc4 service glance] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:51.739002 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ede309-c870-4dd3-92ec-fe7834350fc4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:51.740595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-39ede309-c870-4dd3-92ec-fe7834350fc4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:51.814134 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:51.849162 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ede309-c870-4dd3-92ec-fe7834350fc4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:27:51.850606 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ede309-c870-4dd3-92ec-fe7834350fc4 service glance] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:27:51.871366 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 702/1396] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:27:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:27:52.784337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c77b9-9426-44ac-9a50-f8a9db112b80 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:52.784854 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c77b9-9426-44ac-9a50-f8a9db112b80 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:52.784951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c77b9-9426-44ac-9a50-f8a9db112b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:52.852361 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-082c77b9-9426-44ac-9a50-f8a9db112b80 None None] MFA Rules not processed for user `635e47d0a5a34fdfb5c8967a96a87828`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:52.853597 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-082c77b9-9426-44ac-9a50-f8a9db112b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:52.943438 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 695/1397] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 5 14:27:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:27:52.986961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f1a64-7931-42e8-9be9-b67cd1772b7f None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:52.987467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f1a64-7931-42e8-9be9-b67cd1772b7f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:52.987565 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f1a64-7931-42e8-9be9-b67cd1772b7f None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:52.988837 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 703/1398] 10.222.0.23 () {54 vars in 943 bytes} [Mon Sep 5 14:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:27:52.995760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239f915-aa82-491e-8a58-5e3b7e818c22 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:52.996104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239f915-aa82-491e-8a58-5e3b7e818c22 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:52.996380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239f915-aa82-491e-8a58-5e3b7e818c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:53.006616 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551c2b6-bc00-4666-a44c-ba629ee72d57 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:53.006901 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551c2b6-bc00-4666-a44c-ba629ee72d57 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:53.007179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551c2b6-bc00-4666-a44c-ba629ee72d57 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:53.008967 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 704/1399] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:27:53.014365 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dcb5f-bed8-4076-8028-f557956ec203 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:53.014673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dcb5f-bed8-4076-8028-f557956ec203 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:53.014979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dcb5f-bed8-4076-8028-f557956ec203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:53.056103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:53.075626 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c239f915-aa82-491e-8a58-5e3b7e818c22 None None] MFA Rules not processed for user `1ed60e9eecb94ef39c2f4a5e5f50d670`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:53.076834 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c239f915-aa82-491e-8a58-5e3b7e818c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:53.082382 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-3f6dcb5f-bed8-4076-8028-f557956ec203 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:53.083636 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3f6dcb5f-bed8-4076-8028-f557956ec203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:53.181219 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 705/1400] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:27:53.190216 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 696/1401] 10.222.0.23 () {58 vars in 1040 bytes} [Mon Sep 5 14:27:52 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:27:53.202423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dcb5f-bed8-4076-8028-f557956ec203 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:27:53.203637 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3f6dcb5f-bed8-4076-8028-f557956ec203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:53.239589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:53.312282 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dcb5f-bed8-4076-8028-f557956ec203 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:27:53.420929 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82a054-5f6b-4758-a844-38c1497b603f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed60e9eecb94ef39c2f4a5e5f50d670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:27:53.421565 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82a054-5f6b-4758-a844-38c1497b603f service swift] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:53.421850 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82a054-5f6b-4758-a844-38c1497b603f service swift] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:53.422118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82a054-5f6b-4758-a844-38c1497b603f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:53.423753 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-de82a054-5f6b-4758-a844-38c1497b603f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:53.473768 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:53.484971 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239f915-aa82-491e-8a58-5e3b7e818c22 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:27:53.491340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c239f915-aa82-491e-8a58-5e3b7e818c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:53.507699 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82a054-5f6b-4758-a844-38c1497b603f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:27:53.509340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82a054-5f6b-4758-a844-38c1497b603f service swift] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:27:53.518050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 706/1402] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 5 14:27:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 05 14:27:53.587224 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239f915-aa82-491e-8a58-5e3b7e818c22 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:27:53.600725 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:53.701898 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5ad6b-3316-4496-b84d-eb6b3f2a819b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:27:53.702503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5ad6b-3316-4496-b84d-eb6b3f2a819b service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:53.702786 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5ad6b-3316-4496-b84d-eb6b3f2a819b service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:53.703060 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5ad6b-3316-4496-b84d-eb6b3f2a819b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:53.704659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-abc5ad6b-3316-4496-b84d-eb6b3f2a819b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:53.807389 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5ad6b-3316-4496-b84d-eb6b3f2a819b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:27:53.809362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5ad6b-3316-4496-b84d-eb6b3f2a819b service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:27:53.828193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 697/1403] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:27:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:27:56.049815 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed7ed6-9b21-4ffa-9a36-9135b05d13ea None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:56.050346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed7ed6-9b21-4ffa-9a36-9135b05d13ea None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:56.050346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed7ed6-9b21-4ffa-9a36-9135b05d13ea None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:56.051699 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 707/1404] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:27:56.056929 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec5494-a261-4a01-969e-ac64ce069fc7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:56.057389 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec5494-a261-4a01-969e-ac64ce069fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:56.057567 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec5494-a261-4a01-969e-ac64ce069fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:56.085912 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:56.134878 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-23ec5494-a261-4a01-969e-ac64ce069fc7 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:56.136430 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-23ec5494-a261-4a01-969e-ac64ce069fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:56.259707 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 698/1405] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:27:56.557326 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed7ed6-9b21-4ffa-9a36-9135b05d13ea None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:27:56.559941 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e4ed7ed6-9b21-4ffa-9a36-9135b05d13ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:56.757547 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed7ed6-9b21-4ffa-9a36-9135b05d13ea None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:27:56.803876 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:56.890425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1aba8-0ea8-426d-a61d-04d66cfc8096 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:27:56.891332 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1aba8-0ea8-426d-a61d-04d66cfc8096 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:56.891770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1aba8-0ea8-426d-a61d-04d66cfc8096 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:56.892047 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1aba8-0ea8-426d-a61d-04d66cfc8096 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:56.893801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1bf1aba8-0ea8-426d-a61d-04d66cfc8096 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:56.994947 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1aba8-0ea8-426d-a61d-04d66cfc8096 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:27:56.997468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1aba8-0ea8-426d-a61d-04d66cfc8096 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:27:57.020751 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 708/1406] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:27:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:27:59.097132 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39f41f-37d5-4183-8685-8c4ed84e3f57 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:59.097702 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39f41f-37d5-4183-8685-8c4ed84e3f57 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:59.097702 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39f41f-37d5-4183-8685-8c4ed84e3f57 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:59.099013 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 699/1407] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:27:59.104223 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776ed12-c14a-4a03-aeef-5be2666c5665 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:59.104671 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776ed12-c14a-4a03-aeef-5be2666c5665 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:59.104845 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776ed12-c14a-4a03-aeef-5be2666c5665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:59.179617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:59.187686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-f776ed12-c14a-4a03-aeef-5be2666c5665 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:27:59.188998 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f776ed12-c14a-4a03-aeef-5be2666c5665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:59.299740 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 709/1408] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:27:59.597512 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39f41f-37d5-4183-8685-8c4ed84e3f57 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:27:59.599026 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8e39f41f-37d5-4183-8685-8c4ed84e3f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:59.702198 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:59.765912 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39f41f-37d5-4183-8685-8c4ed84e3f57 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:27:59.893309 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d3989-c08e-4bc3-997a-f27aa4d1974d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:27:59.894173 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d3989-c08e-4bc3-997a-f27aa4d1974d service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:27:59.894458 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d3989-c08e-4bc3-997a-f27aa4d1974d service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:27:59.894848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d3989-c08e-4bc3-997a-f27aa4d1974d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:27:59.896436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-417d3989-c08e-4bc3-997a-f27aa4d1974d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:27:59.967716 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:00.036596 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d3989-c08e-4bc3-997a-f27aa4d1974d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:28:00.038728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d3989-c08e-4bc3-997a-f27aa4d1974d service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:28:00.080820 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 700/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:27:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:28:09.297628 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=44 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:10.064819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=19 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:16.922144 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad33474-97a1-464c-9cf2-1073deb170c2 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:16.922678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad33474-97a1-464c-9cf2-1073deb170c2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:16.922678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad33474-97a1-464c-9cf2-1073deb170c2 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:16.923947 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 710/1410] 10.222.0.23 () {54 vars in 918 bytes} [Mon Sep 5 14:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:28:16.929180 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9204d3-6a64-49d4-a7fa-9cb0746fccee None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:16.929622 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9204d3-6a64-49d4-a7fa-9cb0746fccee None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:16.929735 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9204d3-6a64-49d4-a7fa-9cb0746fccee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:17.007536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2c9204d3-6a64-49d4-a7fa-9cb0746fccee None None] MFA Rules not processed for user `c1880dab32fa424a9356b3fe940d4856`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:28:17.008743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2c9204d3-6a64-49d4-a7fa-9cb0746fccee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:17.112893 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 701/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Sep 5 14:28:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:28:17.127597 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632bea5-9067-4726-bd4c-9b012e7c3eee None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:17.127877 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632bea5-9067-4726-bd4c-9b012e7c3eee None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:17.128150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632bea5-9067-4726-bd4c-9b012e7c3eee None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:17.129493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 711/1412] 10.222.0.23 () {54 vars in 918 bytes} [Mon Sep 5 14:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:28:17.134154 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a3082-b829-4d72-a23d-5611f37ae0cf None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:17.134447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a3082-b829-4d72-a23d-5611f37ae0cf None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:17.134725 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a3082-b829-4d72-a23d-5611f37ae0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:17.208155 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:17.210706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-561a3082-b829-4d72-a23d-5611f37ae0cf None None] MFA Rules not processed for user `d5515accf3b64006bc41422265a641bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:28:17.211914 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-561a3082-b829-4d72-a23d-5611f37ae0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:17.330018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 702/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Sep 5 14:28:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:28:19.705894 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735eda73-faa4-4e1c-a0f2-d804df89ce27 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:19.706370 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735eda73-faa4-4e1c-a0f2-d804df89ce27 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:19.706462 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735eda73-faa4-4e1c-a0f2-d804df89ce27 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:19.707750 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 14:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:28:19.712990 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550b7cb-9bb6-473e-a384-fd57d2e9158a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:19.713416 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550b7cb-9bb6-473e-a384-fd57d2e9158a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:19.713782 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550b7cb-9bb6-473e-a384-fd57d2e9158a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:19.778626 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8550b7cb-9bb6-473e-a384-fd57d2e9158a None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:28:19.779842 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8550b7cb-9bb6-473e-a384-fd57d2e9158a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:19.835593 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:19.877048 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 14:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:28:20.175676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735eda73-faa4-4e1c-a0f2-d804df89ce27 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:28:20.177245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-735eda73-faa4-4e1c-a0f2-d804df89ce27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:20.327191 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735eda73-faa4-4e1c-a0f2-d804df89ce27 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:28:20.443458 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:20.493118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959e2f8-9c35-47a6-8485-becf5ae0ff07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:28:20.493731 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959e2f8-9c35-47a6-8485-becf5ae0ff07 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:20.494009 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959e2f8-9c35-47a6-8485-becf5ae0ff07 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:20.494277 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959e2f8-9c35-47a6-8485-becf5ae0ff07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:20.496492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1959e2f8-9c35-47a6-8485-becf5ae0ff07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:20.595961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959e2f8-9c35-47a6-8485-becf5ae0ff07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:28:20.598001 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959e2f8-9c35-47a6-8485-becf5ae0ff07 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:28:20.616687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 713/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:28:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:28:21.546579 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8097f-4813-460e-82f7-3e8d7c318c74 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:21.547121 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8097f-4813-460e-82f7-3e8d7c318c74 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:21.547121 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff8097f-4813-460e-82f7-3e8d7c318c74 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:21.548464 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 14:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:28:21.553499 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d73471-139a-45a5-9287-4cf6ddf16239 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:21.553941 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d73471-139a-45a5-9287-4cf6ddf16239 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:21.554061 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d73471-139a-45a5-9287-4cf6ddf16239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:21.631944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-64d73471-139a-45a5-9287-4cf6ddf16239 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:28:21.633181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-64d73471-139a-45a5-9287-4cf6ddf16239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:21.661329 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:21.729490 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 14:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:28:21.880683 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8097f-4813-460e-82f7-3e8d7c318c74 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:28:21.882149 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cff8097f-4813-460e-82f7-3e8d7c318c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:22.026759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff8097f-4813-460e-82f7-3e8d7c318c74 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:28:22.066450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:22.142274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd315b-97f1-428b-afb6-2ca32509a4f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:28:22.143931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd315b-97f1-428b-afb6-2ca32509a4f1 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:22.144219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd315b-97f1-428b-afb6-2ca32509a4f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:22.144497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd315b-97f1-428b-afb6-2ca32509a4f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:22.146253 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1ddd315b-97f1-428b-afb6-2ca32509a4f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:22.237543 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd315b-97f1-428b-afb6-2ca32509a4f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:28:22.240426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd315b-97f1-428b-afb6-2ca32509a4f1 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:28:22.258108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 705/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:28:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:28:23.140122 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a081e-fa69-49ec-a7ee-0c856dcd85fe None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:23.140667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a081e-fa69-49ec-a7ee-0c856dcd85fe None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:23.140667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a081e-fa69-49ec-a7ee-0c856dcd85fe None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:23.142005 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 14:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:28:23.146957 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45edc3-d4dc-43bf-971a-31ced43c9ac0 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:23.147359 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45edc3-d4dc-43bf-971a-31ced43c9ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:23.147514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45edc3-d4dc-43bf-971a-31ced43c9ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:23.203134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:23.224658 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6e45edc3-d4dc-43bf-971a-31ced43c9ac0 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:28:23.225915 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6e45edc3-d4dc-43bf-971a-31ced43c9ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:23.325249 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 14:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:28:23.474515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a081e-fa69-49ec-a7ee-0c856dcd85fe None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:28:23.475969 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-744a081e-fa69-49ec-a7ee-0c856dcd85fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:23.623972 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a081e-fa69-49ec-a7ee-0c856dcd85fe None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:28:23.636547 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:23.737195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ce71c-4bbb-4c2e-9d4c-8abf4fd931ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:28:23.737734 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ce71c-4bbb-4c2e-9d4c-8abf4fd931ff service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:23.738014 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ce71c-4bbb-4c2e-9d4c-8abf4fd931ff service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:23.738285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ce71c-4bbb-4c2e-9d4c-8abf4fd931ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:23.739889 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-236ce71c-4bbb-4c2e-9d4c-8abf4fd931ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:23.828267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ce71c-4bbb-4c2e-9d4c-8abf4fd931ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:28:23.829951 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ce71c-4bbb-4c2e-9d4c-8abf4fd931ff service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:28:23.847438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 716/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:28:24.709539 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d54ce-0c7b-44f6-8cb3-26228b3f4abd None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:24.710088 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d54ce-0c7b-44f6-8cb3-26228b3f4abd None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:24.710197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d54ce-0c7b-44f6-8cb3-26228b3f4abd None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:24.711483 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 14:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:28:24.716457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9430806-482c-4b7e-84e6-b179ec567fbc None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:24.716875 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9430806-482c-4b7e-84e6-b179ec567fbc None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:24.717006 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9430806-482c-4b7e-84e6-b179ec567fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:24.738364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:24.796459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d9430806-482c-4b7e-84e6-b179ec567fbc None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:28:24.797972 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d9430806-482c-4b7e-84e6-b179ec567fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:24.894890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 14:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:28:25.052961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d54ce-0c7b-44f6-8cb3-26228b3f4abd None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:28:25.054562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e02d54ce-0c7b-44f6-8cb3-26228b3f4abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:25.163887 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:25.199889 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d54ce-0c7b-44f6-8cb3-26228b3f4abd None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:28:25.313775 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f987c8a-cc4e-414e-a8da-bcb96b4397c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:28:25.314385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f987c8a-cc4e-414e-a8da-bcb96b4397c9 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:25.314664 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f987c8a-cc4e-414e-a8da-bcb96b4397c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:25.314962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f987c8a-cc4e-414e-a8da-bcb96b4397c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:25.316609 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0f987c8a-cc4e-414e-a8da-bcb96b4397c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:25.397396 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:25.411283 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f987c8a-cc4e-414e-a8da-bcb96b4397c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:28:25.412859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f987c8a-cc4e-414e-a8da-bcb96b4397c9 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:28:25.430204 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 708/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:28:26.289977 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e83054-dfce-4575-ba14-7edb94d7ffe5 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:26.290490 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e83054-dfce-4575-ba14-7edb94d7ffe5 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:26.290490 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e83054-dfce-4575-ba14-7edb94d7ffe5 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:26.292114 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 14:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:28:26.297241 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5226b-beda-4f98-a09f-2917697bef95 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:26.297664 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5226b-beda-4f98-a09f-2917697bef95 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:26.297777 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5226b-beda-4f98-a09f-2917697bef95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:26.375292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-22b5226b-beda-4f98-a09f-2917697bef95 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:28:26.376499 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-22b5226b-beda-4f98-a09f-2917697bef95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:26.472921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 14:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:28:26.622801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e83054-dfce-4575-ba14-7edb94d7ffe5 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:28:26.624316 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-14e83054-dfce-4575-ba14-7edb94d7ffe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:26.716758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:26.777577 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e83054-dfce-4575-ba14-7edb94d7ffe5 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:28:26.887061 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5116af-9dfd-4889-82e4-39d93453ecb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:28:26.887591 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5116af-9dfd-4889-82e4-39d93453ecb6 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:26.887863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5116af-9dfd-4889-82e4-39d93453ecb6 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:26.888128 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5116af-9dfd-4889-82e4-39d93453ecb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:26.889735 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6d5116af-9dfd-4889-82e4-39d93453ecb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:26.937840 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:26.977945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5116af-9dfd-4889-82e4-39d93453ecb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:28:26.980091 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5116af-9dfd-4889-82e4-39d93453ecb6 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:28:26.998413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 719/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:28:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:28:27.919662 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf8d8a-c314-4a1d-b4b3-ec20881ef472 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:27.920186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf8d8a-c314-4a1d-b4b3-ec20881ef472 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:27.920186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf8d8a-c314-4a1d-b4b3-ec20881ef472 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:27.921555 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 14:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:28:27.926409 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01e888-00d0-4848-ad76-444e24bc0d99 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:27.926803 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01e888-00d0-4848-ad76-444e24bc0d99 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:27.926963 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01e888-00d0-4848-ad76-444e24bc0d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:28.005237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-7f01e888-00d0-4848-ad76-444e24bc0d99 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:28:28.006435 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7f01e888-00d0-4848-ad76-444e24bc0d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:28.101882 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 14:28:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:28:28.255918 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf8d8a-c314-4a1d-b4b3-ec20881ef472 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:28:28.257455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-12bf8d8a-c314-4a1d-b4b3-ec20881ef472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:28.306053 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:28.402771 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf8d8a-c314-4a1d-b4b3-ec20881ef472 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:28:28.514671 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf1ee6-6210-49ba-8691-acbd613d26f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:28:28.515278 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf1ee6-6210-49ba-8691-acbd613d26f1 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:28.515556 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf1ee6-6210-49ba-8691-acbd613d26f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:28.515826 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf1ee6-6210-49ba-8691-acbd613d26f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:28.517439 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a4bf1ee6-6210-49ba-8691-acbd613d26f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:28.524263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:28.608850 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf1ee6-6210-49ba-8691-acbd613d26f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:28:28.610469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf1ee6-6210-49ba-8691-acbd613d26f1 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:28:28.629033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 711/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:28:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:28:29.498403 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae27a8-a2e7-4451-a394-5a22cec3a558 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:29.498963 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae27a8-a2e7-4451-a394-5a22cec3a558 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:29.498963 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae27a8-a2e7-4451-a394-5a22cec3a558 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:29.500325 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 14:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:28:29.505429 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d13a93-6672-469e-a00b-b8d86561a18a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:29.505833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d13a93-6672-469e-a00b-b8d86561a18a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:29.505997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d13a93-6672-469e-a00b-b8d86561a18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:29.583105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a7d13a93-6672-469e-a00b-b8d86561a18a None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:28:29.584315 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a7d13a93-6672-469e-a00b-b8d86561a18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:29.651469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:29.680270 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 14:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:28:29.832695 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae27a8-a2e7-4451-a394-5a22cec3a558 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:28:29.834222 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e6ae27a8-a2e7-4451-a394-5a22cec3a558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:29.851958 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:29.979473 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae27a8-a2e7-4451-a394-5a22cec3a558 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:28:30.065174 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:30.091095 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10190b-e9a7-48f5-b62c-e318982b1ce7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:28:30.091633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10190b-e9a7-48f5-b62c-e318982b1ce7 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:30.091915 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10190b-e9a7-48f5-b62c-e318982b1ce7 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:30.092189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10190b-e9a7-48f5-b62c-e318982b1ce7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:30.093853 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1a10190b-e9a7-48f5-b62c-e318982b1ce7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:30.192990 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10190b-e9a7-48f5-b62c-e318982b1ce7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:28:30.194646 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10190b-e9a7-48f5-b62c-e318982b1ce7 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:28:30.213406 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 722/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:28:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:28:31.076992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d0c98-149a-465c-a2bc-83e961c4360e None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:31.077567 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d0c98-149a-465c-a2bc-83e961c4360e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:31.077567 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d0c98-149a-465c-a2bc-83e961c4360e None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:31.078829 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 14:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:28:31.083856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b1164-0a78-449b-b59e-009138eb4a26 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:31.084239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b1164-0a78-449b-b59e-009138eb4a26 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:31.084399 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b1164-0a78-449b-b59e-009138eb4a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:31.158878 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-fc2b1164-0a78-449b-b59e-009138eb4a26 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:28:31.160069 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fc2b1164-0a78-449b-b59e-009138eb4a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:31.202073 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:31.258031 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 14:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:28:31.407517 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d0c98-149a-465c-a2bc-83e961c4360e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:28:31.409010 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a45d0c98-149a-465c-a2bc-83e961c4360e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:31.556111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d0c98-149a-465c-a2bc-83e961c4360e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:28:31.610507 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:31.669729 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9a1be-7508-4c58-bc64-d014d269179b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:28:31.670632 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9a1be-7508-4c58-bc64-d014d269179b service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:31.670632 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9a1be-7508-4c58-bc64-d014d269179b service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:31.670818 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9a1be-7508-4c58-bc64-d014d269179b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:31.672408 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d0a9a1be-7508-4c58-bc64-d014d269179b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:31.760842 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9a1be-7508-4c58-bc64-d014d269179b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:28:31.762645 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9a1be-7508-4c58-bc64-d014d269179b service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:28:31.780845 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 714/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:28:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:28:32.639656 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1e686-c7d5-4810-9cad-c909ad1390f1 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:32.640218 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1e686-c7d5-4810-9cad-c909ad1390f1 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:32.640218 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1e686-c7d5-4810-9cad-c909ad1390f1 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:32.641581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 14:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:28:32.646685 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c083a8-482c-4ec8-b514-3f6105a4b9d6 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:32.647088 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c083a8-482c-4ec8-b514-3f6105a4b9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:32.647238 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c083a8-482c-4ec8-b514-3f6105a4b9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:32.723456 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-03c083a8-482c-4ec8-b514-3f6105a4b9d6 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:28:32.724658 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-03c083a8-482c-4ec8-b514-3f6105a4b9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:32.726705 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:32.821281 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 14:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:28:32.973535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1e686-c7d5-4810-9cad-c909ad1390f1 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:28:32.974980 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-50f1e686-c7d5-4810-9cad-c909ad1390f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:33.123648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1e686-c7d5-4810-9cad-c909ad1390f1 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:28:33.149883 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:33.238268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebabcd-ac46-4e17-9613-128a160b1ece service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:28:33.238922 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebabcd-ac46-4e17-9613-128a160b1ece service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:33.239196 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebabcd-ac46-4e17-9613-128a160b1ece service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:33.239460 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebabcd-ac46-4e17-9613-128a160b1ece service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:33.241073 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3cebabcd-ac46-4e17-9613-128a160b1ece service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:33.330481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cebabcd-ac46-4e17-9613-128a160b1ece service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:28:33.332098 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cebabcd-ac46-4e17-9613-128a160b1ece service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:28:33.350188 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 725/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:28:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:28:35.175579 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a1965-f8ba-450c-923e-128eaa0ae2a8 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:35.176152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a1965-f8ba-450c-923e-128eaa0ae2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:35.176152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a1965-f8ba-450c-923e-128eaa0ae2a8 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:35.177527 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 14:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:28:35.182697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072615d6-7973-45e8-a59e-4d2be6fd56cf None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:35.183175 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072615d6-7973-45e8-a59e-4d2be6fd56cf None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:35.183368 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072615d6-7973-45e8-a59e-4d2be6fd56cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:35.225545 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:35.251761 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-072615d6-7973-45e8-a59e-4d2be6fd56cf None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:28:35.252991 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-072615d6-7973-45e8-a59e-4d2be6fd56cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:35.352101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 14:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:28:35.634487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a1965-f8ba-450c-923e-128eaa0ae2a8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:28:35.636009 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-da2a1965-f8ba-450c-923e-128eaa0ae2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:35.742700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a1965-f8ba-450c-923e-128eaa0ae2a8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:28:35.776559 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:35.820539 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c81fa-f92c-43f9-b283-7cf5fe2213dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:28:35.821167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c81fa-f92c-43f9-b283-7cf5fe2213dc service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:35.821444 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c81fa-f92c-43f9-b283-7cf5fe2213dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:35.821713 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c81fa-f92c-43f9-b283-7cf5fe2213dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:35.823290 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-326c81fa-f92c-43f9-b283-7cf5fe2213dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:35.929035 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c81fa-f92c-43f9-b283-7cf5fe2213dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:28:35.930404 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c81fa-f92c-43f9-b283-7cf5fe2213dc service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:28:35.949417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 717/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:28:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:28:38.087989 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179c2dd-5d49-4162-a17f-620b5d0ffb2f None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:38.088582 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179c2dd-5d49-4162-a17f-620b5d0ffb2f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:38.088582 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179c2dd-5d49-4162-a17f-620b5d0ffb2f None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:38.090580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 14:28:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:28:38.095869 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfdf09-ebcf-4248-8ce3-d710a0bb4973 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:38.096277 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfdf09-ebcf-4248-8ce3-d710a0bb4973 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:38.096415 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfdf09-ebcf-4248-8ce3-d710a0bb4973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:38.163011 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9ebfdf09-ebcf-4248-8ce3-d710a0bb4973 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:28:38.164218 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9ebfdf09-ebcf-4248-8ce3-d710a0bb4973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:38.176954 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:38.276160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 14:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:28:38.569639 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179c2dd-5d49-4162-a17f-620b5d0ffb2f None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:28:38.571206 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7179c2dd-5d49-4162-a17f-620b5d0ffb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:38.674430 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179c2dd-5d49-4162-a17f-620b5d0ffb2f None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:28:38.688134 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:38.748131 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2464c3-0e7f-497f-85b5-8de658af06ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:28:38.748726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2464c3-0e7f-497f-85b5-8de658af06ac service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:38.748999 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2464c3-0e7f-497f-85b5-8de658af06ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:38.749356 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2464c3-0e7f-497f-85b5-8de658af06ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:38.750948 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7b2464c3-0e7f-497f-85b5-8de658af06ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:38.858685 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2464c3-0e7f-497f-85b5-8de658af06ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:28:38.860074 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2464c3-0e7f-497f-85b5-8de658af06ac service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:28:38.878519 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 728/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:28:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:28:41.151507 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8de2-3bcb-4198-ba77-8b763282dc74 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:41.152043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8de2-3bcb-4198-ba77-8b763282dc74 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:41.152139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8de2-3bcb-4198-ba77-8b763282dc74 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:41.153556 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 14:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:28:41.158752 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6374c4-15e1-4ece-9979-735e035eec09 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:41.159182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6374c4-15e1-4ece-9979-735e035eec09 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:41.159304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6374c4-15e1-4ece-9979-735e035eec09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:41.208058 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:41.228228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-3b6374c4-15e1-4ece-9979-735e035eec09 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:28:41.229476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3b6374c4-15e1-4ece-9979-735e035eec09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:41.327239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 14:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:28:41.611691 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f8de2-3bcb-4198-ba77-8b763282dc74 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:28:41.613279 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-070f8de2-3bcb-4198-ba77-8b763282dc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:41.717893 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f8de2-3bcb-4198-ba77-8b763282dc74 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:28:41.757036 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:41.791466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc4710-8737-42d8-987c-237ccf6d763f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:28:41.792497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc4710-8737-42d8-987c-237ccf6d763f service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:41.792779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc4710-8737-42d8-987c-237ccf6d763f service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:41.793049 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc4710-8737-42d8-987c-237ccf6d763f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:41.794654 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c4fc4710-8737-42d8-987c-237ccf6d763f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:41.900240 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc4710-8737-42d8-987c-237ccf6d763f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:28:41.902304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc4710-8737-42d8-987c-237ccf6d763f service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:28:41.920520 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 720/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:28:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:28:43.939268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7a9a9-4b22-4d2f-9387-1b172438d28f None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:43.939794 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7a9a9-4b22-4d2f-9387-1b172438d28f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:43.939794 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7a9a9-4b22-4d2f-9387-1b172438d28f None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:43.941083 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 14:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:28:43.946206 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460249b-faf0-473c-8a41-5fe8d4b13e11 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:43.946649 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460249b-faf0-473c-8a41-5fe8d4b13e11 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:43.946752 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460249b-faf0-473c-8a41-5fe8d4b13e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:44.015055 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d460249b-faf0-473c-8a41-5fe8d4b13e11 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:28:44.016252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d460249b-faf0-473c-8a41-5fe8d4b13e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:44.037422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:44.114008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 14:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:28:44.408057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7a9a9-4b22-4d2f-9387-1b172438d28f None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:28:44.409642 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8bc7a9a9-4b22-4d2f-9387-1b172438d28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:44.518362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7a9a9-4b22-4d2f-9387-1b172438d28f None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:28:44.537546 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:44.590616 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba6a34-c280-4b66-ad4c-384414c05572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:28:44.591245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba6a34-c280-4b66-ad4c-384414c05572 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:44.591521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba6a34-c280-4b66-ad4c-384414c05572 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:44.591790 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba6a34-c280-4b66-ad4c-384414c05572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:44.593398 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-03ba6a34-c280-4b66-ad4c-384414c05572 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:44.702123 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba6a34-c280-4b66-ad4c-384414c05572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:28:44.703570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba6a34-c280-4b66-ad4c-384414c05572 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:28:44.721535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 731/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:28:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:28:46.669832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5719512-6916-4c28-b44f-8bce194b8527 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:46.670417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5719512-6916-4c28-b44f-8bce194b8527 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:46.670417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5719512-6916-4c28-b44f-8bce194b8527 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:46.671679 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 14:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:28:46.676871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672fb3a-c568-4584-8bc7-b6525521d347 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:46.677310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672fb3a-c568-4584-8bc7-b6525521d347 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:46.677472 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672fb3a-c568-4584-8bc7-b6525521d347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:46.743127 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:46.747218 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c672fb3a-c568-4584-8bc7-b6525521d347 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:28:46.748454 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c672fb3a-c568-4584-8bc7-b6525521d347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:46.848319 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 14:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:28:47.147770 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5719512-6916-4c28-b44f-8bce194b8527 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:28:47.149326 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f5719512-6916-4c28-b44f-8bce194b8527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:47.256306 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5719512-6916-4c28-b44f-8bce194b8527 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:28:47.304733 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:47.330877 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7d32a-89a4-4a83-8c9a-7b694d1ac733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:28:47.331481 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7d32a-89a4-4a83-8c9a-7b694d1ac733 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:47.331760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7d32a-89a4-4a83-8c9a-7b694d1ac733 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:47.332032 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7d32a-89a4-4a83-8c9a-7b694d1ac733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:47.333660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fef7d32a-89a4-4a83-8c9a-7b694d1ac733 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:47.443453 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef7d32a-89a4-4a83-8c9a-7b694d1ac733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:28:47.444804 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef7d32a-89a4-4a83-8c9a-7b694d1ac733 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:28:47.464240 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 723/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:28:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:28:49.425153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dea1d1-0b1b-41c7-b400-fd37c5c99c0a None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:49.425718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dea1d1-0b1b-41c7-b400-fd37c5c99c0a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:49.425718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dea1d1-0b1b-41c7-b400-fd37c5c99c0a None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:49.427055 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 14:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:28:49.432384 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7d3ef-dda4-4a87-84bd-fbfa3fba2e72 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:49.433219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7d3ef-dda4-4a87-84bd-fbfa3fba2e72 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:49.433639 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7d3ef-dda4-4a87-84bd-fbfa3fba2e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:49.502187 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-46b7d3ef-dda4-4a87-84bd-fbfa3fba2e72 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:28:49.503498 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-46b7d3ef-dda4-4a87-84bd-fbfa3fba2e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:49.532827 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:49.599215 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 14:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:28:49.887768 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dea1d1-0b1b-41c7-b400-fd37c5c99c0a None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:28:49.889351 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c9dea1d1-0b1b-41c7-b400-fd37c5c99c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:49.991427 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dea1d1-0b1b-41c7-b400-fd37c5c99c0a None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:28:50.019499 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:50.065403 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736e68c-6a97-472f-9603-c35c72904162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:28:50.066011 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736e68c-6a97-472f-9603-c35c72904162 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:50.066288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736e68c-6a97-472f-9603-c35c72904162 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:50.066562 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736e68c-6a97-472f-9603-c35c72904162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:50.068160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d736e68c-6a97-472f-9603-c35c72904162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:50.176739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736e68c-6a97-472f-9603-c35c72904162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:28:50.178253 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736e68c-6a97-472f-9603-c35c72904162 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:28:50.196698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 734/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:28:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:28:52.169043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1d8b6-0e06-4745-8571-38bd0d0cabc6 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:52.169606 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1d8b6-0e06-4745-8571-38bd0d0cabc6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:52.169606 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1d8b6-0e06-4745-8571-38bd0d0cabc6 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:52.170942 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 14:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:28:52.176096 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01ef73-55b3-433e-8d00-f79883164339 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:52.176545 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01ef73-55b3-433e-8d00-f79883164339 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:52.176680 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01ef73-55b3-433e-8d00-f79883164339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:52.246207 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-ef01ef73-55b3-433e-8d00-f79883164339 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:28:52.247423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ef01ef73-55b3-433e-8d00-f79883164339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:52.255762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:52.355293 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 14:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:28:52.639833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1d8b6-0e06-4745-8571-38bd0d0cabc6 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:28:52.641687 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-93f1d8b6-0e06-4745-8571-38bd0d0cabc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:52.747043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1d8b6-0e06-4745-8571-38bd0d0cabc6 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:28:52.802741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:52.822522 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49ba0d-3f36-4198-b519-1bb23ad568ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:28:52.823146 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49ba0d-3f36-4198-b519-1bb23ad568ca service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:52.823448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49ba0d-3f36-4198-b519-1bb23ad568ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:52.823814 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49ba0d-3f36-4198-b519-1bb23ad568ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:52.825815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cb49ba0d-3f36-4198-b519-1bb23ad568ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:52.933638 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49ba0d-3f36-4198-b519-1bb23ad568ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:28:52.935284 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49ba0d-3f36-4198-b519-1bb23ad568ca service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:28:52.954024 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 726/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:28:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:28:54.910874 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e223d-c438-42e3-b691-40ae4431b0c4 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:54.911413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e223d-c438-42e3-b691-40ae4431b0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:54.911413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e223d-c438-42e3-b691-40ae4431b0c4 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:54.912751 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 14:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:28:54.918033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62072f3-e334-4209-a28a-59810d9eaf8d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:54.918450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62072f3-e334-4209-a28a-59810d9eaf8d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:54.918563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62072f3-e334-4209-a28a-59810d9eaf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:54.986395 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f62072f3-e334-4209-a28a-59810d9eaf8d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:28:54.987593 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f62072f3-e334-4209-a28a-59810d9eaf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:55.025144 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:55.082872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 14:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:28:55.368911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e223d-c438-42e3-b691-40ae4431b0c4 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:28:55.370587 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-711e223d-c438-42e3-b691-40ae4431b0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:55.472248 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e223d-c438-42e3-b691-40ae4431b0c4 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:28:55.509807 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:55.547689 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0228516-1689-47a8-b206-78ad9119e8fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:28:55.548694 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0228516-1689-47a8-b206-78ad9119e8fe service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:55.549235 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0228516-1689-47a8-b206-78ad9119e8fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:55.549707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0228516-1689-47a8-b206-78ad9119e8fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:55.552786 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b0228516-1689-47a8-b206-78ad9119e8fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:55.663026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0228516-1689-47a8-b206-78ad9119e8fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:28:55.664468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0228516-1689-47a8-b206-78ad9119e8fe service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:28:55.683910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 737/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:28:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:28:57.708017 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f96f8-987a-49e8-a342-4e820ef3f750 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:57.708494 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f96f8-987a-49e8-a342-4e820ef3f750 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:57.708605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f96f8-987a-49e8-a342-4e820ef3f750 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:57.709946 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 14:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:28:57.715247 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30e8c4-fa5f-4b64-9bb6-be418e97cd68 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:57.715679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30e8c4-fa5f-4b64-9bb6-be418e97cd68 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:57.715786 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30e8c4-fa5f-4b64-9bb6-be418e97cd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:57.782532 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-6e30e8c4-fa5f-4b64-9bb6-be418e97cd68 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:28:57.783756 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6e30e8c4-fa5f-4b64-9bb6-be418e97cd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:57.802174 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:57.883842 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 14:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:28:58.171123 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f96f8-987a-49e8-a342-4e820ef3f750 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:28:58.172649 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-565f96f8-987a-49e8-a342-4e820ef3f750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:58.279167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f96f8-987a-49e8-a342-4e820ef3f750 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:28:58.345668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:28:58.352403 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17b230-3c21-4a54-b980-2895ba5738f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:28:58.353006 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17b230-3c21-4a54-b980-2895ba5738f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:28:58.355311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17b230-3c21-4a54-b980-2895ba5738f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:28:58.355311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17b230-3c21-4a54-b980-2895ba5738f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:28:58.355722 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3e17b230-3c21-4a54-b980-2895ba5738f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:28:58.468127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17b230-3c21-4a54-b980-2895ba5738f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:28:58.469588 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17b230-3c21-4a54-b980-2895ba5738f1 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:28:58.488499 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 729/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:28:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:29:00.423372 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ff105-18a1-402a-a9c5-af6c57544a4b None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:00.423908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ff105-18a1-402a-a9c5-af6c57544a4b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:00.423999 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ff105-18a1-402a-a9c5-af6c57544a4b None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:00.425305 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 14:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:29:00.430600 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3337e5-f5fb-4810-ab59-c481f5db6a4b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:00.431044 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3337e5-f5fb-4810-ab59-c481f5db6a4b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:00.431162 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3337e5-f5fb-4810-ab59-c481f5db6a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:00.496749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1b3337e5-f5fb-4810-ab59-c481f5db6a4b None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:29:00.497904 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1b3337e5-f5fb-4810-ab59-c481f5db6a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:00.546059 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:29:00.595310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 14:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:29:00.878392 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ff105-18a1-402a-a9c5-af6c57544a4b None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:29:00.879925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-424ff105-18a1-402a-a9c5-af6c57544a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:00.989442 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ff105-18a1-402a-a9c5-af6c57544a4b None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:29:01.037550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:29:01.064273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072db07b-3695-498b-afb7-7a09ca577180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:29:01.064877 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db07b-3695-498b-afb7-7a09ca577180 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:01.065186 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db07b-3695-498b-afb7-7a09ca577180 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:01.065458 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db07b-3695-498b-afb7-7a09ca577180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:01.067052 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-072db07b-3695-498b-afb7-7a09ca577180 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:01.175273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072db07b-3695-498b-afb7-7a09ca577180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:29:01.176629 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072db07b-3695-498b-afb7-7a09ca577180 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:29:01.195613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 740/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:29:10.593586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=22 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:29:11.193339 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=66 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:29:20.773471 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432e570-60fb-4b2e-8665-8efe997fbf23 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:20.774043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432e570-60fb-4b2e-8665-8efe997fbf23 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:20.774043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432e570-60fb-4b2e-8665-8efe997fbf23 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:20.775397 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 731/1471] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:29:20.780475 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8333d75-eef9-469b-801d-b0de94028a3b None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:20.780906 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8333d75-eef9-469b-801d-b0de94028a3b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:20.781016 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8333d75-eef9-469b-801d-b0de94028a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:20.849882 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c8333d75-eef9-469b-801d-b0de94028a3b None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:29:20.851123 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c8333d75-eef9-469b-801d-b0de94028a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:20.950622 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 741/1472] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:29:21.244162 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5807b4-19fb-4215-891f-2ebf2c23dca2 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:21.246342 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5807b4-19fb-4215-891f-2ebf2c23dca2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:21.246342 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5807b4-19fb-4215-891f-2ebf2c23dca2 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:21.246744 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 732/1473] 10.222.0.23 () {54 vars in 961 bytes} [Mon Sep 5 14:29:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:29:21.251714 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545d9bf-6b1f-41c1-ac29-fdce7a068799 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:21.252004 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545d9bf-6b1f-41c1-ac29-fdce7a068799 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:21.252355 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545d9bf-6b1f-41c1-ac29-fdce7a068799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:21.327745 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c545d9bf-6b1f-41c1-ac29-fdce7a068799 None None] MFA Rules not processed for user `1a7e9f0daa1c48eca87d92ced265afdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:29:21.328951 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c545d9bf-6b1f-41c1-ac29-fdce7a068799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:21.349900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:29:21.406363 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 742/1474] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Sep 5 14:29:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:29:21.413759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5807b4-19fb-4215-891f-2ebf2c23dca2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:29:21.415315 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0a5807b4-19fb-4215-891f-2ebf2c23dca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:21.518411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5807b4-19fb-4215-891f-2ebf2c23dca2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:29:21.593554 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40e723-26c8-4c60-8953-2da688457321 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a7e9f0daa1c48eca87d92ced265afdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:29:21.594146 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40e723-26c8-4c60-8953-2da688457321 service glance] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:21.594419 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40e723-26c8-4c60-8953-2da688457321 service glance] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:21.594683 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40e723-26c8-4c60-8953-2da688457321 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:21.596248 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-aa40e723-26c8-4c60-8953-2da688457321 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:21.648749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:29:21.706641 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40e723-26c8-4c60-8953-2da688457321 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:29:21.708085 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40e723-26c8-4c60-8953-2da688457321 service glance] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:29:21.727315 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 733/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:29:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:29:23.760548 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ed30e-24ef-4b88-95ce-b68a76a05e4e None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:23.761102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ed30e-24ef-4b88-95ce-b68a76a05e4e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:23.761212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ed30e-24ef-4b88-95ce-b68a76a05e4e None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:23.763356 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 743/1476] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:29:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:29:23.768491 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef478e-525b-44de-9730-9d7e854031e5 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:23.768903 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef478e-525b-44de-9730-9d7e854031e5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:23.769033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef478e-525b-44de-9730-9d7e854031e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:23.834931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-40ef478e-525b-44de-9730-9d7e854031e5 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:29:23.836137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-40ef478e-525b-44de-9730-9d7e854031e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:23.934461 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 734/1477] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:29:24.216583 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ed30e-24ef-4b88-95ce-b68a76a05e4e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:29:24.218255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-242ed30e-24ef-4b88-95ce-b68a76a05e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:24.346345 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ed30e-24ef-4b88-95ce-b68a76a05e4e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:29:24.393824 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:29:24.439220 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bd9b4-f0d5-4b83-bf52-74bc30bc104f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:29:24.439827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bd9b4-f0d5-4b83-bf52-74bc30bc104f admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:24.440102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bd9b4-f0d5-4b83-bf52-74bc30bc104f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:24.440366 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bd9b4-f0d5-4b83-bf52-74bc30bc104f admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:24.441000 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127bd9b4-f0d5-4b83-bf52-74bc30bc104f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:29:24.442775 dv-cinder-842905-3-smb devstack@keystone.service[81624]: WARNING py.warnings [None req-127bd9b4-f0d5-4b83-bf52-74bc30bc104f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 14:29:24.442775 dv-cinder-842905-3-smb devstack@keystone.service[81624]: warnings.warn(msg) Sep 05 14:29:24.442775 dv-cinder-842905-3-smb devstack@keystone.service[81624]: Sep 05 14:29:24.443920 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127bd9b4-f0d5-4b83-bf52-74bc30bc104f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:29:24.585422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 744/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Sep 5 14:29:24 2022] GET /identity/v3/projects => generated 2553 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:29:26.531706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d4121-9007-4e73-aa2a-91664c4bac8f None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:26.532784 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d4121-9007-4e73-aa2a-91664c4bac8f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:26.533074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d4121-9007-4e73-aa2a-91664c4bac8f None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:26.535902 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 735/1479] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:29:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:29:26.541542 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d79e0b-729e-448b-a9a7-5b6353be13a0 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:26.541987 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d79e0b-729e-448b-a9a7-5b6353be13a0 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:26.542110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d79e0b-729e-448b-a9a7-5b6353be13a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:26.610639 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-42d79e0b-729e-448b-a9a7-5b6353be13a0 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:29:26.611875 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-42d79e0b-729e-448b-a9a7-5b6353be13a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:26.711094 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 745/1480] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:29:27.006884 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d4121-9007-4e73-aa2a-91664c4bac8f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:29:27.008397 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-580d4121-9007-4e73-aa2a-91664c4bac8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:27.018520 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:29:27.156107 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d4121-9007-4e73-aa2a-91664c4bac8f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:29:27.238804 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:29:27.273325 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73ae3d-03ac-4636-9df7-6f3d536ebc31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:29:27.274368 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73ae3d-03ac-4636-9df7-6f3d536ebc31 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:27.274888 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73ae3d-03ac-4636-9df7-6f3d536ebc31 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:27.275232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73ae3d-03ac-4636-9df7-6f3d536ebc31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:27.276861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-db73ae3d-03ac-4636-9df7-6f3d536ebc31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:27.370934 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73ae3d-03ac-4636-9df7-6f3d536ebc31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:29:27.372648 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73ae3d-03ac-4636-9df7-6f3d536ebc31 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:29:27.390761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 736/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:29:29.501366 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebd3c6-f1fd-41f9-a559-d38ea4db3230 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:29.501953 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebd3c6-f1fd-41f9-a559-d38ea4db3230 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:29.501953 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebd3c6-f1fd-41f9-a559-d38ea4db3230 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:29.503245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 746/1482] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:29:29.508604 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a01aeb-e573-41f9-a85c-aeb920ee66c0 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:29.509029 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a01aeb-e573-41f9-a85c-aeb920ee66c0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:29.509212 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a01aeb-e573-41f9-a85c-aeb920ee66c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:29.578074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b5a01aeb-e573-41f9-a85c-aeb920ee66c0 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:29:29.583703 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b5a01aeb-e573-41f9-a85c-aeb920ee66c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:29.626356 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:29:29.676808 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 737/1483] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:29:29.976046 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebd3c6-f1fd-41f9-a559-d38ea4db3230 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:29:29.977625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-66ebd3c6-f1fd-41f9-a559-d38ea4db3230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:30.001040 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:29:30.079902 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebd3c6-f1fd-41f9-a559-d38ea4db3230 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:29:30.151574 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4102c9-aebc-420d-aa39-49b238fb2280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:29:30.152180 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4102c9-aebc-420d-aa39-49b238fb2280 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:30.152462 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4102c9-aebc-420d-aa39-49b238fb2280 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:30.152742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4102c9-aebc-420d-aa39-49b238fb2280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:30.154382 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ab4102c9-aebc-420d-aa39-49b238fb2280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:30.230202 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:29:30.267384 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4102c9-aebc-420d-aa39-49b238fb2280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:29:30.268824 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4102c9-aebc-420d-aa39-49b238fb2280 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:29:30.287270 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 747/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:29:32.241413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90cdd7-576e-4b84-b8d2-9009069fb88f None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:32.245277 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90cdd7-576e-4b84-b8d2-9009069fb88f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:32.245277 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90cdd7-576e-4b84-b8d2-9009069fb88f None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:32.245277 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 738/1485] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:29:32.248949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a43cd-6abd-4e7c-85c4-efcde06da240 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:32.250707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a43cd-6abd-4e7c-85c4-efcde06da240 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:32.250999 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a43cd-6abd-4e7c-85c4-efcde06da240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:32.319295 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-0b7a43cd-6abd-4e7c-85c4-efcde06da240 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:29:32.320506 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0b7a43cd-6abd-4e7c-85c4-efcde06da240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:32.416510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 748/1486] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:29:32.705045 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90cdd7-576e-4b84-b8d2-9009069fb88f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:29:32.706608 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ed90cdd7-576e-4b84-b8d2-9009069fb88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:32.810897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90cdd7-576e-4b84-b8d2-9009069fb88f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:29:32.881640 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:29:32.883351 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63654089-f69f-4f42-a301-36e8d5beed23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:29:32.883947 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63654089-f69f-4f42-a301-36e8d5beed23 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:32.884224 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63654089-f69f-4f42-a301-36e8d5beed23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:32.884493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63654089-f69f-4f42-a301-36e8d5beed23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:32.886090 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-63654089-f69f-4f42-a301-36e8d5beed23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:32.995200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63654089-f69f-4f42-a301-36e8d5beed23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:29:32.997285 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63654089-f69f-4f42-a301-36e8d5beed23 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:29:33.015908 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 739/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:29:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:29:35.142380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b99ebd-5d80-4a7b-a573-567358ac67ab None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:35.142958 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b99ebd-5d80-4a7b-a573-567358ac67ab None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:35.142958 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b99ebd-5d80-4a7b-a573-567358ac67ab None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:35.144273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 749/1488] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:29:35.149576 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408e5a5-15d1-4fb9-ae4a-bf738a6095a9 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:35.149978 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408e5a5-15d1-4fb9-ae4a-bf738a6095a9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:35.150124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408e5a5-15d1-4fb9-ae4a-bf738a6095a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:35.218633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9408e5a5-15d1-4fb9-ae4a-bf738a6095a9 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:29:35.219838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9408e5a5-15d1-4fb9-ae4a-bf738a6095a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:35.274755 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:29:35.318701 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 740/1489] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:29:35.614934 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b99ebd-5d80-4a7b-a573-567358ac67ab None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:29:35.616518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a9b99ebd-5d80-4a7b-a573-567358ac67ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:35.652031 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:29:35.723086 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b99ebd-5d80-4a7b-a573-567358ac67ab None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:29:35.794159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6fdb3-47f5-4881-a13b-8f1f25f08e5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:29:35.794758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6fdb3-47f5-4881-a13b-8f1f25f08e5b service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:35.795029 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6fdb3-47f5-4881-a13b-8f1f25f08e5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:35.795291 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6fdb3-47f5-4881-a13b-8f1f25f08e5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:35.796869 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b0c6fdb3-47f5-4881-a13b-8f1f25f08e5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:35.874444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:29:35.902270 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6fdb3-47f5-4881-a13b-8f1f25f08e5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:29:35.904266 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6fdb3-47f5-4881-a13b-8f1f25f08e5b service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:29:35.922202 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 750/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:29:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:29:38.258899 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221ff29-670b-4750-8ab7-ca924bee17cb None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:38.259384 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221ff29-670b-4750-8ab7-ca924bee17cb None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:38.259492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221ff29-670b-4750-8ab7-ca924bee17cb None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:38.260812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 741/1491] 10.222.0.23 () {54 vars in 927 bytes} [Mon Sep 5 14:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:29:38.266166 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f42c9-00f1-4a4c-96a5-2db3bbfdd882 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:38.266612 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f42c9-00f1-4a4c-96a5-2db3bbfdd882 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:38.266709 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f42c9-00f1-4a4c-96a5-2db3bbfdd882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:38.333273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b17f42c9-00f1-4a4c-96a5-2db3bbfdd882 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:29:38.334472 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b17f42c9-00f1-4a4c-96a5-2db3bbfdd882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:38.439273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 751/1492] 10.222.0.23 () {58 vars in 1024 bytes} [Mon Sep 5 14:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:29:38.745350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221ff29-670b-4750-8ab7-ca924bee17cb None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:29:38.747812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6221ff29-670b-4750-8ab7-ca924bee17cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:38.850771 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221ff29-670b-4750-8ab7-ca924bee17cb None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:29:38.923798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef57be-fc7b-4008-b97b-376be6c0c404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:29:38.924394 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef57be-fc7b-4008-b97b-376be6c0c404 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:29:38.924673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef57be-fc7b-4008-b97b-376be6c0c404 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:29:38.924946 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef57be-fc7b-4008-b97b-376be6c0c404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:29:38.926568 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-26ef57be-fc7b-4008-b97b-376be6c0c404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:29:38.936544 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:29:39.036166 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef57be-fc7b-4008-b97b-376be6c0c404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:29:39.037642 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef57be-fc7b-4008-b97b-376be6c0c404 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:29:39.056162 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 742/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:29:48.437433 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=82 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:29:49.053924 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=50 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:31:03.174558 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4b1fc-92de-42f6-91cd-deac9022de89 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:31:03.175157 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4b1fc-92de-42f6-91cd-deac9022de89 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:31:03.175157 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4b1fc-92de-42f6-91cd-deac9022de89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:31:03.251895 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-65c4b1fc-92de-42f6-91cd-deac9022de89 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:31:03.253157 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-65c4b1fc-92de-42f6-91cd-deac9022de89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:31:03.350907 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 752/1494] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:31:03.359632 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ed632-ded0-469d-adf8-881b3899e75b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:31:03.360117 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ed632-ded0-469d-adf8-881b3899e75b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:31:03.360238 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ed632-ded0-469d-adf8-881b3899e75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:31:03.436462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-529ed632-ded0-469d-adf8-881b3899e75b None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:31:03.437605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-529ed632-ded0-469d-adf8-881b3899e75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:31:03.533190 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 743/1495] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:31:03.537749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4b1fc-92de-42f6-91cd-deac9022de89 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:31:03.538952 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-65c4b1fc-92de-42f6-91cd-deac9022de89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:31:03.551398 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4b1fc-92de-42f6-91cd-deac9022de89 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:31:03.611885 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:31:03.648418 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d562b0-91da-4629-a642-86f0f1cf1016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:31:03.649024 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d562b0-91da-4629-a642-86f0f1cf1016 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:31:03.649508 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d562b0-91da-4629-a642-86f0f1cf1016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:31:03.649796 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d562b0-91da-4629-a642-86f0f1cf1016 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:31:03.650440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d562b0-91da-4629-a642-86f0f1cf1016 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:31:03.650746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d562b0-91da-4629-a642-86f0f1cf1016 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:31:03.651773 dv-cinder-842905-3-smb devstack@keystone.service[81624]: WARNING py.warnings [None req-56d562b0-91da-4629-a642-86f0f1cf1016 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 05 14:31:03.651773 dv-cinder-842905-3-smb devstack@keystone.service[81624]: warnings.warn(msg) Sep 05 14:31:03.651773 dv-cinder-842905-3-smb devstack@keystone.service[81624]: Sep 05 14:31:03.652660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d562b0-91da-4629-a642-86f0f1cf1016 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:31:03.664459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 753/1496] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:31:03.674038 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ed632-ded0-469d-adf8-881b3899e75b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:31:03.683804 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ed632-ded0-469d-adf8-881b3899e75b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:31:03.744874 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:31:03.778727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e413c5-ed78-4859-becc-26cbbaf91731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:31:03.779341 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e413c5-ed78-4859-becc-26cbbaf91731 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:31:03.779620 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e413c5-ed78-4859-becc-26cbbaf91731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:31:03.779891 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e413c5-ed78-4859-becc-26cbbaf91731 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:31:03.780576 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e413c5-ed78-4859-becc-26cbbaf91731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:31:03.783096 dv-cinder-842905-3-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-d6e413c5-ed78-4859-becc-26cbbaf91731 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 14:31:03.783096 dv-cinder-842905-3-smb devstack@keystone.service[81623]: warnings.warn(msg) Sep 05 14:31:03.783096 dv-cinder-842905-3-smb devstack@keystone.service[81623]: Sep 05 14:31:03.784287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e413c5-ed78-4859-becc-26cbbaf91731 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:31:03.897241 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 744/1497] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:31:03 2022] POST /identity/v3/projects => generated 379 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:31:03.902182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d562b0-91da-4629-a642-86f0f1cf1016 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:31:03.903707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-56d562b0-91da-4629-a642-86f0f1cf1016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:31:03.937171 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d562b0-91da-4629-a642-86f0f1cf1016 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:31:04.032019 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463991a-c047-4575-b356-a50e9937249c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:31:04.032617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463991a-c047-4575-b356-a50e9937249c admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:31:04.032891 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463991a-c047-4575-b356-a50e9937249c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:31:04.033195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463991a-c047-4575-b356-a50e9937249c admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:31:04.033821 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463991a-c047-4575-b356-a50e9937249c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:31:04.034826 dv-cinder-842905-3-smb devstack@keystone.service[81624]: WARNING py.warnings [None req-a463991a-c047-4575-b356-a50e9937249c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 14:31:04.034826 dv-cinder-842905-3-smb devstack@keystone.service[81624]: warnings.warn(msg) Sep 05 14:31:04.034826 dv-cinder-842905-3-smb devstack@keystone.service[81624]: Sep 05 14:31:04.036018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463991a-c047-4575-b356-a50e9937249c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:31:04.112786 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 754/1498] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:31:03 2022] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:31:04.116944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e413c5-ed78-4859-becc-26cbbaf91731 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:31:04.118737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d6e413c5-ed78-4859-becc-26cbbaf91731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:31:04.180715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e413c5-ed78-4859-becc-26cbbaf91731 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:31:04.266857 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:31:04.277893 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40a690-5312-4f74-abc3-271b771db456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:31:04.278499 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40a690-5312-4f74-abc3-271b771db456 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:31:04.278777 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40a690-5312-4f74-abc3-271b771db456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:31:04.279047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40a690-5312-4f74-abc3-271b771db456 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:31:04.279685 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40a690-5312-4f74-abc3-271b771db456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:31:04.280693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-1c40a690-5312-4f74-abc3-271b771db456 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 05 14:31:04.280693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: warnings.warn(msg) Sep 05 14:31:04.280693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: Sep 05 14:31:04.281607 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40a690-5312-4f74-abc3-271b771db456 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:31:04.294938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 745/1499] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:31:04.298283 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463991a-c047-4575-b356-a50e9937249c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:31:04.299911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a463991a-c047-4575-b356-a50e9937249c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:31:04.312372 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463991a-c047-4575-b356-a50e9937249c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:31:04.338584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:31:04.407397 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fa2ed-aa1d-42a4-9cd4-658cb059b6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:31:04.408001 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fa2ed-aa1d-42a4-9cd4-658cb059b6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:31:04.408327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fa2ed-aa1d-42a4-9cd4-658cb059b6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:31:04.408604 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fa2ed-aa1d-42a4-9cd4-658cb059b6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:31:04.409269 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777fa2ed-aa1d-42a4-9cd4-658cb059b6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:31:04.410284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: WARNING py.warnings [None req-777fa2ed-aa1d-42a4-9cd4-658cb059b6a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 05 14:31:04.410284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: warnings.warn(msg) Sep 05 14:31:04.410284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: Sep 05 14:31:04.411169 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777fa2ed-aa1d-42a4-9cd4-658cb059b6a1 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:31:04.423754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 755/1500] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:31:04.427955 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40a690-5312-4f74-abc3-271b771db456 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:31:04.429498 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1c40a690-5312-4f74-abc3-271b771db456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:31:04.463489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40a690-5312-4f74-abc3-271b771db456 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:31:04.554878 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858ca09-e4a2-4b97-816a-9f5cddeb64ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:31:04.556034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858ca09-e4a2-4b97-816a-9f5cddeb64ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:31:04.556340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858ca09-e4a2-4b97-816a-9f5cddeb64ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:31:04.556609 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858ca09-e4a2-4b97-816a-9f5cddeb64ff admin admin] PATH_INFO: `/v3/projects/90941917fa624e7fbb6d53fa88a68046/users/7344b4f9d65b43c785e2814dc8e297c1/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:31:04.578527 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858ca09-e4a2-4b97-816a-9f5cddeb64ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=90941917fa624e7fbb6d53fa88a68046, user_id=7344b4f9d65b43c785e2814dc8e297c1, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:31:04.579538 dv-cinder-842905-3-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-6858ca09-e4a2-4b97-816a-9f5cddeb64ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 14:31:04.579538 dv-cinder-842905-3-smb devstack@keystone.service[81623]: warnings.warn(msg) Sep 05 14:31:04.579538 dv-cinder-842905-3-smb devstack@keystone.service[81623]: Sep 05 14:31:04.581494 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858ca09-e4a2-4b97-816a-9f5cddeb64ff admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:31:04.691131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 746/1501] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:31:04 2022] PUT /identity/v3/projects/90941917fa624e7fbb6d53fa88a68046/users/7344b4f9d65b43c785e2814dc8e297c1/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:31:04.703889 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d506d7a-fa14-4566-b439-3f9fdae4fd44 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:31:04.704171 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d506d7a-fa14-4566-b439-3f9fdae4fd44 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:31:04.704438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d506d7a-fa14-4566-b439-3f9fdae4fd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:31:04.760968 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-7d506d7a-fa14-4566-b439-3f9fdae4fd44 None None] MFA Rules not processed for user `7344b4f9d65b43c785e2814dc8e297c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:31:04.762184 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7d506d7a-fa14-4566-b439-3f9fdae4fd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:31:04.850745 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 756/1502] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:31:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:31:04.865481 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec719e9-3121-49b5-9ae1-6820c57703d5 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:31:04.871665 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec719e9-3121-49b5-9ae1-6820c57703d5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:31:04.871665 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec719e9-3121-49b5-9ae1-6820c57703d5 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:31:04.871665 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 747/1503] 10.222.0.23 () {54 vars in 964 bytes} [Mon Sep 5 14:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:31:04.872987 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730690d-6576-4e56-bbea-d31b14f8891e None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:31:04.873304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730690d-6576-4e56-bbea-d31b14f8891e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:31:04.873573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730690d-6576-4e56-bbea-d31b14f8891e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:31:04.904160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:31:04.948770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d730690d-6576-4e56-bbea-d31b14f8891e None None] MFA Rules not processed for user `d7e1db2b6f70497ab535e0e9e86ec4ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:31:04.950024 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d730690d-6576-4e56-bbea-d31b14f8891e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:31:05.026398 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 757/1504] 10.222.0.23 () {58 vars in 1061 bytes} [Mon Sep 5 14:31:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:31:05.034066 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec719e9-3121-49b5-9ae1-6820c57703d5 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:31:05.035589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8ec719e9-3121-49b5-9ae1-6820c57703d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:31:05.086383 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:31:05.140722 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec719e9-3121-49b5-9ae1-6820c57703d5 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:31:05.214346 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d3f2b-b566-4f5b-81ea-b6989f295caf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:31:05.214937 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d3f2b-b566-4f5b-81ea-b6989f295caf service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:31:05.215212 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d3f2b-b566-4f5b-81ea-b6989f295caf service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:31:05.215478 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d3f2b-b566-4f5b-81ea-b6989f295caf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:31:05.217076 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a40d3f2b-b566-4f5b-81ea-b6989f295caf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:31:05.316594 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d3f2b-b566-4f5b-81ea-b6989f295caf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:31:05.318064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d3f2b-b566-4f5b-81ea-b6989f295caf service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:31:05.321542 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:31:05.337870 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 748/1505] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:31:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:31:05.389556 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171b0b8-44ee-492e-adfa-c47ca5037f77 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:31:05.389994 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171b0b8-44ee-492e-adfa-c47ca5037f77 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:31:05.390137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171b0b8-44ee-492e-adfa-c47ca5037f77 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:31:05.391450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 758/1506] 10.222.0.23 () {52 vars in 830 bytes} [Mon Sep 5 14:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:31:05.394974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d3f2b-b566-4f5b-81ea-b6989f295caf service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:31:05.396179 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a40d3f2b-b566-4f5b-81ea-b6989f295caf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:31:05.494999 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d3f2b-b566-4f5b-81ea-b6989f295caf service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:31:05.588848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37bf7a-bb40-4707-a9d5-fa9ba1bc1051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:31:05.589496 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37bf7a-bb40-4707-a9d5-fa9ba1bc1051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:31:05.589771 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37bf7a-bb40-4707-a9d5-fa9ba1bc1051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:31:05.590039 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37bf7a-bb40-4707-a9d5-fa9ba1bc1051 admin admin] PATH_INFO: `/v3/users/7344b4f9d65b43c785e2814dc8e297c1` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:31:05.601950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37bf7a-bb40-4707-a9d5-fa9ba1bc1051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7344b4f9d65b43c785e2814dc8e297c1)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:31:05.603085 dv-cinder-842905-3-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-8d37bf7a-bb40-4707-a9d5-fa9ba1bc1051 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 14:31:05.603085 dv-cinder-842905-3-smb devstack@keystone.service[81623]: warnings.warn(msg) Sep 05 14:31:05.603085 dv-cinder-842905-3-smb devstack@keystone.service[81623]: Sep 05 14:31:05.604277 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37bf7a-bb40-4707-a9d5-fa9ba1bc1051 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:31:05.613799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:31:05.763096 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8d37bf7a-bb40-4707-a9d5-fa9ba1bc1051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7344b4f9d65b43c785e2814dc8e297c1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:31:05.763564 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8d37bf7a-bb40-4707-a9d5-fa9ba1bc1051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7344b4f9d65b43c785e2814dc8e297c1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:31:05.821888 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8d37bf7a-bb40-4707-a9d5-fa9ba1bc1051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7344b4f9d65b43c785e2814dc8e297c1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:31:05.845214 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8d37bf7a-bb40-4707-a9d5-fa9ba1bc1051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7344b4f9d65b43c785e2814dc8e297c1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:31:05.845768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8d37bf7a-bb40-4707-a9d5-fa9ba1bc1051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7344b4f9d65b43c785e2814dc8e297c1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:31:05.865757 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 749/1507] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:31:05 2022] DELETE /identity/v3/users/7344b4f9d65b43c785e2814dc8e297c1 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:31:05.870426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a5e7e-40be-4af1-8142-1473e84ff644 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:31:05.870714 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a5e7e-40be-4af1-8142-1473e84ff644 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:31:05.870994 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a5e7e-40be-4af1-8142-1473e84ff644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:31:05.927104 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-bd0a5e7e-40be-4af1-8142-1473e84ff644 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:31:05.928310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-bd0a5e7e-40be-4af1-8142-1473e84ff644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:31:06.011117 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:31:06.023575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 759/1508] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:31:06.033400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37bf7a-bb40-4707-a9d5-fa9ba1bc1051 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:31:06.034605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8d37bf7a-bb40-4707-a9d5-fa9ba1bc1051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:31:06.134236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37bf7a-bb40-4707-a9d5-fa9ba1bc1051 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:31:06.190406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:31:06.209758 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8b5a4-400d-4a16-b4b2-f4144f847817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:31:06.210365 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8b5a4-400d-4a16-b4b2-f4144f847817 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:31:06.210640 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8b5a4-400d-4a16-b4b2-f4144f847817 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:31:06.210907 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8b5a4-400d-4a16-b4b2-f4144f847817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:31:06.212708 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-daa8b5a4-400d-4a16-b4b2-f4144f847817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:31:06.322751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8b5a4-400d-4a16-b4b2-f4144f847817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:31:06.324209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8b5a4-400d-4a16-b4b2-f4144f847817 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:31:06.344091 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 750/1509] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:31:06.766460 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a5e7e-40be-4af1-8142-1473e84ff644 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:31:06.770415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-bd0a5e7e-40be-4af1-8142-1473e84ff644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:31:06.779851 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a5e7e-40be-4af1-8142-1473e84ff644 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:31:06.880859 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26278570-c9d0-41af-8540-028cedc5a8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:31:06.881438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26278570-c9d0-41af-8540-028cedc5a8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:31:06.881715 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26278570-c9d0-41af-8540-028cedc5a8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:31:06.881984 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26278570-c9d0-41af-8540-028cedc5a8cf admin admin] PATH_INFO: `/v3/projects/90941917fa624e7fbb6d53fa88a68046` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:31:06.891829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26278570-c9d0-41af-8540-028cedc5a8cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=90941917fa624e7fbb6d53fa88a68046)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:31:06.892871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: WARNING py.warnings [None req-26278570-c9d0-41af-8540-028cedc5a8cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 14:31:06.892871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: warnings.warn(msg) Sep 05 14:31:06.892871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: Sep 05 14:31:06.894110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26278570-c9d0-41af-8540-028cedc5a8cf admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:31:07.004249 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-26278570-c9d0-41af-8540-028cedc5a8cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90941917fa624e7fbb6d53fa88a68046', 'request_id': 'req-26278570-c9d0-41af-8540-028cedc5a8cf'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:31:07.010969 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-26278570-c9d0-41af-8540-028cedc5a8cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90941917fa624e7fbb6d53fa88a68046', 'request_id': 'req-26278570-c9d0-41af-8540-028cedc5a8cf'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:31:07.056303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-26278570-c9d0-41af-8540-028cedc5a8cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90941917fa624e7fbb6d53fa88a68046', 'request_id': 'req-26278570-c9d0-41af-8540-028cedc5a8cf'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:31:07.086448 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-26278570-c9d0-41af-8540-028cedc5a8cf admin admin] The token cache is being invalidate because project 90941917fa624e7fbb6d53fa88a68046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:31:07.087337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-26278570-c9d0-41af-8540-028cedc5a8cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:31:07.087859 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-26278570-c9d0-41af-8540-028cedc5a8cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:31:07.089186 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 760/1510] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:31:06 2022] DELETE /identity/v3/projects/90941917fa624e7fbb6d53fa88a68046 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:31:16.387642 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=62 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:31:17.084454 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:32:41.213775 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c60f24-9aa4-4ecb-bd05-ea8468fdc3e3 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:32:41.214356 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c60f24-9aa4-4ecb-bd05-ea8468fdc3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:32:41.214356 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c60f24-9aa4-4ecb-bd05-ea8468fdc3e3 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:32:41.215667 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 14:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:32:41.220603 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a59d4-46c8-4a52-be29-fe78cc7d8c8f None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:32:41.225255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a59d4-46c8-4a52-be29-fe78cc7d8c8f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:32:41.225255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a59d4-46c8-4a52-be29-fe78cc7d8c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:32:41.303200 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-ad2a59d4-46c8-4a52-be29-fe78cc7d8c8f None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:32:41.304406 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ad2a59d4-46c8-4a52-be29-fe78cc7d8c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:32:41.407929 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 14:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:32:41.562627 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c60f24-9aa4-4ecb-bd05-ea8468fdc3e3 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:32:41.564713 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-91c60f24-9aa4-4ecb-bd05-ea8468fdc3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:32:41.684335 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c60f24-9aa4-4ecb-bd05-ea8468fdc3e3 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:32:41.690125 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ed720-f7ed-4633-b433-0e2736dae7ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:32:41.690731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ed720-f7ed-4633-b433-0e2736dae7ab service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:32:41.691011 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ed720-f7ed-4633-b433-0e2736dae7ab service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:32:41.691285 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ed720-f7ed-4633-b433-0e2736dae7ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:32:41.699252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ed720-f7ed-4633-b433-0e2736dae7ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:32:41.700861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ed720-f7ed-4633-b433-0e2736dae7ab service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:32:41.710150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 752/1513] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:32:42.547611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a63471-649d-44ab-9956-c89fa19b1ba7 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:32:42.548174 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a63471-649d-44ab-9956-c89fa19b1ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:32:42.548174 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a63471-649d-44ab-9956-c89fa19b1ba7 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:32:42.549569 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 14:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:32:42.554403 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764776a1-c1f3-4588-b5b2-2a10117310f8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:32:42.554858 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764776a1-c1f3-4588-b5b2-2a10117310f8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:32:42.554965 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764776a1-c1f3-4588-b5b2-2a10117310f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:32:42.575924 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-764776a1-c1f3-4588-b5b2-2a10117310f8 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:32:42.577169 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-764776a1-c1f3-4588-b5b2-2a10117310f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:32:42.585008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 753/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 14:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:32:42.746292 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a63471-649d-44ab-9956-c89fa19b1ba7 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:32:42.760647 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a63471-649d-44ab-9956-c89fa19b1ba7 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:32:42.766132 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c5d22-4895-4db1-b3d1-184556538aff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:32:42.766719 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c5d22-4895-4db1-b3d1-184556538aff service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:32:42.766998 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c5d22-4895-4db1-b3d1-184556538aff service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:32:42.767269 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c5d22-4895-4db1-b3d1-184556538aff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:32:42.775838 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c5d22-4895-4db1-b3d1-184556538aff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:32:42.777462 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c5d22-4895-4db1-b3d1-184556538aff service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:32:42.786906 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 763/1516] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:32:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:32:42.996305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1de28-91fb-4e5c-9808-e35eb2db1adf None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:32:42.996593 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1de28-91fb-4e5c-9808-e35eb2db1adf None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:32:42.996866 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1de28-91fb-4e5c-9808-e35eb2db1adf None None] PATH_INFO: `/v3` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:32:42.998190 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 754/1517] 10.222.0.44 () {54 vars in 925 bytes} [Mon Sep 5 14:32:42 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:32:43.006091 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce8093-8d59-46f0-8a9e-9ac77e564f8f None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:32:43.006383 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce8093-8d59-46f0-8a9e-9ac77e564f8f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:32:43.006662 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce8093-8d59-46f0-8a9e-9ac77e564f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:32:43.065730 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-0dce8093-8d59-46f0-8a9e-9ac77e564f8f None None] MFA Rules not processed for user `c1880dab32fa424a9356b3fe940d4856`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:32:43.066846 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0dce8093-8d59-46f0-8a9e-9ac77e564f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:32:43.083657 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:32:43.139976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 764/1518] 10.222.0.44 () {58 vars in 1015 bytes} [Mon Sep 5 14:32:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:32:52.354539 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fe210-deaa-45c2-9f46-f840630b62a6 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:32:52.355064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fe210-deaa-45c2-9f46-f840630b62a6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:32:52.355064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fe210-deaa-45c2-9f46-f840630b62a6 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:32:52.356310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 755/1519] 10.222.0.23 () {54 vars in 961 bytes} [Mon Sep 5 14:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:32:52.361757 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f384dc-bdf0-4ef0-a011-fac5cf8e7be7 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:32:52.362180 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f384dc-bdf0-4ef0-a011-fac5cf8e7be7 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:32:52.362333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f384dc-bdf0-4ef0-a011-fac5cf8e7be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:32:52.382199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-64f384dc-bdf0-4ef0-a011-fac5cf8e7be7 None None] MFA Rules not processed for user `c1880dab32fa424a9356b3fe940d4856`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:32:52.383384 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-64f384dc-bdf0-4ef0-a011-fac5cf8e7be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:32:52.391691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 765/1520] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Sep 5 14:32:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:32:52.399789 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fe210-deaa-45c2-9f46-f840630b62a6 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:32:52.413346 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fe210-deaa-45c2-9f46-f840630b62a6 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:32:52.418896 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd8775-b99f-48c6-9cf3-818c2b253f0d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1880dab32fa424a9356b3fe940d4856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:32:52.419481 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd8775-b99f-48c6-9cf3-818c2b253f0d service placement] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:32:52.419757 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd8775-b99f-48c6-9cf3-818c2b253f0d service placement] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:32:52.420024 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd8775-b99f-48c6-9cf3-818c2b253f0d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:32:52.428167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd8775-b99f-48c6-9cf3-818c2b253f0d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:32:52.429783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd8775-b99f-48c6-9cf3-818c2b253f0d service placement] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:32:52.439430 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 756/1521] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:32:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:32:54.036583 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9c346-c2e8-4d3a-884c-07da9f195148 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:32:54.037203 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9c346-c2e8-4d3a-884c-07da9f195148 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:32:54.037203 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9c346-c2e8-4d3a-884c-07da9f195148 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:32:54.038491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 766/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 14:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:32:54.044096 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f2d92-1ce3-46f1-9b09-e052e47bd10f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:32:54.044552 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f2d92-1ce3-46f1-9b09-e052e47bd10f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:32:54.044663 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f2d92-1ce3-46f1-9b09-e052e47bd10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:32:54.063954 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5e2f2d92-1ce3-46f1-9b09-e052e47bd10f None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:32:54.065164 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5e2f2d92-1ce3-46f1-9b09-e052e47bd10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:32:54.072908 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 757/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 14:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:32:54.229754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9c346-c2e8-4d3a-884c-07da9f195148 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:32:54.245275 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9c346-c2e8-4d3a-884c-07da9f195148 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:32:54.250717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83501c-9ca9-4369-bc46-6e5298be1b8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:32:54.251310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83501c-9ca9-4369-bc46-6e5298be1b8d service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:32:54.251589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83501c-9ca9-4369-bc46-6e5298be1b8d service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:32:54.251911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83501c-9ca9-4369-bc46-6e5298be1b8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:32:54.261138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83501c-9ca9-4369-bc46-6e5298be1b8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:32:54.262728 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83501c-9ca9-4369-bc46-6e5298be1b8d service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:32:54.272190 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 767/1524] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:32:55.104587 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bee5d0-f588-47ae-b3ee-585bce243afa None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:32:55.105172 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bee5d0-f588-47ae-b3ee-585bce243afa None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:32:55.105172 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bee5d0-f588-47ae-b3ee-585bce243afa None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:32:55.106515 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 758/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 14:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:32:55.111257 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312cf28-71e2-420f-94ec-7949cf81e473 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:32:55.111709 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312cf28-71e2-420f-94ec-7949cf81e473 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:32:55.111840 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312cf28-71e2-420f-94ec-7949cf81e473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:32:55.131235 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d312cf28-71e2-420f-94ec-7949cf81e473 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:32:55.132520 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d312cf28-71e2-420f-94ec-7949cf81e473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:32:55.141727 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 768/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 14:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:32:55.295439 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bee5d0-f588-47ae-b3ee-585bce243afa None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:32:55.310316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bee5d0-f588-47ae-b3ee-585bce243afa None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:32:55.315793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de59b3c-b56e-4666-9438-60f64fda1a07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:32:55.316386 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59b3c-b56e-4666-9438-60f64fda1a07 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:32:55.316666 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59b3c-b56e-4666-9438-60f64fda1a07 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:32:55.316953 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de59b3c-b56e-4666-9438-60f64fda1a07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:32:55.325816 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de59b3c-b56e-4666-9438-60f64fda1a07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:32:55.332531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de59b3c-b56e-4666-9438-60f64fda1a07 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:32:55.337507 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 759/1527] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:32:59.364889 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965b867-6a7d-43e4-b282-f5c13a44839f None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:32:59.365478 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965b867-6a7d-43e4-b282-f5c13a44839f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:32:59.365478 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965b867-6a7d-43e4-b282-f5c13a44839f None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:32:59.366809 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 769/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 14:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:32:59.372404 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ac55d-0f78-49a7-81bc-54deaea01cd4 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:32:59.372819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ac55d-0f78-49a7-81bc-54deaea01cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:32:59.372966 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ac55d-0f78-49a7-81bc-54deaea01cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:32:59.392503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7d2ac55d-0f78-49a7-81bc-54deaea01cd4 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:32:59.393720 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7d2ac55d-0f78-49a7-81bc-54deaea01cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:32:59.402501 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 760/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 14:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:32:59.693814 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965b867-6a7d-43e4-b282-f5c13a44839f None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:32:59.696111 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a965b867-6a7d-43e4-b282-f5c13a44839f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:32:59.774961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965b867-6a7d-43e4-b282-f5c13a44839f None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:32:59.778555 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7eb40-99bc-4ac3-b18a-91eeca5016b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:32:59.779157 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7eb40-99bc-4ac3-b18a-91eeca5016b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:32:59.779435 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7eb40-99bc-4ac3-b18a-91eeca5016b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:32:59.779706 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7eb40-99bc-4ac3-b18a-91eeca5016b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:32:59.788619 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7eb40-99bc-4ac3-b18a-91eeca5016b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:32:59.790846 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7eb40-99bc-4ac3-b18a-91eeca5016b6 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:32:59.799769 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 770/1530] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:32:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:33:01.693171 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becc2c0-f87a-4560-ad10-65d7eb8c2033 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:33:01.693737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becc2c0-f87a-4560-ad10-65d7eb8c2033 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:33:01.693737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3becc2c0-f87a-4560-ad10-65d7eb8c2033 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:33:01.695057 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 761/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 14:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:33:01.700631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e127b-2a7a-41ec-b8a1-6f4f66418a60 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:33:01.701086 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e127b-2a7a-41ec-b8a1-6f4f66418a60 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:33:01.701199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e127b-2a7a-41ec-b8a1-6f4f66418a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:33:01.721349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-9b9e127b-2a7a-41ec-b8a1-6f4f66418a60 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:33:01.722532 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9b9e127b-2a7a-41ec-b8a1-6f4f66418a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:33:01.731054 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 771/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 14:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:33:02.019173 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3becc2c0-f87a-4560-ad10-65d7eb8c2033 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:33:02.030106 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3becc2c0-f87a-4560-ad10-65d7eb8c2033 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:33:02.033591 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb831ba8-cc70-49bc-9d92-4bf1ebc3f693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:33:02.034188 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb831ba8-cc70-49bc-9d92-4bf1ebc3f693 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:33:02.034470 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb831ba8-cc70-49bc-9d92-4bf1ebc3f693 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:33:02.034744 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb831ba8-cc70-49bc-9d92-4bf1ebc3f693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:33:02.044128 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb831ba8-cc70-49bc-9d92-4bf1ebc3f693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:33:02.045601 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb831ba8-cc70-49bc-9d92-4bf1ebc3f693 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:33:02.055751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 762/1533] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:33:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:33:05.550421 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b40164-6d68-4e15-8922-b1dcfa9a3f4f None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:33:05.550989 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b40164-6d68-4e15-8922-b1dcfa9a3f4f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:33:05.551249 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b40164-6d68-4e15-8922-b1dcfa9a3f4f None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:33:05.552574 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 772/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 14:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:33:05.557925 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f4d84-7bb5-4aad-a5ce-e22ed7483ea3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:33:05.558351 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f4d84-7bb5-4aad-a5ce-e22ed7483ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:33:05.558467 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f4d84-7bb5-4aad-a5ce-e22ed7483ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:33:05.578493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d29f4d84-7bb5-4aad-a5ce-e22ed7483ea3 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:33:05.579686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d29f4d84-7bb5-4aad-a5ce-e22ed7483ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:33:05.588312 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 763/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 14:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:33:06.140091 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b40164-6d68-4e15-8922-b1dcfa9a3f4f None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:33:06.141799 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f8b40164-6d68-4e15-8922-b1dcfa9a3f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:33:06.206025 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:33:06.219054 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b40164-6d68-4e15-8922-b1dcfa9a3f4f None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:33:06.222643 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc2e52-6d39-4f08-9ec8-9fc7a725adae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:33:06.223244 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc2e52-6d39-4f08-9ec8-9fc7a725adae service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:33:06.223876 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc2e52-6d39-4f08-9ec8-9fc7a725adae service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:33:06.223876 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc2e52-6d39-4f08-9ec8-9fc7a725adae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:33:06.233537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc2e52-6d39-4f08-9ec8-9fc7a725adae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:33:06.234873 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc2e52-6d39-4f08-9ec8-9fc7a725adae service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:33:06.245813 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 773/1536] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:33:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:33:08.185257 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204372e-6850-4fba-80d9-5f78a27d5d47 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:33:08.185767 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204372e-6850-4fba-80d9-5f78a27d5d47 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:33:08.185767 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204372e-6850-4fba-80d9-5f78a27d5d47 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:33:08.187041 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 764/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 14:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:33:08.192157 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61909b75-d1ae-407d-a121-8a4ede1f35d4 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:33:08.192582 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61909b75-d1ae-407d-a121-8a4ede1f35d4 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:33:08.192695 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61909b75-d1ae-407d-a121-8a4ede1f35d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:33:08.213035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-61909b75-d1ae-407d-a121-8a4ede1f35d4 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:33:08.214269 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-61909b75-d1ae-407d-a121-8a4ede1f35d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:33:08.222168 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 774/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 14:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:33:08.782130 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204372e-6850-4fba-80d9-5f78a27d5d47 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:33:08.783798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0204372e-6850-4fba-80d9-5f78a27d5d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:33:08.791385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=84 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:33:08.797084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204372e-6850-4fba-80d9-5f78a27d5d47 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:33:08.800516 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d57cf-918c-4569-96aa-94a11f017c22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:33:08.801175 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d57cf-918c-4569-96aa-94a11f017c22 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:33:08.801460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d57cf-918c-4569-96aa-94a11f017c22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:33:08.801755 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d57cf-918c-4569-96aa-94a11f017c22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:33:08.810800 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d57cf-918c-4569-96aa-94a11f017c22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:33:08.812221 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d57cf-918c-4569-96aa-94a11f017c22 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:33:08.822057 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 765/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:33:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:33:18.208161 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=11 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:33:18.834831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:36.095204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1934764-7e95-4da9-ba62-6d0908cf1327 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.096938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1934764-7e95-4da9-ba62-6d0908cf1327 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.096938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1934764-7e95-4da9-ba62-6d0908cf1327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.128870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d1934764-7e95-4da9-ba62-6d0908cf1327 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:36.130136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d1934764-7e95-4da9-ba62-6d0908cf1327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:36.149605 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 775/1540] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:36.154395 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b7e35-f65b-45d2-b314-a505099ece7b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.154936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b7e35-f65b-45d2-b314-a505099ece7b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.154936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b7e35-f65b-45d2-b314-a505099ece7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.165693 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f30196-9ba9-4bf8-9fcd-8d92337287f6 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.166014 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f30196-9ba9-4bf8-9fcd-8d92337287f6 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.166249 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f30196-9ba9-4bf8-9fcd-8d92337287f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.192667 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-cb0b7e35-f65b-45d2-b314-a505099ece7b None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:36.194365 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cb0b7e35-f65b-45d2-b314-a505099ece7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:36.210251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b5f30196-9ba9-4bf8-9fcd-8d92337287f6 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:36.211481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b5f30196-9ba9-4bf8-9fcd-8d92337287f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:36.217725 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 766/1541] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:36.231222 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f06f5e-39e6-4fe3-99e4-aad86d7b8f33 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.231222 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f06f5e-39e6-4fe3-99e4-aad86d7b8f33 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.231222 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f06f5e-39e6-4fe3-99e4-aad86d7b8f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.241087 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 776/1542] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:36.241087 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f30196-9ba9-4bf8-9fcd-8d92337287f6 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:36.263911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f30196-9ba9-4bf8-9fcd-8d92337287f6 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:36.287790 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114fcc6-6af4-4956-bdb1-9cfade8170e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:36.288167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-61f06f5e-39e6-4fe3-99e4-aad86d7b8f33 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:36.288427 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114fcc6-6af4-4956-bdb1-9cfade8170e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.288709 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114fcc6-6af4-4956-bdb1-9cfade8170e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.288984 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114fcc6-6af4-4956-bdb1-9cfade8170e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.289704 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114fcc6-6af4-4956-bdb1-9cfade8170e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:34:36.290252 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114fcc6-6af4-4956-bdb1-9cfade8170e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:36.291072 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-61f06f5e-39e6-4fe3-99e4-aad86d7b8f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:36.297449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114fcc6-6af4-4956-bdb1-9cfade8170e7 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:36.314981 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 767/1543] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:36.316943 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03246cf4-85da-4bb0-8d7a-6ce57a73442b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.317120 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03246cf4-85da-4bb0-8d7a-6ce57a73442b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.318204 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03246cf4-85da-4bb0-8d7a-6ce57a73442b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.336296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 777/1544] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:34:36.337653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b67edd-92d1-43b4-b95e-bfbc53122b4a None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.337944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b67edd-92d1-43b4-b95e-bfbc53122b4a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.338281 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b67edd-92d1-43b4-b95e-bfbc53122b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.350483 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-03246cf4-85da-4bb0-8d7a-6ce57a73442b None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:36.351712 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-03246cf4-85da-4bb0-8d7a-6ce57a73442b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:36.360734 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 768/1545] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:36.362055 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6651d-64fd-4f72-8adb-07e8095b0a74 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.362481 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6651d-64fd-4f72-8adb-07e8095b0a74 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.362609 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6651d-64fd-4f72-8adb-07e8095b0a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.384818 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d6d6651d-64fd-4f72-8adb-07e8095b0a74 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:36.386122 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-65b67edd-92d1-43b4-b95e-bfbc53122b4a None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:36.386281 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d6d6651d-64fd-4f72-8adb-07e8095b0a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:36.387413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-65b67edd-92d1-43b4-b95e-bfbc53122b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:36.396029 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 769/1546] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:36.397800 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74166d6e-30e4-4d5f-85ab-21d58a53d234 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.398094 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74166d6e-30e4-4d5f-85ab-21d58a53d234 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.398374 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74166d6e-30e4-4d5f-85ab-21d58a53d234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.412721 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 778/1547] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:36.413688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b67edd-92d1-43b4-b95e-bfbc53122b4a None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:36.420921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-74166d6e-30e4-4d5f-85ab-21d58a53d234 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:36.422238 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-74166d6e-30e4-4d5f-85ab-21d58a53d234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:36.424153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b67edd-92d1-43b4-b95e-bfbc53122b4a None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:36.429624 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf2458-1579-417a-8219-93d9e8cf553b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:36.430228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf2458-1579-417a-8219-93d9e8cf553b admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.430509 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf2458-1579-417a-8219-93d9e8cf553b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.430784 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf2458-1579-417a-8219-93d9e8cf553b admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.431370 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 770/1548] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:36.431581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf2458-1579-417a-8219-93d9e8cf553b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:36.432159 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74166d6e-30e4-4d5f-85ab-21d58a53d234 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:36.432434 dv-cinder-842905-3-smb devstack@keystone.service[81624]: WARNING py.warnings [None req-d6bf2458-1579-417a-8219-93d9e8cf553b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 14:34:36.432434 dv-cinder-842905-3-smb devstack@keystone.service[81624]: warnings.warn(msg) Sep 05 14:34:36.432434 dv-cinder-842905-3-smb devstack@keystone.service[81624]: Sep 05 14:34:36.433645 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf2458-1579-417a-8219-93d9e8cf553b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:36.442344 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74166d6e-30e4-4d5f-85ab-21d58a53d234 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:36.446945 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec0f61-2684-451f-91e7-58ed3c8fa6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:36.447676 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec0f61-2684-451f-91e7-58ed3c8fa6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.447954 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec0f61-2684-451f-91e7-58ed3c8fa6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.448221 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec0f61-2684-451f-91e7-58ed3c8fa6f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.448858 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec0f61-2684-451f-91e7-58ed3c8fa6f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:34:36.449196 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec0f61-2684-451f-91e7-58ed3c8fa6f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:36.450201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-67ec0f61-2684-451f-91e7-58ed3c8fa6f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 05 14:34:36.450201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: warnings.warn(msg) Sep 05 14:34:36.450201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: Sep 05 14:34:36.451078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec0f61-2684-451f-91e7-58ed3c8fa6f5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:36.462546 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 771/1549] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:34:36.463713 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d6f1b-d0db-4875-8d05-3b7e997a76fb None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.463995 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d6f1b-d0db-4875-8d05-3b7e997a76fb None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.464263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d6f1b-d0db-4875-8d05-3b7e997a76fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.483663 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e94d6f1b-d0db-4875-8d05-3b7e997a76fb None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:36.484859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e94d6f1b-d0db-4875-8d05-3b7e997a76fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:36.493732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 772/1550] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:36.494876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2d9a3-ba1b-438f-a5c8-fa2dcbecac1d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.495163 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2d9a3-ba1b-438f-a5c8-fa2dcbecac1d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.495440 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2d9a3-ba1b-438f-a5c8-fa2dcbecac1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.514258 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-80c2d9a3-ba1b-438f-a5c8-fa2dcbecac1d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:36.515425 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-80c2d9a3-ba1b-438f-a5c8-fa2dcbecac1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:36.526926 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 773/1551] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:36.528119 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a43a9-037e-4bc6-b8a4-46f8c7fa0b01 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.528481 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a43a9-037e-4bc6-b8a4-46f8c7fa0b01 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.528763 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a43a9-037e-4bc6-b8a4-46f8c7fa0b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.544670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 779/1552] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:34:36 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:36.546373 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1467a8-72fa-489b-822f-5e1cf6605c3d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.546656 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1467a8-72fa-489b-822f-5e1cf6605c3d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.546928 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1467a8-72fa-489b-822f-5e1cf6605c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.549723 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-0c4a43a9-037e-4bc6-b8a4-46f8c7fa0b01 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:36.550965 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0c4a43a9-037e-4bc6-b8a4-46f8c7fa0b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:36.567815 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-4a1467a8-72fa-489b-822f-5e1cf6605c3d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:36.571842 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4a1467a8-72fa-489b-822f-5e1cf6605c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:36.618732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 774/1553] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:36.620083 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef73856-6226-446f-a553-98afdb170f69 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.620371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef73856-6226-446f-a553-98afdb170f69 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.620638 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef73856-6226-446f-a553-98afdb170f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.639783 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 780/1554] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:36.640411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1467a8-72fa-489b-822f-5e1cf6605c3d None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:36.640539 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2ef73856-6226-446f-a553-98afdb170f69 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:36.641758 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2ef73856-6226-446f-a553-98afdb170f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:36.650388 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 775/1555] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:36.651284 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef73856-6226-446f-a553-98afdb170f69 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:36.653872 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1467a8-72fa-489b-822f-5e1cf6605c3d None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:36.658778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a1517-3aed-4417-ae10-2a3c589090e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:36.659375 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a1517-3aed-4417-ae10-2a3c589090e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.659781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a1517-3aed-4417-ae10-2a3c589090e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.660053 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a1517-3aed-4417-ae10-2a3c589090e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.661412 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a1517-3aed-4417-ae10-2a3c589090e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:34:36.661720 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a1517-3aed-4417-ae10-2a3c589090e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:36.663391 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a1517-3aed-4417-ae10-2a3c589090e0 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:36.667076 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef73856-6226-446f-a553-98afdb170f69 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:36.672999 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef521e9-e4b9-4175-9eea-3be383d377b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:36.673647 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef521e9-e4b9-4175-9eea-3be383d377b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.674082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef521e9-e4b9-4175-9eea-3be383d377b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.674357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef521e9-e4b9-4175-9eea-3be383d377b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.675005 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef521e9-e4b9-4175-9eea-3be383d377b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:36.675589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 781/1556] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:34:36.676666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a1517-3aed-4417-ae10-2a3c589090e0 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:36.677166 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef521e9-e4b9-4175-9eea-3be383d377b0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:36.687265 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a1517-3aed-4417-ae10-2a3c589090e0 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:36.692511 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f94d9b-48cc-420f-97e5-e19039ed5458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:36.693132 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f94d9b-48cc-420f-97e5-e19039ed5458 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.693414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f94d9b-48cc-420f-97e5-e19039ed5458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.693685 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f94d9b-48cc-420f-97e5-e19039ed5458 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.694315 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f94d9b-48cc-420f-97e5-e19039ed5458 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:34:36.694614 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f94d9b-48cc-420f-97e5-e19039ed5458 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:36.696279 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f94d9b-48cc-420f-97e5-e19039ed5458 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:36.709100 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 782/1557] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:34:36.711441 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ed36a-7472-4e0d-8ff7-5a152bcc976d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.711441 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ed36a-7472-4e0d-8ff7-5a152bcc976d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.711441 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ed36a-7472-4e0d-8ff7-5a152bcc976d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.731265 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-324ed36a-7472-4e0d-8ff7-5a152bcc976d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:36.732479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-324ed36a-7472-4e0d-8ff7-5a152bcc976d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:36.740784 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 783/1558] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:36.741570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ed36a-7472-4e0d-8ff7-5a152bcc976d None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:36.750630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ed36a-7472-4e0d-8ff7-5a152bcc976d None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:36.755266 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4e38c-45d2-4a78-9f81-9c673abc3728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:36.755887 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4e38c-45d2-4a78-9f81-9c673abc3728 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.756170 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4e38c-45d2-4a78-9f81-9c673abc3728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.756445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4e38c-45d2-4a78-9f81-9c673abc3728 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.757078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4e38c-45d2-4a78-9f81-9c673abc3728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:36.759038 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4e38c-45d2-4a78-9f81-9c673abc3728 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:36.823402 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 776/1559] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:34:36 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:36.824788 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5b6f1-6e83-46fd-8787-777e2534df21 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.825088 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5b6f1-6e83-46fd-8787-777e2534df21 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.825362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5b6f1-6e83-46fd-8787-777e2534df21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.844678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 784/1560] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:34:36 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:36.844678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4e38c-45d2-4a78-9f81-9c673abc3728 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:36.845333 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-fce5b6f1-6e83-46fd-8787-777e2534df21 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:36.846509 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fce5b6f1-6e83-46fd-8787-777e2534df21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:36.853071 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4e38c-45d2-4a78-9f81-9c673abc3728 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:36.899551 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:36.911136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 777/1561] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:36.911136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd17183-0d6a-4929-b68c-de7a2450c5ef None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.911136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd17183-0d6a-4929-b68c-de7a2450c5ef None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.911136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd17183-0d6a-4929-b68c-de7a2450c5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.914625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e12be-a02a-44be-9a00-62105131044a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:36.915237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e12be-a02a-44be-9a00-62105131044a admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.915518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e12be-a02a-44be-9a00-62105131044a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.915791 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e12be-a02a-44be-9a00-62105131044a admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.916434 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e12be-a02a-44be-9a00-62105131044a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:34:36.916733 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e12be-a02a-44be-9a00-62105131044a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:36.918388 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e12be-a02a-44be-9a00-62105131044a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:36.930510 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1cd17183-0d6a-4929-b68c-de7a2450c5ef None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:36.931728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1cd17183-0d6a-4929-b68c-de7a2450c5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:36.932588 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 785/1562] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:34:36.933531 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e12be-a02a-44be-9a00-62105131044a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:36.943457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e12be-a02a-44be-9a00-62105131044a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:36.946491 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 778/1563] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:36.947250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd17183-0d6a-4929-b68c-de7a2450c5ef None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:36.948338 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37602b-76f3-4551-8d00-3ea4aa9c1ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:36.948924 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37602b-76f3-4551-8d00-3ea4aa9c1ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.949231 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37602b-76f3-4551-8d00-3ea4aa9c1ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.949497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37602b-76f3-4551-8d00-3ea4aa9c1ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.950254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37602b-76f3-4551-8d00-3ea4aa9c1ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:36.952137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37602b-76f3-4551-8d00-3ea4aa9c1ea8 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:36.956638 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd17183-0d6a-4929-b68c-de7a2450c5ef None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:36.962153 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccc5aa-01d3-469c-b0ec-e24fa6fcc687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:36.962759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccc5aa-01d3-469c-b0ec-e24fa6fcc687 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:36.963042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccc5aa-01d3-469c-b0ec-e24fa6fcc687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:36.963272 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccc5aa-01d3-469c-b0ec-e24fa6fcc687 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:36.963931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccc5aa-01d3-469c-b0ec-e24fa6fcc687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:36.965834 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccc5aa-01d3-469c-b0ec-e24fa6fcc687 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:36.970412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:37.067322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 786/1564] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:34:36 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:37.068270 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37602b-76f3-4551-8d00-3ea4aa9c1ea8 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:37.102653 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 779/1565] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:34:36 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:37.102653 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccc5aa-01d3-469c-b0ec-e24fa6fcc687 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:37.131731 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37602b-76f3-4551-8d00-3ea4aa9c1ea8 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:37.165670 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccc5aa-01d3-469c-b0ec-e24fa6fcc687 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:37.170405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60f344-b520-421e-a429-a638d57734ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:37.171012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60f344-b520-421e-a429-a638d57734ba admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:37.171292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60f344-b520-421e-a429-a638d57734ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:37.171560 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60f344-b520-421e-a429-a638d57734ba admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:37.172189 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60f344-b520-421e-a429-a638d57734ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:37.173225 dv-cinder-842905-3-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-2f60f344-b520-421e-a429-a638d57734ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 14:34:37.173225 dv-cinder-842905-3-smb devstack@keystone.service[81623]: warnings.warn(msg) Sep 05 14:34:37.173225 dv-cinder-842905-3-smb devstack@keystone.service[81623]: Sep 05 14:34:37.175661 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60f344-b520-421e-a429-a638d57734ba admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:37.190776 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da289b8-525e-4c6d-959c-604e0a71cee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:37.191415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da289b8-525e-4c6d-959c-604e0a71cee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:37.192319 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da289b8-525e-4c6d-959c-604e0a71cee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:37.192544 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da289b8-525e-4c6d-959c-604e0a71cee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:37.193144 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da289b8-525e-4c6d-959c-604e0a71cee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:34:37.198516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da289b8-525e-4c6d-959c-604e0a71cee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:37.198516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da289b8-525e-4c6d-959c-604e0a71cee8 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:37.206676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 787/1566] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:34:37.208113 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da289b8-525e-4c6d-959c-604e0a71cee8 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:37.217674 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da289b8-525e-4c6d-959c-604e0a71cee8 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:37.222280 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f61d7c-da58-43f3-9b4f-39c93f5391d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:37.227513 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f61d7c-da58-43f3-9b4f-39c93f5391d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:37.227513 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f61d7c-da58-43f3-9b4f-39c93f5391d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:37.227513 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f61d7c-da58-43f3-9b4f-39c93f5391d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:37.227513 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f61d7c-da58-43f3-9b4f-39c93f5391d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:37.227513 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f61d7c-da58-43f3-9b4f-39c93f5391d4 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:37.236654 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 788/1567] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:37.237493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f61d7c-da58-43f3-9b4f-39c93f5391d4 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:37.246864 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f61d7c-da58-43f3-9b4f-39c93f5391d4 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:37.251418 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b06a68-9e6a-4039-9eb1-3512ddaf31e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:37.251988 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b06a68-9e6a-4039-9eb1-3512ddaf31e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:37.252270 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b06a68-9e6a-4039-9eb1-3512ddaf31e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:37.252542 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b06a68-9e6a-4039-9eb1-3512ddaf31e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:37.253211 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b06a68-9e6a-4039-9eb1-3512ddaf31e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:34:37.253516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b06a68-9e6a-4039-9eb1-3512ddaf31e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:37.255621 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b06a68-9e6a-4039-9eb1-3512ddaf31e5 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:37.266867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 789/1568] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:34:37.267606 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b06a68-9e6a-4039-9eb1-3512ddaf31e5 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:37.277517 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b06a68-9e6a-4039-9eb1-3512ddaf31e5 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:37.282525 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766ed13-4d2a-473b-aaab-d24ae8c657b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:37.283100 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766ed13-4d2a-473b-aaab-d24ae8c657b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:37.283375 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766ed13-4d2a-473b-aaab-d24ae8c657b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:37.283643 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766ed13-4d2a-473b-aaab-d24ae8c657b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:37.284254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766ed13-4d2a-473b-aaab-d24ae8c657b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:37.287024 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 780/1569] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:34:37 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:37.292140 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766ed13-4d2a-473b-aaab-d24ae8c657b3 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:37.292275 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60f344-b520-421e-a429-a638d57734ba admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:37.297597 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60f344-b520-421e-a429-a638d57734ba admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:37.302454 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e38867-0a0b-48c0-ae1e-44a8aede8598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:37.303054 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e38867-0a0b-48c0-ae1e-44a8aede8598 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:37.303337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e38867-0a0b-48c0-ae1e-44a8aede8598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:37.303613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e38867-0a0b-48c0-ae1e-44a8aede8598 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:37.304260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e38867-0a0b-48c0-ae1e-44a8aede8598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:34:37.304565 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e38867-0a0b-48c0-ae1e-44a8aede8598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:37.306242 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e38867-0a0b-48c0-ae1e-44a8aede8598 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:37.319308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 781/1570] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:34:37.330675 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e38867-0a0b-48c0-ae1e-44a8aede8598 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:37.330675 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e38867-0a0b-48c0-ae1e-44a8aede8598 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:37.335931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459eca3-ed4a-40ed-972b-72e744f7c9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:37.336506 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459eca3-ed4a-40ed-972b-72e744f7c9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:37.336781 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459eca3-ed4a-40ed-972b-72e744f7c9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:37.337094 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459eca3-ed4a-40ed-972b-72e744f7c9e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:37.337707 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459eca3-ed4a-40ed-972b-72e744f7c9e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:37.339590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459eca3-ed4a-40ed-972b-72e744f7c9e3 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:37.388883 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 790/1571] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:34:37 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:37.389729 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766ed13-4d2a-473b-aaab-d24ae8c657b3 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:37.403347 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:37.433895 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 782/1572] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:34:37 2022] POST /identity/v3/users => generated 284 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:37.433895 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459eca3-ed4a-40ed-972b-72e744f7c9e3 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:37.441136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459eca3-ed4a-40ed-972b-72e744f7c9e3 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:37.455079 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766ed13-4d2a-473b-aaab-d24ae8c657b3 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:37.460714 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff02edc-e11b-4a5f-bed2-92c106635fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:37.461348 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff02edc-e11b-4a5f-bed2-92c106635fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:37.461632 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff02edc-e11b-4a5f-bed2-92c106635fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:37.461901 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff02edc-e11b-4a5f-bed2-92c106635fe2 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:37.462525 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff02edc-e11b-4a5f-bed2-92c106635fe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:37.464476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff02edc-e11b-4a5f-bed2-92c106635fe2 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:37.498280 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594f9da-5338-4ac4-8681-780f05f2c71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:37.498885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594f9da-5338-4ac4-8681-780f05f2c71a admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:37.499158 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594f9da-5338-4ac4-8681-780f05f2c71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:37.499424 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594f9da-5338-4ac4-8681-780f05f2c71a admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:37.500037 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594f9da-5338-4ac4-8681-780f05f2c71a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:37.501948 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594f9da-5338-4ac4-8681-780f05f2c71a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:37.590547 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 791/1573] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:34:37 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:37.591662 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff02edc-e11b-4a5f-bed2-92c106635fe2 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:37.602342 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff02edc-e11b-4a5f-bed2-92c106635fe2 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:37.606941 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a1582-90e3-4ce0-a549-aae0c6e0c00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:37.607516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a1582-90e3-4ce0-a549-aae0c6e0c00d admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:37.607795 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a1582-90e3-4ce0-a549-aae0c6e0c00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:37.608068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a1582-90e3-4ce0-a549-aae0c6e0c00d admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:37.608707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a1582-90e3-4ce0-a549-aae0c6e0c00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:37.610328 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a1582-90e3-4ce0-a549-aae0c6e0c00d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:37.622097 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 792/1574] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:37.622903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a1582-90e3-4ce0-a549-aae0c6e0c00d admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:37.629900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 783/1575] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:34:37 2022] POST /identity/v3/projects => generated 379 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:37.630944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594f9da-5338-4ac4-8681-780f05f2c71a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:37.634476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a1582-90e3-4ce0-a549-aae0c6e0c00d admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:37.669223 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:37.696540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a25b5-713d-4361-94da-2aaad6458ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:37.697157 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a25b5-713d-4361-94da-2aaad6458ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:37.697528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a25b5-713d-4361-94da-2aaad6458ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:37.697812 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a25b5-713d-4361-94da-2aaad6458ad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:37.698488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a25b5-713d-4361-94da-2aaad6458ad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:37.700491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a25b5-713d-4361-94da-2aaad6458ad4 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:37.702098 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594f9da-5338-4ac4-8681-780f05f2c71a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:37.708420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e36928-765f-4cbe-9d91-6da8e93f7f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:37.709087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e36928-765f-4cbe-9d91-6da8e93f7f60 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:37.709364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e36928-765f-4cbe-9d91-6da8e93f7f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:37.709635 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e36928-765f-4cbe-9d91-6da8e93f7f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:37.710329 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e36928-765f-4cbe-9d91-6da8e93f7f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:37.712066 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e36928-765f-4cbe-9d91-6da8e93f7f60 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:37.722068 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 784/1576] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:37.722850 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e36928-765f-4cbe-9d91-6da8e93f7f60 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:37.732793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e36928-765f-4cbe-9d91-6da8e93f7f60 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:37.737907 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308cea1-60d0-42f5-b2e8-6b722e0a0a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:37.738472 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308cea1-60d0-42f5-b2e8-6b722e0a0a7a admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:37.738815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308cea1-60d0-42f5-b2e8-6b722e0a0a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:37.738815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308cea1-60d0-42f5-b2e8-6b722e0a0a7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:37.739630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308cea1-60d0-42f5-b2e8-6b722e0a0a7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:37.741514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308cea1-60d0-42f5-b2e8-6b722e0a0a7a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:37.850263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 793/1577] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:34:37 2022] POST /identity/v3/projects => generated 389 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:37.851248 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a25b5-713d-4361-94da-2aaad6458ad4 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:37.890639 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 785/1578] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:34:37 2022] POST /identity/v3/projects => generated 405 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:37.893050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308cea1-60d0-42f5-b2e8-6b722e0a0a7a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:37.919332 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a25b5-713d-4361-94da-2aaad6458ad4 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:37.941107 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:37.961578 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308cea1-60d0-42f5-b2e8-6b722e0a0a7a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:37.966684 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be98d4c-056a-4d20-83e6-3951d6f94c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:37.967379 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be98d4c-056a-4d20-83e6-3951d6f94c7e admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:37.967705 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be98d4c-056a-4d20-83e6-3951d6f94c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:37.967983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be98d4c-056a-4d20-83e6-3951d6f94c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:37.968694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be98d4c-056a-4d20-83e6-3951d6f94c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:37.970482 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be98d4c-056a-4d20-83e6-3951d6f94c7e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:37.979802 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b349b31-5991-4806-b801-395cedefb589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:37.980444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b349b31-5991-4806-b801-395cedefb589 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:37.980911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b349b31-5991-4806-b801-395cedefb589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:37.981469 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b349b31-5991-4806-b801-395cedefb589 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:37.981608 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 786/1579] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:37.982249 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be98d4c-056a-4d20-83e6-3951d6f94c7e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:37.985158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b349b31-5991-4806-b801-395cedefb589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:37.987578 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b349b31-5991-4806-b801-395cedefb589 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:37.992567 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be98d4c-056a-4d20-83e6-3951d6f94c7e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:37.997077 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dc5cc-6cf5-4286-8a91-abaded82bc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:37.997717 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dc5cc-6cf5-4286-8a91-abaded82bc30 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:37.997995 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dc5cc-6cf5-4286-8a91-abaded82bc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:37.998268 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dc5cc-6cf5-4286-8a91-abaded82bc30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:37.998894 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400dc5cc-6cf5-4286-8a91-abaded82bc30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:38.000463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400dc5cc-6cf5-4286-8a91-abaded82bc30 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:38.014323 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 787/1580] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:38.014323 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dc5cc-6cf5-4286-8a91-abaded82bc30 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:38.024161 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dc5cc-6cf5-4286-8a91-abaded82bc30 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:38.028969 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e5db5-bce5-4158-b04a-90c08c9ce743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:38.029630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e5db5-bce5-4158-b04a-90c08c9ce743 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:38.029906 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e5db5-bce5-4158-b04a-90c08c9ce743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:38.030176 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e5db5-bce5-4158-b04a-90c08c9ce743 admin admin] PATH_INFO: `/v3/projects/6490692b9e024e09ad2e5ffb0bc0707a/users/c74f8acfc15647f4b3606bc46fb16992/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:38.045148 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e5db5-bce5-4158-b04a-90c08c9ce743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6490692b9e024e09ad2e5ffb0bc0707a, user_id=c74f8acfc15647f4b3606bc46fb16992, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:38.047757 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e5db5-bce5-4158-b04a-90c08c9ce743 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:38.148619 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 794/1581] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:34:37 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:38.149536 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b349b31-5991-4806-b801-395cedefb589 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:38.158952 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b349b31-5991-4806-b801-395cedefb589 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:38.164200 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015065c-e557-48fb-bf1c-9786ffd2b131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:38.164770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015065c-e557-48fb-bf1c-9786ffd2b131 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:38.165046 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015065c-e557-48fb-bf1c-9786ffd2b131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:38.165345 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015065c-e557-48fb-bf1c-9786ffd2b131 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:38.165967 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015065c-e557-48fb-bf1c-9786ffd2b131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:38.167864 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015065c-e557-48fb-bf1c-9786ffd2b131 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:38.212550 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 788/1582] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:34:38 2022] PUT /identity/v3/projects/6490692b9e024e09ad2e5ffb0bc0707a/users/c74f8acfc15647f4b3606bc46fb16992/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:38.213448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e5db5-bce5-4158-b04a-90c08c9ce743 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:38.281152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e5db5-bce5-4158-b04a-90c08c9ce743 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:38.286511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99f42f-8e66-4065-a920-3a7f35bbe3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:38.287111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99f42f-8e66-4065-a920-3a7f35bbe3df admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:38.287386 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99f42f-8e66-4065-a920-3a7f35bbe3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:38.287654 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99f42f-8e66-4065-a920-3a7f35bbe3df admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:38.288282 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99f42f-8e66-4065-a920-3a7f35bbe3df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:38.290019 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99f42f-8e66-4065-a920-3a7f35bbe3df admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:38.296094 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:38.299925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 795/1583] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:34:38 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:38.299925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015065c-e557-48fb-bf1c-9786ffd2b131 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:38.301914 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 789/1584] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:38.302749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99f42f-8e66-4065-a920-3a7f35bbe3df admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:38.310702 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015065c-e557-48fb-bf1c-9786ffd2b131 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:38.313277 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99f42f-8e66-4065-a920-3a7f35bbe3df admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:38.315641 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c230531-bd14-474d-8c5d-16de37191595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:38.316246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c230531-bd14-474d-8c5d-16de37191595 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:38.316525 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c230531-bd14-474d-8c5d-16de37191595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:38.316963 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c230531-bd14-474d-8c5d-16de37191595 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:38.317874 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c230531-bd14-474d-8c5d-16de37191595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:38.318209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdce05-70c1-4c01-996f-a1fc3ff668bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:38.318840 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdce05-70c1-4c01-996f-a1fc3ff668bc admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:38.319121 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdce05-70c1-4c01-996f-a1fc3ff668bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:38.319429 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdce05-70c1-4c01-996f-a1fc3ff668bc admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:38.319881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c230531-bd14-474d-8c5d-16de37191595 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:38.320047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cdce05-70c1-4c01-996f-a1fc3ff668bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:38.321964 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cdce05-70c1-4c01-996f-a1fc3ff668bc admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:38.388058 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 796/1585] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:34:38 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:38.388886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c230531-bd14-474d-8c5d-16de37191595 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:38.399740 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c230531-bd14-474d-8c5d-16de37191595 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:38.403935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 790/1586] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:34:38 2022] POST /identity/v3/users => generated 303 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:38.403935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdce05-70c1-4c01-996f-a1fc3ff668bc admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:38.404955 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26d5af-14ae-4abd-9974-4d751285663e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:38.405636 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26d5af-14ae-4abd-9974-4d751285663e admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:38.405923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26d5af-14ae-4abd-9974-4d751285663e admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:38.406255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26d5af-14ae-4abd-9974-4d751285663e admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:38.406969 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26d5af-14ae-4abd-9974-4d751285663e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:38.408759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26d5af-14ae-4abd-9974-4d751285663e admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:38.413834 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdce05-70c1-4c01-996f-a1fc3ff668bc admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:38.418661 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979cbd4-686e-4d42-b59c-79b2df925608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:38.419250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979cbd4-686e-4d42-b59c-79b2df925608 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:38.419555 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979cbd4-686e-4d42-b59c-79b2df925608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:38.419831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979cbd4-686e-4d42-b59c-79b2df925608 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:38.420344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 797/1587] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:38.420606 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979cbd4-686e-4d42-b59c-79b2df925608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:38.421187 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26d5af-14ae-4abd-9974-4d751285663e admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:38.422304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979cbd4-686e-4d42-b59c-79b2df925608 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:38.431492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26d5af-14ae-4abd-9974-4d751285663e admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:38.434642 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 791/1588] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:38.434642 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb07e11-e03f-411f-9fac-6b0deeb79440 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:38.434642 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb07e11-e03f-411f-9fac-6b0deeb79440 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:38.434642 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb07e11-e03f-411f-9fac-6b0deeb79440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:38.440092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db068a4-b4cf-488c-ab33-dfeb12a4c3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:38.440716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db068a4-b4cf-488c-ab33-dfeb12a4c3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:38.440992 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db068a4-b4cf-488c-ab33-dfeb12a4c3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:38.444926 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db068a4-b4cf-488c-ab33-dfeb12a4c3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:38.444926 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db068a4-b4cf-488c-ab33-dfeb12a4c3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:38.444926 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db068a4-b4cf-488c-ab33-dfeb12a4c3a0 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:38.454603 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 798/1589] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:38.455545 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db068a4-b4cf-488c-ab33-dfeb12a4c3a0 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:38.460672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-bcb07e11-e03f-411f-9fac-6b0deeb79440 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:38.462306 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bcb07e11-e03f-411f-9fac-6b0deeb79440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:38.476125 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db068a4-b4cf-488c-ab33-dfeb12a4c3a0 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:38.476288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 792/1590] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:38.476288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb07e11-e03f-411f-9fac-6b0deeb79440 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:38.476461 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04744206-2989-48dd-a826-016a102b6160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:38.476461 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04744206-2989-48dd-a826-016a102b6160 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:38.476461 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04744206-2989-48dd-a826-016a102b6160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:38.476461 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04744206-2989-48dd-a826-016a102b6160 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:38.476773 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04744206-2989-48dd-a826-016a102b6160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:38.477620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04744206-2989-48dd-a826-016a102b6160 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:38.485340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb07e11-e03f-411f-9fac-6b0deeb79440 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:38.489046 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 799/1591] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:38.490319 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04744206-2989-48dd-a826-016a102b6160 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:38.490621 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad5ebe-2ffb-47ed-897a-b282833c48eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:38.491310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad5ebe-2ffb-47ed-897a-b282833c48eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:38.491585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad5ebe-2ffb-47ed-897a-b282833c48eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:38.491859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad5ebe-2ffb-47ed-897a-b282833c48eb admin admin] PATH_INFO: `/v3/projects/b5309ad8c62f47049266f7b789fbec34/users/e5410db9af5644ab97be0e79838cd683/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:38.502031 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04744206-2989-48dd-a826-016a102b6160 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:38.508058 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad5ebe-2ffb-47ed-897a-b282833c48eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5309ad8c62f47049266f7b789fbec34, user_id=e5410db9af5644ab97be0e79838cd683, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:38.508428 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb826e-e114-4a24-98c4-1028d4e35627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:38.509048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb826e-e114-4a24-98c4-1028d4e35627 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:38.509352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb826e-e114-4a24-98c4-1028d4e35627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:38.509633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb826e-e114-4a24-98c4-1028d4e35627 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:38.510511 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb826e-e114-4a24-98c4-1028d4e35627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:38.510773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad5ebe-2ffb-47ed-897a-b282833c48eb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:38.512125 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb826e-e114-4a24-98c4-1028d4e35627 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:38.523133 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 800/1592] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:38.523918 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb826e-e114-4a24-98c4-1028d4e35627 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:38.534421 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb826e-e114-4a24-98c4-1028d4e35627 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:38.539702 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19581140-7f02-45d2-8959-4f964cb2c9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:38.540362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19581140-7f02-45d2-8959-4f964cb2c9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:38.540774 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19581140-7f02-45d2-8959-4f964cb2c9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:38.541114 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19581140-7f02-45d2-8959-4f964cb2c9b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:38.541945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19581140-7f02-45d2-8959-4f964cb2c9b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:38.543788 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19581140-7f02-45d2-8959-4f964cb2c9b2 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:38.556251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 801/1593] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:38.557017 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19581140-7f02-45d2-8959-4f964cb2c9b2 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:38.568607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19581140-7f02-45d2-8959-4f964cb2c9b2 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:38.573457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9c5e9-ab9b-4909-8c85-f56427ece073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:38.579434 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9c5e9-ab9b-4909-8c85-f56427ece073 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:38.579434 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9c5e9-ab9b-4909-8c85-f56427ece073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:38.579434 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9c5e9-ab9b-4909-8c85-f56427ece073 admin admin] PATH_INFO: `/v3/projects/75aac1d849c04f139c63e244ec26b01c/users/672a9c1fc01a4f95835e9391bc1df036/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:38.590743 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9c5e9-ab9b-4909-8c85-f56427ece073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75aac1d849c04f139c63e244ec26b01c, user_id=672a9c1fc01a4f95835e9391bc1df036, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:38.591785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: WARNING py.warnings [None req-dec9c5e9-ab9b-4909-8c85-f56427ece073 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 14:34:38.591785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: warnings.warn(msg) Sep 05 14:34:38.591785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: Sep 05 14:34:38.593736 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec9c5e9-ab9b-4909-8c85-f56427ece073 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:38.611341 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 793/1594] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:34:38 2022] PUT /identity/v3/projects/b5309ad8c62f47049266f7b789fbec34/users/e5410db9af5644ab97be0e79838cd683/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:38.612234 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad5ebe-2ffb-47ed-897a-b282833c48eb admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:38.674160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad5ebe-2ffb-47ed-897a-b282833c48eb admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:38.679403 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afe4f2-d074-4bfa-9edc-e9e945a88dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:38.680189 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afe4f2-d074-4bfa-9edc-e9e945a88dec admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:38.680472 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afe4f2-d074-4bfa-9edc-e9e945a88dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:38.680746 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afe4f2-d074-4bfa-9edc-e9e945a88dec admin admin] PATH_INFO: `/v3/projects/241a011b4362459baefb59900fb3226d/users/5bad217b9d214a3abfa90c10de9aec4f/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:38.686964 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 802/1595] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:34:38 2022] PUT /identity/v3/projects/75aac1d849c04f139c63e244ec26b01c/users/672a9c1fc01a4f95835e9391bc1df036/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:38.688617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9c5e9-ab9b-4909-8c85-f56427ece073 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:38.696967 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34afe4f2-d074-4bfa-9edc-e9e945a88dec admin admin] RBAC: Authorizing `identity:create_grant(project_id=241a011b4362459baefb59900fb3226d, user_id=5bad217b9d214a3abfa90c10de9aec4f, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:38.699916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34afe4f2-d074-4bfa-9edc-e9e945a88dec admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:38.756467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9c5e9-ab9b-4909-8c85-f56427ece073 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:38.761171 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981ae8f-6672-4ad8-9fd1-6e1b3e672ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:38.761784 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981ae8f-6672-4ad8-9fd1-6e1b3e672ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:38.762069 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981ae8f-6672-4ad8-9fd1-6e1b3e672ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:38.762345 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981ae8f-6672-4ad8-9fd1-6e1b3e672ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:38.762988 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981ae8f-6672-4ad8-9fd1-6e1b3e672ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:38.764683 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981ae8f-6672-4ad8-9fd1-6e1b3e672ad4 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:38.765965 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:38.774949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 803/1596] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:38.775736 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981ae8f-6672-4ad8-9fd1-6e1b3e672ad4 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:38.817456 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 794/1597] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:34:38 2022] PUT /identity/v3/projects/241a011b4362459baefb59900fb3226d/users/5bad217b9d214a3abfa90c10de9aec4f/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:38.818518 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afe4f2-d074-4bfa-9edc-e9e945a88dec admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:38.830125 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981ae8f-6672-4ad8-9fd1-6e1b3e672ad4 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:38.882304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d062bb-8a6b-496f-8164-a8add80cd5be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:38.882930 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d062bb-8a6b-496f-8164-a8add80cd5be service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:38.883185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d062bb-8a6b-496f-8164-a8add80cd5be service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:38.883450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d062bb-8a6b-496f-8164-a8add80cd5be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:38.892419 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afe4f2-d074-4bfa-9edc-e9e945a88dec admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:38.892576 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d062bb-8a6b-496f-8164-a8add80cd5be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:38.894008 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d062bb-8a6b-496f-8164-a8add80cd5be service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:38.897883 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4a9ae-bbc1-475a-8511-464a4b31402a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:38.898484 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4a9ae-bbc1-475a-8511-464a4b31402a admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:38.898780 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4a9ae-bbc1-475a-8511-464a4b31402a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:38.899032 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4a9ae-bbc1-475a-8511-464a4b31402a admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:38.899705 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4a9ae-bbc1-475a-8511-464a4b31402a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:38.901339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4a9ae-bbc1-475a-8511-464a4b31402a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:38.903970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 804/1598] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:34:38.904860 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d062bb-8a6b-496f-8164-a8add80cd5be service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:38.912290 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 795/1599] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:38.914151 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4a9ae-bbc1-475a-8511-464a4b31402a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:38.915335 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d062bb-8a6b-496f-8164-a8add80cd5be service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:38.920536 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcc419-6279-4c23-8490-2cba69420ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:38.921172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcc419-6279-4c23-8490-2cba69420ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:38.921436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcc419-6279-4c23-8490-2cba69420ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:38.921703 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcc419-6279-4c23-8490-2cba69420ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:38.922329 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bcc419-6279-4c23-8490-2cba69420ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:38.923958 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bcc419-6279-4c23-8490-2cba69420ed8 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:38.926720 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4a9ae-bbc1-475a-8511-464a4b31402a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:38.932269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619da249-84ec-4d7f-a3bd-99b691047ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:38.932939 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619da249-84ec-4d7f-a3bd-99b691047ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:38.940523 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619da249-84ec-4d7f-a3bd-99b691047ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:38.940523 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619da249-84ec-4d7f-a3bd-99b691047ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:38.940523 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619da249-84ec-4d7f-a3bd-99b691047ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:38.940815 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 805/1600] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:38.940903 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619da249-84ec-4d7f-a3bd-99b691047ce8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:38.940994 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ad758-c87b-4af1-bd48-ad6f84879e8b None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:38.940994 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ad758-c87b-4af1-bd48-ad6f84879e8b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:38.940994 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ad758-c87b-4af1-bd48-ad6f84879e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:38.950325 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 796/1601] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:38.950325 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319eb1d-78ef-4663-a25b-446f4d70ead0 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:38.950325 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319eb1d-78ef-4663-a25b-446f4d70ead0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:38.950325 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319eb1d-78ef-4663-a25b-446f4d70ead0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:38.968091 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-1d3ad758-c87b-4af1-bd48-ad6f84879e8b None None] MFA Rules not processed for user `e5410db9af5644ab97be0e79838cd683`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:38.969397 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1d3ad758-c87b-4af1-bd48-ad6f84879e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:38.969811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:38.978928 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6319eb1d-78ef-4663-a25b-446f4d70ead0 None None] MFA Rules not processed for user `672a9c1fc01a4f95835e9391bc1df036`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:38.980215 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6319eb1d-78ef-4663-a25b-446f4d70ead0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:39.037648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 806/1602] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:39.038426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ad758-c87b-4af1-bd48-ad6f84879e8b None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:39.042483 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 797/1603] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:39.043670 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dfd07-2ba7-4fe7-97f6-c4bf78cedd0c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:39.043957 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dfd07-2ba7-4fe7-97f6-c4bf78cedd0c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:39.044228 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0dfd07-2ba7-4fe7-97f6-c4bf78cedd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:39.053776 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ad758-c87b-4af1-bd48-ad6f84879e8b None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:39.060692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3b762-c7bb-428d-9d69-523ed8117fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:39.061424 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3b762-c7bb-428d-9d69-523ed8117fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:39.061701 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3b762-c7bb-428d-9d69-523ed8117fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:39.061973 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3b762-c7bb-428d-9d69-523ed8117fd7 admin admin] PATH_INFO: `/v3/projects/fa3684d0b02b402aabe4d053df18a96a/users/656588cb9b354bbab81bff12e56f16cc/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:39.079793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9e0dfd07-2ba7-4fe7-97f6-c4bf78cedd0c None None] MFA Rules not processed for user `5bad217b9d214a3abfa90c10de9aec4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:39.081208 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9e0dfd07-2ba7-4fe7-97f6-c4bf78cedd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:39.081928 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3b762-c7bb-428d-9d69-523ed8117fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa3684d0b02b402aabe4d053df18a96a, user_id=656588cb9b354bbab81bff12e56f16cc, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:39.085034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3b762-c7bb-428d-9d69-523ed8117fd7 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:39.145676 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 798/1604] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:39.148329 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0dfd07-2ba7-4fe7-97f6-c4bf78cedd0c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:39.159673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0dfd07-2ba7-4fe7-97f6-c4bf78cedd0c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:39.164692 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0464e0-61ad-4633-aefa-3b6380997c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:39.165386 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0464e0-61ad-4633-aefa-3b6380997c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:39.165767 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0464e0-61ad-4633-aefa-3b6380997c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:39.166062 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0464e0-61ad-4633-aefa-3b6380997c1c admin admin] PATH_INFO: `/v3/projects/42b33ed10ad1436684d1b2a32c99a27b/users/737c90cc21dc4da489d15d513dec5932/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:39.182541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0464e0-61ad-4633-aefa-3b6380997c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b33ed10ad1436684d1b2a32c99a27b, user_id=737c90cc21dc4da489d15d513dec5932, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:39.186026 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0464e0-61ad-4633-aefa-3b6380997c1c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:39.219649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 807/1605] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:34:39 2022] PUT /identity/v3/projects/fa3684d0b02b402aabe4d053df18a96a/users/656588cb9b354bbab81bff12e56f16cc/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:39.220770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3b762-c7bb-428d-9d69-523ed8117fd7 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:39.231291 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:39.289041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3b762-c7bb-428d-9d69-523ed8117fd7 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:39.295026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf33466-7632-4ba4-8516-f1e55df8fd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:39.301041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33466-7632-4ba4-8516-f1e55df8fd7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:39.301041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33466-7632-4ba4-8516-f1e55df8fd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:39.301041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf33466-7632-4ba4-8516-f1e55df8fd7c admin admin] PATH_INFO: `/v3/projects/6f2580d8a63c40a38b4292bfae0faf61/users/0a11601da6724a97b4f5acc5b06b2811/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:39.311818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf33466-7632-4ba4-8516-f1e55df8fd7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f2580d8a63c40a38b4292bfae0faf61, user_id=0a11601da6724a97b4f5acc5b06b2811, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:39.315350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf33466-7632-4ba4-8516-f1e55df8fd7c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:39.328263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 799/1606] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:34:39 2022] PUT /identity/v3/projects/42b33ed10ad1436684d1b2a32c99a27b/users/737c90cc21dc4da489d15d513dec5932/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:39.329757 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0464e0-61ad-4633-aefa-3b6380997c1c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:39.401944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0464e0-61ad-4633-aefa-3b6380997c1c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:39.407102 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23320908-67d7-4864-8b2e-dced18ea931c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:39.407764 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23320908-67d7-4864-8b2e-dced18ea931c admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:39.408126 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23320908-67d7-4864-8b2e-dced18ea931c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:39.408314 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23320908-67d7-4864-8b2e-dced18ea931c admin admin] PATH_INFO: `/v3/projects/288b7d61600b406597ec10874d3811d7/users/7c203bca504243ea80766eeccd171890/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:39.412183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 808/1607] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:34:39 2022] PUT /identity/v3/projects/6f2580d8a63c40a38b4292bfae0faf61/users/0a11601da6724a97b4f5acc5b06b2811/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:39.416231 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf33466-7632-4ba4-8516-f1e55df8fd7c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:39.432711 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23320908-67d7-4864-8b2e-dced18ea931c admin admin] RBAC: Authorizing `identity:create_grant(project_id=288b7d61600b406597ec10874d3811d7, user_id=7c203bca504243ea80766eeccd171890, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:39.436183 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23320908-67d7-4864-8b2e-dced18ea931c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:39.472012 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf33466-7632-4ba4-8516-f1e55df8fd7c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:39.476290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df008eb5-8218-4d1c-872f-087b056a104b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:39.476882 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df008eb5-8218-4d1c-872f-087b056a104b service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:39.477190 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df008eb5-8218-4d1c-872f-087b056a104b service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:39.477462 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df008eb5-8218-4d1c-872f-087b056a104b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:39.532026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df008eb5-8218-4d1c-872f-087b056a104b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:39.533532 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df008eb5-8218-4d1c-872f-087b056a104b service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:39.548213 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 800/1608] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:34:39 2022] PUT /identity/v3/projects/288b7d61600b406597ec10874d3811d7/users/7c203bca504243ea80766eeccd171890/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:39.548213 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3cd7d-6bd7-4ddf-98b9-39adf237251a None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:39.548213 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3cd7d-6bd7-4ddf-98b9-39adf237251a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:39.548213 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3cd7d-6bd7-4ddf-98b9-39adf237251a None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:39.548621 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 809/1609] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:34:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:34:39.548621 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df008eb5-8218-4d1c-872f-087b056a104b service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:39.548779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 801/1610] 10.222.0.23 () {54 vars in 962 bytes} [Mon Sep 5 14:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:34:39.549404 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96e93f-fe6f-46cf-8667-0cb35cbec3b8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:39.549850 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96e93f-fe6f-46cf-8667-0cb35cbec3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:39.550334 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96e93f-fe6f-46cf-8667-0cb35cbec3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:39.571989 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:39.592140 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9e96e93f-fe6f-46cf-8667-0cb35cbec3b8 None None] MFA Rules not processed for user `656588cb9b354bbab81bff12e56f16cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:39.593648 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9e96e93f-fe6f-46cf-8667-0cb35cbec3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:39.633839 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df008eb5-8218-4d1c-872f-087b056a104b service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:39.676592 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 802/1611] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:39.678397 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25505623-6a55-415c-b6c7-2f1328d68a1d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:39.678710 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25505623-6a55-415c-b6c7-2f1328d68a1d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:39.679478 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25505623-6a55-415c-b6c7-2f1328d68a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:39.702194 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-25505623-6a55-415c-b6c7-2f1328d68a1d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:39.703888 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-25505623-6a55-415c-b6c7-2f1328d68a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:39.721482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb2593-c742-4d67-b5ff-efb16292ed73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:39.733771 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb2593-c742-4d67-b5ff-efb16292ed73 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:39.735038 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb2593-c742-4d67-b5ff-efb16292ed73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:39.735397 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb2593-c742-4d67-b5ff-efb16292ed73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:39.737565 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb2593-c742-4d67-b5ff-efb16292ed73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:39.742125 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb2593-c742-4d67-b5ff-efb16292ed73 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:39.782981 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 803/1612] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:39.784261 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa4acd-bc22-447d-915f-1967764038b7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:39.784550 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa4acd-bc22-447d-915f-1967764038b7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:39.784831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa4acd-bc22-447d-915f-1967764038b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:39.807167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4aaa4acd-bc22-447d-915f-1967764038b7 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:39.808293 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4aaa4acd-bc22-447d-915f-1967764038b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:39.817766 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 804/1613] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:39.826727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df248961-fadb-44f3-8929-c3271e5e56d1 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:39.826727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df248961-fadb-44f3-8929-c3271e5e56d1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:39.826727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df248961-fadb-44f3-8929-c3271e5e56d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:39.840202 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-df248961-fadb-44f3-8929-c3271e5e56d1 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:39.841438 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-df248961-fadb-44f3-8929-c3271e5e56d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:39.845016 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:39.850303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 805/1614] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:39.856573 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de63b7-1f84-4f91-8c70-f802c541e816 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:39.856573 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de63b7-1f84-4f91-8c70-f802c541e816 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:39.856573 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de63b7-1f84-4f91-8c70-f802c541e816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:39.891580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 810/1615] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:34:39 2022] POST /identity/v3/projects => generated 371 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:39.893248 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860d319-119a-4d03-bfd7-3bdbe775522e None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:39.894119 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860d319-119a-4d03-bfd7-3bdbe775522e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:39.894545 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860d319-119a-4d03-bfd7-3bdbe775522e None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:39.896309 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-49de63b7-1f84-4f91-8c70-f802c541e816 None None] MFA Rules not processed for user `d5515accf3b64006bc41422265a641bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:39.896967 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 811/1616] 10.222.0.23 () {54 vars in 962 bytes} [Mon Sep 5 14:34:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:34:39.897880 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860d319-119a-4d03-bfd7-3bdbe775522e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:39.899776 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8860d319-119a-4d03-bfd7-3bdbe775522e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:39.905687 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-49de63b7-1f84-4f91-8c70-f802c541e816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:39.962239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860d319-119a-4d03-bfd7-3bdbe775522e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:39.966205 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb5104-57ab-4d47-8e19-098bcd5ae0e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:39.966679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb5104-57ab-4d47-8e19-098bcd5ae0e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:39.966954 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb5104-57ab-4d47-8e19-098bcd5ae0e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:39.967356 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb5104-57ab-4d47-8e19-098bcd5ae0e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:39.986543 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 806/1617] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Sep 5 14:34:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:39.987825 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de63b7-1f84-4f91-8c70-f802c541e816 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:40.001517 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de63b7-1f84-4f91-8c70-f802c541e816 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:40.011062 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ed229-bb79-4543-99e3-b51688f28931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:40.013179 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ed229-bb79-4543-99e3-b51688f28931 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:40.013633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ed229-bb79-4543-99e3-b51688f28931 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:40.014010 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ed229-bb79-4543-99e3-b51688f28931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:40.043604 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb5104-57ab-4d47-8e19-098bcd5ae0e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:40.045327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb5104-57ab-4d47-8e19-098bcd5ae0e2 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:40.056868 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 812/1618] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:34:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:34:40.057749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb5104-57ab-4d47-8e19-098bcd5ae0e2 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:40.069380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb5104-57ab-4d47-8e19-098bcd5ae0e2 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:40.074465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57463850-1bb6-4ce4-b264-482d8c8fd576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:40.075069 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57463850-1bb6-4ce4-b264-482d8c8fd576 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:40.075461 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57463850-1bb6-4ce4-b264-482d8c8fd576 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:40.075755 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57463850-1bb6-4ce4-b264-482d8c8fd576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:40.081443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ed229-bb79-4543-99e3-b51688f28931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:40.083172 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ed229-bb79-4543-99e3-b51688f28931 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:40.088710 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57463850-1bb6-4ce4-b264-482d8c8fd576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:40.090394 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57463850-1bb6-4ce4-b264-482d8c8fd576 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:40.106625 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 807/1619] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:34:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:34:40.106625 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ed229-bb79-4543-99e3-b51688f28931 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:40.107022 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 813/1620] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:34:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:34:40.107022 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196009fa-12ef-425c-8c1f-b59c1ed88e2e None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:40.107022 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196009fa-12ef-425c-8c1f-b59c1ed88e2e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:40.107022 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196009fa-12ef-425c-8c1f-b59c1ed88e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:40.108357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ed229-bb79-4543-99e3-b51688f28931 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:40.117314 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c32e1-b8c5-4792-b036-b0457537c71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:40.118691 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c32e1-b8c5-4792-b036-b0457537c71d admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:40.120081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c32e1-b8c5-4792-b036-b0457537c71d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:40.120628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c32e1-b8c5-4792-b036-b0457537c71d admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:40.121869 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c32e1-b8c5-4792-b036-b0457537c71d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:40.126426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c32e1-b8c5-4792-b036-b0457537c71d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:40.127035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-196009fa-12ef-425c-8c1f-b59c1ed88e2e None None] MFA Rules not processed for user `d5515accf3b64006bc41422265a641bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:40.128237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-196009fa-12ef-425c-8c1f-b59c1ed88e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:40.142121 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 814/1621] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Sep 5 14:34:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:40.143220 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196009fa-12ef-425c-8c1f-b59c1ed88e2e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:40.155452 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196009fa-12ef-425c-8c1f-b59c1ed88e2e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:40.162406 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96250f2d-72f0-430e-9c84-0be15e80033d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:40.163254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96250f2d-72f0-430e-9c84-0be15e80033d service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:40.163585 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96250f2d-72f0-430e-9c84-0be15e80033d service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:40.163925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96250f2d-72f0-430e-9c84-0be15e80033d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:40.231400 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96250f2d-72f0-430e-9c84-0be15e80033d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:40.231400 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96250f2d-72f0-430e-9c84-0be15e80033d service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:40.244476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 815/1622] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:34:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:34:40.250797 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96250f2d-72f0-430e-9c84-0be15e80033d service nova] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:40.251532 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:40.259118 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 808/1623] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:34:40 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:40.259489 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96250f2d-72f0-430e-9c84-0be15e80033d service nova] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:40.260207 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c32e1-b8c5-4792-b036-b0457537c71d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:40.266516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea2721-0b8d-48fb-95c2-2b888bbd5f0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:40.267324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea2721-0b8d-48fb-95c2-2b888bbd5f0a service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:40.267859 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea2721-0b8d-48fb-95c2-2b888bbd5f0a service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:40.268277 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea2721-0b8d-48fb-95c2-2b888bbd5f0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:40.285601 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c32e1-b8c5-4792-b036-b0457537c71d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:40.291757 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4594784-fab4-40ff-ba73-8e4f63902fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:40.292615 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4594784-fab4-40ff-ba73-8e4f63902fed admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:40.293050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4594784-fab4-40ff-ba73-8e4f63902fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:40.293548 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4594784-fab4-40ff-ba73-8e4f63902fed admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:40.294376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4594784-fab4-40ff-ba73-8e4f63902fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:40.296408 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4594784-fab4-40ff-ba73-8e4f63902fed admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:40.322025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 809/1624] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:40.326449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4594784-fab4-40ff-ba73-8e4f63902fed admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:40.339190 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4594784-fab4-40ff-ba73-8e4f63902fed admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:40.345726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df3402-d9df-4f97-bd9b-c2759d558fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:40.348287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df3402-d9df-4f97-bd9b-c2759d558fee admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:40.348287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df3402-d9df-4f97-bd9b-c2759d558fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:40.348287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df3402-d9df-4f97-bd9b-c2759d558fee admin admin] PATH_INFO: `/v3/projects/fbd18cbb72aa4422b9252cf068efa9dd/users/7f3b0c83d41045c0b18a6e8458e5cb8f/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:40.366720 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df3402-d9df-4f97-bd9b-c2759d558fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd18cbb72aa4422b9252cf068efa9dd, user_id=7f3b0c83d41045c0b18a6e8458e5cb8f, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:40.369968 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df3402-d9df-4f97-bd9b-c2759d558fee admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:40.384427 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea2721-0b8d-48fb-95c2-2b888bbd5f0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:40.386666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea2721-0b8d-48fb-95c2-2b888bbd5f0a service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:40.399059 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 816/1625] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:34:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:34:40.472229 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 810/1626] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:34:40 2022] PUT /identity/v3/projects/fbd18cbb72aa4422b9252cf068efa9dd/users/7f3b0c83d41045c0b18a6e8458e5cb8f/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:40.473722 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea2721-0b8d-48fb-95c2-2b888bbd5f0a service nova] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:40.490784 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea2721-0b8d-48fb-95c2-2b888bbd5f0a service nova] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:40.535252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf7fc4-7d84-44cf-9d0d-acd9fc928fba None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:40.535867 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf7fc4-7d84-44cf-9d0d-acd9fc928fba None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:40.536280 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf7fc4-7d84-44cf-9d0d-acd9fc928fba None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:40.537270 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:40.537838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 811/1627] 10.222.0.23 () {54 vars in 912 bytes} [Mon Sep 5 14:34:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:34:40.545665 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78d1cf-c8bf-4c3e-99de-648df86ffe6e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:40.546030 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78d1cf-c8bf-4c3e-99de-648df86ffe6e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:40.546375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78d1cf-c8bf-4c3e-99de-648df86ffe6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:40.593632 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8b78d1cf-c8bf-4c3e-99de-648df86ffe6e None None] MFA Rules not processed for user `d5515accf3b64006bc41422265a641bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:40.602470 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8b78d1cf-c8bf-4c3e-99de-648df86ffe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:40.603438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6f888-b6f0-468c-b458-7e4347b8c89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:40.609259 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6f888-b6f0-468c-b458-7e4347b8c89b admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:40.609602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6f888-b6f0-468c-b458-7e4347b8c89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:40.614328 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6f888-b6f0-468c-b458-7e4347b8c89b admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:40.618813 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6f888-b6f0-468c-b458-7e4347b8c89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:40.622769 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6f888-b6f0-468c-b458-7e4347b8c89b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:40.650726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 817/1628] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:34:40.655589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6f888-b6f0-468c-b458-7e4347b8c89b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:40.675066 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6f888-b6f0-468c-b458-7e4347b8c89b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:40.690795 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8c377-7474-44b8-a5cc-767c7f3e570f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:40.691388 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8c377-7474-44b8-a5cc-767c7f3e570f admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:40.692242 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8c377-7474-44b8-a5cc-767c7f3e570f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:40.692879 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8c377-7474-44b8-a5cc-767c7f3e570f admin admin] PATH_INFO: `/v3/projects/fbd18cbb72aa4422b9252cf068efa9dd/users/7f3b0c83d41045c0b18a6e8458e5cb8f/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:40.696982 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8c377-7474-44b8-a5cc-767c7f3e570f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd18cbb72aa4422b9252cf068efa9dd, user_id=7f3b0c83d41045c0b18a6e8458e5cb8f, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:40.702241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8c377-7474-44b8-a5cc-767c7f3e570f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:40.734392 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 818/1629] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:34:40 2022] PUT /identity/v3/projects/fbd18cbb72aa4422b9252cf068efa9dd/users/7f3b0c83d41045c0b18a6e8458e5cb8f/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:34:40.745252 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14dd85-739c-4c85-aac2-698fe93728c2 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:40.748274 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14dd85-739c-4c85-aac2-698fe93728c2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:40.748274 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14dd85-739c-4c85-aac2-698fe93728c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:40.835490 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-bb14dd85-739c-4c85-aac2-698fe93728c2 None None] MFA Rules not processed for user `7f3b0c83d41045c0b18a6e8458e5cb8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:40.837017 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-bb14dd85-739c-4c85-aac2-698fe93728c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:40.888426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 812/1630] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 5 14:34:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:40.905623 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78d1cf-c8bf-4c3e-99de-648df86ffe6e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:40.936012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:41.003479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 819/1631] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:34:41.003479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24760373-c01e-401a-9efa-7376242944e2 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:41.003479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24760373-c01e-401a-9efa-7376242944e2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:41.003479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24760373-c01e-401a-9efa-7376242944e2 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:41.003479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 820/1632] 10.222.0.23 () {54 vars in 912 bytes} [Mon Sep 5 14:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:34:41.011115 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c01b05-8c6a-4473-91a8-353bd313290e None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:41.011451 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c01b05-8c6a-4473-91a8-353bd313290e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:41.011732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c01b05-8c6a-4473-91a8-353bd313290e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:41.016700 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:41.050852 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78d1cf-c8bf-4c3e-99de-648df86ffe6e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:41.054406 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-08c01b05-8c6a-4473-91a8-353bd313290e None None] MFA Rules not processed for user `d5515accf3b64006bc41422265a641bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:41.057817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-08c01b05-8c6a-4473-91a8-353bd313290e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:41.139059 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d0822-241e-4c1e-b76f-279c8827666e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:41.139688 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d0822-241e-4c1e-b76f-279c8827666e service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:41.139967 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d0822-241e-4c1e-b76f-279c8827666e service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:41.140235 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d0822-241e-4c1e-b76f-279c8827666e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:41.176705 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 821/1633] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 5 14:34:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:34:41.177921 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c01b05-8c6a-4473-91a8-353bd313290e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:41.189541 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c01b05-8c6a-4473-91a8-353bd313290e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:41.195620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305dffb7-39a4-4beb-90a0-40f9a7218691 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:41.196832 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dffb7-39a4-4beb-90a0-40f9a7218691 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:41.197275 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dffb7-39a4-4beb-90a0-40f9a7218691 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:41.197870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dffb7-39a4-4beb-90a0-40f9a7218691 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:41.243922 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dffb7-39a4-4beb-90a0-40f9a7218691 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:41.245559 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305dffb7-39a4-4beb-90a0-40f9a7218691 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:41.250228 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d0822-241e-4c1e-b76f-279c8827666e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:41.250228 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d0822-241e-4c1e-b76f-279c8827666e service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:41.261746 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 813/1634] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:34:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:34:41.269396 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 822/1635] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:34:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:34:41.458006 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d0822-241e-4c1e-b76f-279c8827666e service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:41.467943 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d0822-241e-4c1e-b76f-279c8827666e service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:41.475367 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94fb24-2d90-4d1f-9803-5e5620c16b11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:41.476126 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94fb24-2d90-4d1f-9803-5e5620c16b11 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:41.485673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94fb24-2d90-4d1f-9803-5e5620c16b11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:41.485673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94fb24-2d90-4d1f-9803-5e5620c16b11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:41.488891 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94fb24-2d90-4d1f-9803-5e5620c16b11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:41.490570 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94fb24-2d90-4d1f-9803-5e5620c16b11 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:41.503514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 814/1636] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:34:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:34:42.342561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d65437-36b5-473b-9d02-30f3e70e3df2 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:42.347331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d65437-36b5-473b-9d02-30f3e70e3df2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:42.347331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d65437-36b5-473b-9d02-30f3e70e3df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:42.409285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-78d65437-36b5-473b-9d02-30f3e70e3df2 None None] MFA Rules not processed for user `7c203bca504243ea80766eeccd171890`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:42.412020 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-78d65437-36b5-473b-9d02-30f3e70e3df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:42.512428 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 823/1637] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:42 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:42.519126 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94fb24-2d90-4d1f-9803-5e5620c16b11 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:42.690462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94fb24-2d90-4d1f-9803-5e5620c16b11 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:42.710273 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191212d9-816b-467b-b3a5-5c0c4e20148e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:42.711004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191212d9-816b-467b-b3a5-5c0c4e20148e admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:42.711299 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191212d9-816b-467b-b3a5-5c0c4e20148e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:42.711575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191212d9-816b-467b-b3a5-5c0c4e20148e admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:42.712246 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191212d9-816b-467b-b3a5-5c0c4e20148e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:42.714950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191212d9-816b-467b-b3a5-5c0c4e20148e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:42.720659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:42.762944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d65437-36b5-473b-9d02-30f3e70e3df2 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:42.776999 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d65437-36b5-473b-9d02-30f3e70e3df2 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:42.781297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25befc70-a85d-4dfa-bc0c-a168a3e2af11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:42.782027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25befc70-a85d-4dfa-bc0c-a168a3e2af11 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:42.782376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25befc70-a85d-4dfa-bc0c-a168a3e2af11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:42.782718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25befc70-a85d-4dfa-bc0c-a168a3e2af11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:42.820021 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:42.862102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25befc70-a85d-4dfa-bc0c-a168a3e2af11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:42.864137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25befc70-a85d-4dfa-bc0c-a168a3e2af11 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:42.874057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 824/1638] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:34:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:34:42.894374 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 815/1639] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:34:42 2022] POST /identity/v3/projects => generated 405 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:42.898724 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25befc70-a85d-4dfa-bc0c-a168a3e2af11 service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:42.911154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25befc70-a85d-4dfa-bc0c-a168a3e2af11 service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:43.030179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ec594-2aaf-418c-afc8-2fd7adc4966b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:43.031267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ec594-2aaf-418c-afc8-2fd7adc4966b admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:43.031728 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ec594-2aaf-418c-afc8-2fd7adc4966b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:43.031954 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ec594-2aaf-418c-afc8-2fd7adc4966b admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:43.035528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ec594-2aaf-418c-afc8-2fd7adc4966b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:43.036922 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ec594-2aaf-418c-afc8-2fd7adc4966b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:43.211172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 825/1640] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:34:42 2022] POST /identity/v3/users => generated 309 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:43.211589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191212d9-816b-467b-b3a5-5c0c4e20148e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:43.239654 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191212d9-816b-467b-b3a5-5c0c4e20148e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:43.265366 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60f7ce-d57d-4a31-b201-c6a77b3cee42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:43.266078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60f7ce-d57d-4a31-b201-c6a77b3cee42 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:43.266496 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60f7ce-d57d-4a31-b201-c6a77b3cee42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:43.266848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60f7ce-d57d-4a31-b201-c6a77b3cee42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:43.267743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60f7ce-d57d-4a31-b201-c6a77b3cee42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:43.282241 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60f7ce-d57d-4a31-b201-c6a77b3cee42 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:43.301821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 816/1641] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:34:43.305803 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ec594-2aaf-418c-afc8-2fd7adc4966b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:43.317698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ec594-2aaf-418c-afc8-2fd7adc4966b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:43.323181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00974a8-7830-417b-a8c8-6154dc740c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:43.323927 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00974a8-7830-417b-a8c8-6154dc740c6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:43.324266 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00974a8-7830-417b-a8c8-6154dc740c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:43.324691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00974a8-7830-417b-a8c8-6154dc740c6a admin admin] PATH_INFO: `/v3/projects/eb8286cb862c458cb441aae059e34169/users/4ca30f546d24466bb5b4e1fb79df4739/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:43.359170 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00974a8-7830-417b-a8c8-6154dc740c6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb8286cb862c458cb441aae059e34169, user_id=4ca30f546d24466bb5b4e1fb79df4739, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:43.363423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00974a8-7830-417b-a8c8-6154dc740c6a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:43.474398 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 826/1642] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:34:43 2022] PUT /identity/v3/projects/eb8286cb862c458cb441aae059e34169/users/4ca30f546d24466bb5b4e1fb79df4739/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:34:43.480377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60f7ce-d57d-4a31-b201-c6a77b3cee42 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:43.492422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60f7ce-d57d-4a31-b201-c6a77b3cee42 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:43.652183 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2018710-e091-443f-a6f7-3116cd6c8880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:43.653752 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2018710-e091-443f-a6f7-3116cd6c8880 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:43.654246 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2018710-e091-443f-a6f7-3116cd6c8880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:43.654690 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2018710-e091-443f-a6f7-3116cd6c8880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:43.655717 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2018710-e091-443f-a6f7-3116cd6c8880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:43.657726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2018710-e091-443f-a6f7-3116cd6c8880 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:43.710341 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00974a8-7830-417b-a8c8-6154dc740c6a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:43.720472 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 817/1643] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:43.728438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00974a8-7830-417b-a8c8-6154dc740c6a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:43.734734 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d9c62-ebc2-4426-a51d-69345eac1a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:43.735996 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d9c62-ebc2-4426-a51d-69345eac1a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:43.736750 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d9c62-ebc2-4426-a51d-69345eac1a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:43.737863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d9c62-ebc2-4426-a51d-69345eac1a5c admin admin] PATH_INFO: `/v3/projects/eb8286cb862c458cb441aae059e34169/users/4ca30f546d24466bb5b4e1fb79df4739/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:43.740956 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d9c62-ebc2-4426-a51d-69345eac1a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb8286cb862c458cb441aae059e34169, user_id=4ca30f546d24466bb5b4e1fb79df4739, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:43.748801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d9c62-ebc2-4426-a51d-69345eac1a5c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:43.770790 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 827/1644] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:34:43 2022] PUT /identity/v3/projects/eb8286cb862c458cb441aae059e34169/users/4ca30f546d24466bb5b4e1fb79df4739/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:46.421596 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2018710-e091-443f-a6f7-3116cd6c8880 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:46.437004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2018710-e091-443f-a6f7-3116cd6c8880 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:46.658406 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29d0d2-2e63-4683-900e-25a9f6dd679c None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:46.658920 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29d0d2-2e63-4683-900e-25a9f6dd679c None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:46.658994 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29d0d2-2e63-4683-900e-25a9f6dd679c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:46.662879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55146971-a1fb-4a50-af1c-708cd9f77aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:46.663708 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55146971-a1fb-4a50-af1c-708cd9f77aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:46.664225 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55146971-a1fb-4a50-af1c-708cd9f77aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:46.664687 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55146971-a1fb-4a50-af1c-708cd9f77aea admin admin] PATH_INFO: `/v3/users/e5410db9af5644ab97be0e79838cd683` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:46.666679 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55146971-a1fb-4a50-af1c-708cd9f77aea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5410db9af5644ab97be0e79838cd683)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:46.670533 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55146971-a1fb-4a50-af1c-708cd9f77aea admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:46.777442 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-af29d0d2-2e63-4683-900e-25a9f6dd679c None None] MFA Rules not processed for user `4ca30f546d24466bb5b4e1fb79df4739`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:46.778985 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-af29d0d2-2e63-4683-900e-25a9f6dd679c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:46.989191 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:47.012734 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 828/1645] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:46 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:47.112980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-55146971-a1fb-4a50-af1c-708cd9f77aea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5410db9af5644ab97be0e79838cd683'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:47.114516 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-55146971-a1fb-4a50-af1c-708cd9f77aea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5410db9af5644ab97be0e79838cd683'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:47.234163 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-55146971-a1fb-4a50-af1c-708cd9f77aea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5410db9af5644ab97be0e79838cd683'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:47.250645 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-55146971-a1fb-4a50-af1c-708cd9f77aea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5410db9af5644ab97be0e79838cd683'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:47.251398 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-55146971-a1fb-4a50-af1c-708cd9f77aea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5410db9af5644ab97be0e79838cd683'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:47.253041 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:47.274911 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 818/1646] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:34:46 2022] DELETE /identity/v3/users/e5410db9af5644ab97be0e79838cd683 => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:34:47.280200 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4afcb-ea5a-4e76-a611-4c178c7d2d9a None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:47.280677 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4afcb-ea5a-4e76-a611-4c178c7d2d9a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:47.281113 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4afcb-ea5a-4e76-a611-4c178c7d2d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:47.314590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-9cf4afcb-ea5a-4e76-a611-4c178c7d2d9a None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:47.314590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9cf4afcb-ea5a-4e76-a611-4c178c7d2d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:47.432990 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 829/1647] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:47.441006 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55146971-a1fb-4a50-af1c-708cd9f77aea admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:47.442916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-55146971-a1fb-4a50-af1c-708cd9f77aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:47.609426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55146971-a1fb-4a50-af1c-708cd9f77aea admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:47.615889 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99837d-35d5-4ab6-b3c1-4bca977e16ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:47.616643 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99837d-35d5-4ab6-b3c1-4bca977e16ef service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:47.616929 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99837d-35d5-4ab6-b3c1-4bca977e16ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:47.617251 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99837d-35d5-4ab6-b3c1-4bca977e16ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:47.658288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99837d-35d5-4ab6-b3c1-4bca977e16ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:47.659942 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99837d-35d5-4ab6-b3c1-4bca977e16ef service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:47.681387 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 819/1648] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:34:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:34:48.969832 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4afcb-ea5a-4e76-a611-4c178c7d2d9a None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:48.972104 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9cf4afcb-ea5a-4e76-a611-4c178c7d2d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:48.998843 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4afcb-ea5a-4e76-a611-4c178c7d2d9a None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:49.017196 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b2ddb-2a63-4231-aa89-f70c619d75f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:49.018361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b2ddb-2a63-4231-aa89-f70c619d75f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:49.018786 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b2ddb-2a63-4231-aa89-f70c619d75f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:49.019198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b2ddb-2a63-4231-aa89-f70c619d75f9 admin admin] PATH_INFO: `/v3/projects/b5309ad8c62f47049266f7b789fbec34` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:49.023904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b2ddb-2a63-4231-aa89-f70c619d75f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5309ad8c62f47049266f7b789fbec34)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:49.027068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b2ddb-2a63-4231-aa89-f70c619d75f9 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:49.051854 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47a209-5cd2-4037-b6c4-7adcdbaf1d52 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:49.052700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47a209-5cd2-4037-b6c4-7adcdbaf1d52 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:49.053166 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47a209-5cd2-4037-b6c4-7adcdbaf1d52 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:49.054696 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 820/1649] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 5 14:34:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:34:49.171639 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946f6fb-57a2-4fbc-8e35-f6e665b60c14 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:49.172224 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946f6fb-57a2-4fbc-8e35-f6e665b60c14 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:49.172677 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946f6fb-57a2-4fbc-8e35-f6e665b60c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:49.224573 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d946f6fb-57a2-4fbc-8e35-f6e665b60c14 None None] MFA Rules not processed for user `c1880dab32fa424a9356b3fe940d4856`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:49.230868 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d946f6fb-57a2-4fbc-8e35-f6e665b60c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:49.308133 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-096b2ddb-2a63-4231-aa89-f70c619d75f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5309ad8c62f47049266f7b789fbec34', 'request_id': 'req-096b2ddb-2a63-4231-aa89-f70c619d75f9'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:49.327765 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-096b2ddb-2a63-4231-aa89-f70c619d75f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5309ad8c62f47049266f7b789fbec34', 'request_id': 'req-096b2ddb-2a63-4231-aa89-f70c619d75f9'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:49.398477 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 821/1650] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 5 14:34:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:49.462653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-096b2ddb-2a63-4231-aa89-f70c619d75f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5309ad8c62f47049266f7b789fbec34', 'request_id': 'req-096b2ddb-2a63-4231-aa89-f70c619d75f9'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:49.482751 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-096b2ddb-2a63-4231-aa89-f70c619d75f9 admin admin] The token cache is being invalidate because project b5309ad8c62f47049266f7b789fbec34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:34:49.483071 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-096b2ddb-2a63-4231-aa89-f70c619d75f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:49.483986 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-096b2ddb-2a63-4231-aa89-f70c619d75f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:49.491905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883af09-f551-40b3-a316-22a9cb91d685 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:49.492168 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883af09-f551-40b3-a316-22a9cb91d685 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:49.492494 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883af09-f551-40b3-a316-22a9cb91d685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:49.496114 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 830/1651] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:34:48 2022] DELETE /identity/v3/projects/b5309ad8c62f47049266f7b789fbec34 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:49.517959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2883af09-f551-40b3-a316-22a9cb91d685 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:49.519266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2883af09-f551-40b3-a316-22a9cb91d685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:49.684745 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 822/1652] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:49.693593 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76631c89-6e50-4a9f-8376-a3fe10e037f5 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:49.693934 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76631c89-6e50-4a9f-8376-a3fe10e037f5 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:49.694308 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76631c89-6e50-4a9f-8376-a3fe10e037f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:49.743953 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-76631c89-6e50-4a9f-8376-a3fe10e037f5 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:49.750198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-76631c89-6e50-4a9f-8376-a3fe10e037f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:49.757127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883af09-f551-40b3-a316-22a9cb91d685 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:49.758675 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2883af09-f551-40b3-a316-22a9cb91d685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:49.776622 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 831/1653] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:49.777628 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76631c89-6e50-4a9f-8376-a3fe10e037f5 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:49.801027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76631c89-6e50-4a9f-8376-a3fe10e037f5 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:49.812906 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc7ec5-8bff-4bbd-bee4-c7a2bc71112a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:49.813792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc7ec5-8bff-4bbd-bee4-c7a2bc71112a admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:49.814352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc7ec5-8bff-4bbd-bee4-c7a2bc71112a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:49.814689 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc7ec5-8bff-4bbd-bee4-c7a2bc71112a admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:49.815390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc7ec5-8bff-4bbd-bee4-c7a2bc71112a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:34:49.815746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc7ec5-8bff-4bbd-bee4-c7a2bc71112a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:49.835207 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc7ec5-8bff-4bbd-bee4-c7a2bc71112a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:49.874710 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 832/1654] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:34:49.879795 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc7ec5-8bff-4bbd-bee4-c7a2bc71112a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:49.887673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:49.912408 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc7ec5-8bff-4bbd-bee4-c7a2bc71112a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:49.927446 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6ecf9-b5f1-4044-b9e9-4f36ab0c7165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:49.928392 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6ecf9-b5f1-4044-b9e9-4f36ab0c7165 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:49.928947 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6ecf9-b5f1-4044-b9e9-4f36ab0c7165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:49.932398 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6ecf9-b5f1-4044-b9e9-4f36ab0c7165 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:49.933765 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6ecf9-b5f1-4044-b9e9-4f36ab0c7165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:49.937369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6ecf9-b5f1-4044-b9e9-4f36ab0c7165 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:50.008516 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883af09-f551-40b3-a316-22a9cb91d685 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:50.024546 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a1e42-e1f8-42e3-9524-0e9ce24337f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1880dab32fa424a9356b3fe940d4856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:50.026373 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a1e42-e1f8-42e3-9524-0e9ce24337f4 service placement] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:50.035894 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a1e42-e1f8-42e3-9524-0e9ce24337f4 service placement] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:50.036251 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a1e42-e1f8-42e3-9524-0e9ce24337f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:50.047498 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c04a1e42-e1f8-42e3-9524-0e9ce24337f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:50.092696 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a1e42-e1f8-42e3-9524-0e9ce24337f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:50.092696 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a1e42-e1f8-42e3-9524-0e9ce24337f4 service placement] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:50.145156 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 823/1655] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:34:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:34:50.181984 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 833/1656] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:34:49 2022] POST /identity/v3/projects => generated 403 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:50.186001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a1e42-e1f8-42e3-9524-0e9ce24337f4 service placement] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:50.223247 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a1e42-e1f8-42e3-9524-0e9ce24337f4 service placement] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:50.256622 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6ecf9-b5f1-4044-b9e9-4f36ab0c7165 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:50.259115 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d8b6ecf9-b5f1-4044-b9e9-4f36ab0c7165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:50.405494 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0632f-4269-4b98-8895-db888b687ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:50.405605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0632f-4269-4b98-8895-db888b687ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:50.405814 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0632f-4269-4b98-8895-db888b687ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:50.407658 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0632f-4269-4b98-8895-db888b687ab3 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:50.407871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:50.408131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0632f-4269-4b98-8895-db888b687ab3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:50.420768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0632f-4269-4b98-8895-db888b687ab3 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:50.465619 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6ecf9-b5f1-4044-b9e9-4f36ab0c7165 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:50.471052 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e964a-b084-480a-969e-8c608a698c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:50.471854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e964a-b084-480a-969e-8c608a698c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:50.472236 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e964a-b084-480a-969e-8c608a698c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:50.473257 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e964a-b084-480a-969e-8c608a698c1c admin admin] PATH_INFO: `/v3/users/656588cb9b354bbab81bff12e56f16cc` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:50.474602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e964a-b084-480a-969e-8c608a698c1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=656588cb9b354bbab81bff12e56f16cc)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:50.475863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: WARNING py.warnings [None req-8f1e964a-b084-480a-969e-8c608a698c1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 14:34:50.475863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: warnings.warn(msg) Sep 05 14:34:50.475863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: Sep 05 14:34:50.477876 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e964a-b084-480a-969e-8c608a698c1c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:50.588727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 824/1657] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:34:50 2022] POST /identity/v3/users => generated 302 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:50.595287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0632f-4269-4b98-8895-db888b687ab3 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:50.620210 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0632f-4269-4b98-8895-db888b687ab3 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:50.635188 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a68747-d5e2-4672-bc9d-fc0787889edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:50.636065 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a68747-d5e2-4672-bc9d-fc0787889edb admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:50.636485 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a68747-d5e2-4672-bc9d-fc0787889edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:50.636911 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a68747-d5e2-4672-bc9d-fc0787889edb admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:50.637750 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a68747-d5e2-4672-bc9d-fc0787889edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:50.639518 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a68747-d5e2-4672-bc9d-fc0787889edb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:50.664414 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 825/1658] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:34:50.665755 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a68747-d5e2-4672-bc9d-fc0787889edb admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:50.694825 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a68747-d5e2-4672-bc9d-fc0787889edb admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:50.705531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992cdc6-7380-46db-9f2d-e8ba28b76e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:50.706622 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992cdc6-7380-46db-9f2d-e8ba28b76e28 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:50.707183 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992cdc6-7380-46db-9f2d-e8ba28b76e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:50.707700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992cdc6-7380-46db-9f2d-e8ba28b76e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:50.708760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992cdc6-7380-46db-9f2d-e8ba28b76e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:50.718790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992cdc6-7380-46db-9f2d-e8ba28b76e28 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:50.753333 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 826/1659] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:50.757648 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992cdc6-7380-46db-9f2d-e8ba28b76e28 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:50.776188 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992cdc6-7380-46db-9f2d-e8ba28b76e28 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:50.800312 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407ba6c-caaf-40f8-a6cb-1b4b0c70451e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:50.809616 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407ba6c-caaf-40f8-a6cb-1b4b0c70451e admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:50.809946 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407ba6c-caaf-40f8-a6cb-1b4b0c70451e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:50.810227 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407ba6c-caaf-40f8-a6cb-1b4b0c70451e admin admin] PATH_INFO: `/v3/projects/b994edae305a49a984e24071da831eba/users/590a14c75c2743d0a3d62ed40183cec6/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:50.843349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407ba6c-caaf-40f8-a6cb-1b4b0c70451e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b994edae305a49a984e24071da831eba, user_id=590a14c75c2743d0a3d62ed40183cec6, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:50.846147 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407ba6c-caaf-40f8-a6cb-1b4b0c70451e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:50.939038 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-8f1e964a-b084-480a-969e-8c608a698c1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '656588cb9b354bbab81bff12e56f16cc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:51.021567 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 827/1660] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:34:50 2022] PUT /identity/v3/projects/b994edae305a49a984e24071da831eba/users/590a14c75c2743d0a3d62ed40183cec6/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:51.029015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcabe8-a846-4b97-b1d0-47f4c3efb8ee None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:51.029503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcabe8-a846-4b97-b1d0-47f4c3efb8ee None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:51.029939 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcabe8-a846-4b97-b1d0-47f4c3efb8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:51.067658 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7bbcabe8-a846-4b97-b1d0-47f4c3efb8ee None None] MFA Rules not processed for user `590a14c75c2743d0a3d62ed40183cec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:51.069415 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7bbcabe8-a846-4b97-b1d0-47f4c3efb8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:51.082559 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-8f1e964a-b084-480a-969e-8c608a698c1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '656588cb9b354bbab81bff12e56f16cc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:51.117608 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-8f1e964a-b084-480a-969e-8c608a698c1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '656588cb9b354bbab81bff12e56f16cc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:51.118595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-8f1e964a-b084-480a-969e-8c608a698c1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '656588cb9b354bbab81bff12e56f16cc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:51.133799 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-8f1e964a-b084-480a-969e-8c608a698c1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '656588cb9b354bbab81bff12e56f16cc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:51.149254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 834/1661] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:34:50 2022] DELETE /identity/v3/users/656588cb9b354bbab81bff12e56f16cc => generated 0 bytes in 890 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:34:51.149978 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:51.151028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcf71f-7913-43d0-9fa5-23fb601037ac None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:51.151654 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcf71f-7913-43d0-9fa5-23fb601037ac None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:51.151654 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcf71f-7913-43d0-9fa5-23fb601037ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:51.201416 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 828/1662] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:51 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:51.208760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcabe8-a846-4b97-b1d0-47f4c3efb8ee None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:51.210597 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7bbcabe8-a846-4b97-b1d0-47f4c3efb8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:51.231924 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-09bcf71f-7913-43d0-9fa5-23fb601037ac None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:51.244097 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-09bcf71f-7913-43d0-9fa5-23fb601037ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:51.382136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcabe8-a846-4b97-b1d0-47f4c3efb8ee None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:51.387953 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 835/1663] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:51.391909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4f57c-8830-4f31-8ad9-69f720c4056f None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:51.391909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4f57c-8830-4f31-8ad9-69f720c4056f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:51.391909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4f57c-8830-4f31-8ad9-69f720c4056f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:51.394642 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35d25e-8e91-4e2b-a93a-88f393fac52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:51.395387 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35d25e-8e91-4e2b-a93a-88f393fac52d admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:51.395735 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35d25e-8e91-4e2b-a93a-88f393fac52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:51.396070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35d25e-8e91-4e2b-a93a-88f393fac52d admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:51.396785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35d25e-8e91-4e2b-a93a-88f393fac52d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:51.399688 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35d25e-8e91-4e2b-a93a-88f393fac52d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:51.447133 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-46a4f57c-8830-4f31-8ad9-69f720c4056f None None] MFA Rules not processed for user `c74f8acfc15647f4b3606bc46fb16992`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:51.448373 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-46a4f57c-8830-4f31-8ad9-69f720c4056f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:51.571299 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 829/1664] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:34:51 2022] POST /identity/v3/projects => generated 405 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:51.572980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35d25e-8e91-4e2b-a93a-88f393fac52d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:51.580123 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-eb35d25e-8e91-4e2b-a93a-88f393fac52d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:51.605511 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 836/1665] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:51.606321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a4f57c-8830-4f31-8ad9-69f720c4056f None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:51.644369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a4f57c-8830-4f31-8ad9-69f720c4056f None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:51.763976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed6868-a51f-4d2c-ae21-d8bc88e0ff7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:51.766011 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed6868-a51f-4d2c-ae21-d8bc88e0ff7a admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:51.766467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed6868-a51f-4d2c-ae21-d8bc88e0ff7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:51.767864 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed6868-a51f-4d2c-ae21-d8bc88e0ff7a admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:51.768729 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed6868-a51f-4d2c-ae21-d8bc88e0ff7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:51.774197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed6868-a51f-4d2c-ae21-d8bc88e0ff7a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:51.828826 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35d25e-8e91-4e2b-a93a-88f393fac52d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:51.833842 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3c840-c34a-4e5d-a679-9a43102581c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:51.834825 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3c840-c34a-4e5d-a679-9a43102581c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:51.835301 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3c840-c34a-4e5d-a679-9a43102581c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:51.835779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3c840-c34a-4e5d-a679-9a43102581c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:51.847326 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3c840-c34a-4e5d-a679-9a43102581c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:51.849747 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3c840-c34a-4e5d-a679-9a43102581c4 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:51.861805 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 830/1666] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:34:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:34:51.863606 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3c840-c34a-4e5d-a679-9a43102581c4 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:51.865378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-36d3c840-c34a-4e5d-a679-9a43102581c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:51.965915 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 837/1667] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:34:51 2022] POST /identity/v3/users => generated 309 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:51.973376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed6868-a51f-4d2c-ae21-d8bc88e0ff7a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:52.035029 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed6868-a51f-4d2c-ae21-d8bc88e0ff7a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:52.049736 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6735f28-b4a6-413b-92f9-4b090b35c9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:52.051240 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6735f28-b4a6-413b-92f9-4b090b35c9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:52.051672 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6735f28-b4a6-413b-92f9-4b090b35c9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:52.052292 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6735f28-b4a6-413b-92f9-4b090b35c9e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:52.053769 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6735f28-b4a6-413b-92f9-4b090b35c9e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:52.058119 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6735f28-b4a6-413b-92f9-4b090b35c9e4 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:52.065210 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3c840-c34a-4e5d-a679-9a43102581c4 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:52.080051 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 838/1668] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:52.081278 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d1b8e-8b5e-4bdc-adca-4d28ccb08980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:52.083027 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d1b8e-8b5e-4bdc-adca-4d28ccb08980 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:52.083504 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126492f2-541b-4ff2-9532-144cb9147c14 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:52.083744 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d1b8e-8b5e-4bdc-adca-4d28ccb08980 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:52.083850 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126492f2-541b-4ff2-9532-144cb9147c14 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:52.084120 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126492f2-541b-4ff2-9532-144cb9147c14 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:52.084392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d1b8e-8b5e-4bdc-adca-4d28ccb08980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:52.091338 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 839/1669] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 5 14:34:52 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:34:52.092940 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126492f2-541b-4ff2-9532-144cb9147c14 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:52.135472 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126492f2-541b-4ff2-9532-144cb9147c14 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:52.150433 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f99fd1-45b6-4740-ba3a-044512c6685a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:52.151554 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f99fd1-45b6-4740-ba3a-044512c6685a admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:52.157592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f99fd1-45b6-4740-ba3a-044512c6685a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:52.157822 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f99fd1-45b6-4740-ba3a-044512c6685a admin admin] PATH_INFO: `/v3/projects/998d06dae9bd4f7d8bf59c5c8b6cc922/users/60b3458d8e444878bee4f90fa6024be5/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:52.175875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d1b8e-8b5e-4bdc-adca-4d28ccb08980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:52.178162 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d1b8e-8b5e-4bdc-adca-4d28ccb08980 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:52.197460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 831/1670] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:34:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:34:52.198770 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebd2b3-1bc3-4ca4-8877-2dc61a65df3e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:52.199176 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebd2b3-1bc3-4ca4-8877-2dc61a65df3e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:52.203892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebd2b3-1bc3-4ca4-8877-2dc61a65df3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:52.218964 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f99fd1-45b6-4740-ba3a-044512c6685a admin admin] RBAC: Authorizing `identity:create_grant(project_id=998d06dae9bd4f7d8bf59c5c8b6cc922, user_id=60b3458d8e444878bee4f90fa6024be5, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:52.221735 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f99fd1-45b6-4740-ba3a-044512c6685a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:52.256092 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-77ebd2b3-1bc3-4ca4-8877-2dc61a65df3e None None] MFA Rules not processed for user `c1880dab32fa424a9356b3fe940d4856`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:52.257439 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-77ebd2b3-1bc3-4ca4-8877-2dc61a65df3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:52.337607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 840/1671] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:34:52 2022] PUT /identity/v3/projects/998d06dae9bd4f7d8bf59c5c8b6cc922/users/60b3458d8e444878bee4f90fa6024be5/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:52.339644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f99fd1-45b6-4740-ba3a-044512c6685a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:52.345582 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d0f99fd1-45b6-4740-ba3a-044512c6685a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:52.357484 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 832/1672] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 5 14:34:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:52.359843 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebd2b3-1bc3-4ca4-8877-2dc61a65df3e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:52.372054 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebd2b3-1bc3-4ca4-8877-2dc61a65df3e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:52.474239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2d72b-9c19-46e6-95a8-faeb9975a75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:52.474893 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2d72b-9c19-46e6-95a8-faeb9975a75c admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:52.477317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2d72b-9c19-46e6-95a8-faeb9975a75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:52.479660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2d72b-9c19-46e6-95a8-faeb9975a75c admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:52.480373 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2d72b-9c19-46e6-95a8-faeb9975a75c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:52.482529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2d72b-9c19-46e6-95a8-faeb9975a75c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:52.504273 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 833/1673] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:52.504273 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2d72b-9c19-46e6-95a8-faeb9975a75c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:52.508944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9fb2d72b-9c19-46e6-95a8-faeb9975a75c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:52.535372 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f99fd1-45b6-4740-ba3a-044512c6685a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:52.549029 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12caf0-8db3-4da8-9ae2-8da0aed21dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:52.549029 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12caf0-8db3-4da8-9ae2-8da0aed21dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:52.549029 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12caf0-8db3-4da8-9ae2-8da0aed21dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:52.549029 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12caf0-8db3-4da8-9ae2-8da0aed21dae admin admin] PATH_INFO: `/v3/users/7c203bca504243ea80766eeccd171890` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:52.549326 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12caf0-8db3-4da8-9ae2-8da0aed21dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c203bca504243ea80766eeccd171890)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:52.551002 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12caf0-8db3-4da8-9ae2-8da0aed21dae admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:52.739931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2d72b-9c19-46e6-95a8-faeb9975a75c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:52.757711 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa6e5b-8b75-4491-8703-9e3f679428bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1880dab32fa424a9356b3fe940d4856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:52.758352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa6e5b-8b75-4491-8703-9e3f679428bd service placement] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:52.758636 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa6e5b-8b75-4491-8703-9e3f679428bd service placement] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:52.758907 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa6e5b-8b75-4491-8703-9e3f679428bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:52.772184 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa6e5b-8b75-4491-8703-9e3f679428bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:52.774982 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa6e5b-8b75-4491-8703-9e3f679428bd service placement] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:52.819295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:52.821709 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 834/1674] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:34:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:34:52.829090 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa6e5b-8b75-4491-8703-9e3f679428bd service placement] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:52.846962 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6a12caf0-8db3-4da8-9ae2-8da0aed21dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c203bca504243ea80766eeccd171890'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:52.866195 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa6e5b-8b75-4491-8703-9e3f679428bd service placement] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:52.882342 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcf9d8-82d6-45df-8034-59ec8cdc9120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:52.883031 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcf9d8-82d6-45df-8034-59ec8cdc9120 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:52.883313 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcf9d8-82d6-45df-8034-59ec8cdc9120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:52.883635 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcf9d8-82d6-45df-8034-59ec8cdc9120 admin admin] PATH_INFO: `/v3/projects/998d06dae9bd4f7d8bf59c5c8b6cc922/users/60b3458d8e444878bee4f90fa6024be5/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:52.887721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bcf9d8-82d6-45df-8034-59ec8cdc9120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=998d06dae9bd4f7d8bf59c5c8b6cc922, user_id=60b3458d8e444878bee4f90fa6024be5, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:52.896067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bcf9d8-82d6-45df-8034-59ec8cdc9120 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:52.929009 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 835/1675] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:34:52 2022] PUT /identity/v3/projects/998d06dae9bd4f7d8bf59c5c8b6cc922/users/60b3458d8e444878bee4f90fa6024be5/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:52.939589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efdc03-e867-475f-a9d5-b53d5d4810e2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:52.939875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efdc03-e867-475f-a9d5-b53d5d4810e2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:52.940304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efdc03-e867-475f-a9d5-b53d5d4810e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:52.973304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6a12caf0-8db3-4da8-9ae2-8da0aed21dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c203bca504243ea80766eeccd171890'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:53.034149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6a12caf0-8db3-4da8-9ae2-8da0aed21dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c203bca504243ea80766eeccd171890'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:53.036757 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6a12caf0-8db3-4da8-9ae2-8da0aed21dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c203bca504243ea80766eeccd171890'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:53.073387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6a12caf0-8db3-4da8-9ae2-8da0aed21dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c203bca504243ea80766eeccd171890'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:53.092327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 841/1676] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:34:52 2022] DELETE /identity/v3/users/7c203bca504243ea80766eeccd171890 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:53.097507 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-58efdc03-e867-475f-a9d5-b53d5d4810e2 None None] MFA Rules not processed for user `60b3458d8e444878bee4f90fa6024be5`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:53.099621 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-58efdc03-e867-475f-a9d5-b53d5d4810e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:53.114866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12caf0-8db3-4da8-9ae2-8da0aed21dae admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:53.116874 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6a12caf0-8db3-4da8-9ae2-8da0aed21dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:53.290452 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 836/1677] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:52 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:53.295258 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:53.315716 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efdc03-e867-475f-a9d5-b53d5d4810e2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:53.317834 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-58efdc03-e867-475f-a9d5-b53d5d4810e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:53.331453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12caf0-8db3-4da8-9ae2-8da0aed21dae admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:53.348748 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec227bd-ad9b-4638-97d2-535b747973b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:53.350275 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec227bd-ad9b-4638-97d2-535b747973b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:53.350700 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec227bd-ad9b-4638-97d2-535b747973b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:53.351118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec227bd-ad9b-4638-97d2-535b747973b2 admin admin] PATH_INFO: `/v3/projects/fa3684d0b02b402aabe4d053df18a96a` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:53.352823 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec227bd-ad9b-4638-97d2-535b747973b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa3684d0b02b402aabe4d053df18a96a)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:53.356572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec227bd-ad9b-4638-97d2-535b747973b2 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:53.465425 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efdc03-e867-475f-a9d5-b53d5d4810e2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:53.471282 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11b8b6-a6b4-4a25-9d76-27ca4ebac36c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:53.473206 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11b8b6-a6b4-4a25-9d76-27ca4ebac36c service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:53.473206 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11b8b6-a6b4-4a25-9d76-27ca4ebac36c service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:53.475494 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11b8b6-a6b4-4a25-9d76-27ca4ebac36c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:53.509221 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11b8b6-a6b4-4a25-9d76-27ca4ebac36c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:53.511709 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11b8b6-a6b4-4a25-9d76-27ca4ebac36c service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:53.525303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 837/1678] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:34:53 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:34:53.670178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-eec227bd-ad9b-4638-97d2-535b747973b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa3684d0b02b402aabe4d053df18a96a', 'request_id': 'req-eec227bd-ad9b-4638-97d2-535b747973b2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:53.713090 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-eec227bd-ad9b-4638-97d2-535b747973b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa3684d0b02b402aabe4d053df18a96a', 'request_id': 'req-eec227bd-ad9b-4638-97d2-535b747973b2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:53.827773 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-eec227bd-ad9b-4638-97d2-535b747973b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa3684d0b02b402aabe4d053df18a96a', 'request_id': 'req-eec227bd-ad9b-4638-97d2-535b747973b2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:53.844092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-eec227bd-ad9b-4638-97d2-535b747973b2 admin admin] The token cache is being invalidate because project fa3684d0b02b402aabe4d053df18a96a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:34:53.844443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-eec227bd-ad9b-4638-97d2-535b747973b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:53.845179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-eec227bd-ad9b-4638-97d2-535b747973b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:53.846952 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 842/1679] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:34:53 2022] DELETE /identity/v3/projects/fa3684d0b02b402aabe4d053df18a96a => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:53.856467 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9baf2-6d43-4816-9d74-96dd2044ac55 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:53.856786 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9baf2-6d43-4816-9d74-96dd2044ac55 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:53.857036 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9baf2-6d43-4816-9d74-96dd2044ac55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:53.881503 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec227bd-ad9b-4638-97d2-535b747973b2 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:53.886684 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-eec227bd-ad9b-4638-97d2-535b747973b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:53.911165 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-47a9baf2-6d43-4816-9d74-96dd2044ac55 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:53.912768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-47a9baf2-6d43-4816-9d74-96dd2044ac55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:54.050109 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec227bd-ad9b-4638-97d2-535b747973b2 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:54.058225 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c777a-3b54-4763-a830-98abbf879cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:54.059405 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c777a-3b54-4763-a830-98abbf879cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:54.059918 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c777a-3b54-4763-a830-98abbf879cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:54.061226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c777a-3b54-4763-a830-98abbf879cec admin admin] PATH_INFO: `/v3/users/590a14c75c2743d0a3d62ed40183cec6` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:54.062058 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c777a-3b54-4763-a830-98abbf879cec admin admin] RBAC: Authorizing `identity:delete_user(user_id=590a14c75c2743d0a3d62ed40183cec6)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:54.065217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c777a-3b54-4763-a830-98abbf879cec admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:54.074523 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 838/1680] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:54.084089 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c2ae8-13c0-4bf9-acb8-2450634d6c60 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:54.084585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c2ae8-13c0-4bf9-acb8-2450634d6c60 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:54.085000 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c2ae8-13c0-4bf9-acb8-2450634d6c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:54.110613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c28c2ae8-13c0-4bf9-acb8-2450634d6c60 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:54.112852 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c28c2ae8-13c0-4bf9-acb8-2450634d6c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:54.125821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 839/1681] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:54.130132 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c2ae8-13c0-4bf9-acb8-2450634d6c60 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:54.143602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c2ae8-13c0-4bf9-acb8-2450634d6c60 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:54.152998 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2168497-664a-4d75-bbae-11b0dd62b805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:54.155175 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2168497-664a-4d75-bbae-11b0dd62b805 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:54.156099 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2168497-664a-4d75-bbae-11b0dd62b805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:54.156473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2168497-664a-4d75-bbae-11b0dd62b805 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:54.158602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2168497-664a-4d75-bbae-11b0dd62b805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:34:54.159053 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2168497-664a-4d75-bbae-11b0dd62b805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:54.164065 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2168497-664a-4d75-bbae-11b0dd62b805 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:54.187947 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 840/1682] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:34:54.192902 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2168497-664a-4d75-bbae-11b0dd62b805 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:54.207458 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2168497-664a-4d75-bbae-11b0dd62b805 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:54.215354 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2200c-2231-4b3e-a46a-78889d63db72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:54.216489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2200c-2231-4b3e-a46a-78889d63db72 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:54.216906 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2200c-2231-4b3e-a46a-78889d63db72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:54.217356 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2200c-2231-4b3e-a46a-78889d63db72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:54.218320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2200c-2231-4b3e-a46a-78889d63db72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:54.221145 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2200c-2231-4b3e-a46a-78889d63db72 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:54.384494 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 841/1683] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:34:54 2022] POST /identity/v3/projects => generated 369 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:34:54.384494 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2200c-2231-4b3e-a46a-78889d63db72 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:54.391706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5ab2200c-2231-4b3e-a46a-78889d63db72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:54.405908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f82c777a-3b54-4763-a830-98abbf879cec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '590a14c75c2743d0a3d62ed40183cec6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:54.517839 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f82c777a-3b54-4763-a830-98abbf879cec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '590a14c75c2743d0a3d62ed40183cec6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:54.570466 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f82c777a-3b54-4763-a830-98abbf879cec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '590a14c75c2743d0a3d62ed40183cec6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:54.570466 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f82c777a-3b54-4763-a830-98abbf879cec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '590a14c75c2743d0a3d62ed40183cec6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:54.603973 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f82c777a-3b54-4763-a830-98abbf879cec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '590a14c75c2743d0a3d62ed40183cec6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:54.645979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 843/1684] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:34:53 2022] DELETE /identity/v3/users/590a14c75c2743d0a3d62ed40183cec6 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:54.647223 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c777a-3b54-4763-a830-98abbf879cec admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:54.649999 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f82c777a-3b54-4763-a830-98abbf879cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:54.656357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2200c-2231-4b3e-a46a-78889d63db72 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:54.670917 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:54.889925 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6543299-c504-4a09-bb92-17ebac60cf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:54.892791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6543299-c504-4a09-bb92-17ebac60cf2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:54.893199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6543299-c504-4a09-bb92-17ebac60cf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:54.895009 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6543299-c504-4a09-bb92-17ebac60cf2b admin admin] PATH_INFO: `/v3/projects/288b7d61600b406597ec10874d3811d7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:54.897205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6543299-c504-4a09-bb92-17ebac60cf2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=288b7d61600b406597ec10874d3811d7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:54.903131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-c6543299-c504-4a09-bb92-17ebac60cf2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 14:34:54.903131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: warnings.warn(msg) Sep 05 14:34:54.903131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: Sep 05 14:34:54.908984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6543299-c504-4a09-bb92-17ebac60cf2b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:54.947229 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c777a-3b54-4763-a830-98abbf879cec admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:54.977953 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ac076-d96c-45d0-a229-f30325f2d8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:54.978733 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ac076-d96c-45d0-a229-f30325f2d8be admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:54.979412 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ac076-d96c-45d0-a229-f30325f2d8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:54.979761 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ac076-d96c-45d0-a229-f30325f2d8be admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:54.980491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ac076-d96c-45d0-a229-f30325f2d8be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:54.995836 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ac076-d96c-45d0-a229-f30325f2d8be admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:55.153810 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 844/1685] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:34:54 2022] POST /identity/v3/users => generated 285 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:55.155217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa2d71-46a9-4c32-a4ff-7cb7bb900a98 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:55.155580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa2d71-46a9-4c32-a4ff-7cb7bb900a98 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:55.155929 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa2d71-46a9-4c32-a4ff-7cb7bb900a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:55.239632 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-defa2d71-46a9-4c32-a4ff-7cb7bb900a98 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:55.242819 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-defa2d71-46a9-4c32-a4ff-7cb7bb900a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:55.284678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c6543299-c504-4a09-bb92-17ebac60cf2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '288b7d61600b406597ec10874d3811d7', 'request_id': 'req-c6543299-c504-4a09-bb92-17ebac60cf2b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:55.304781 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c6543299-c504-4a09-bb92-17ebac60cf2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '288b7d61600b406597ec10874d3811d7', 'request_id': 'req-c6543299-c504-4a09-bb92-17ebac60cf2b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:55.337811 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 845/1686] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:55.337811 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa2d71-46a9-4c32-a4ff-7cb7bb900a98 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:55.358381 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa2d71-46a9-4c32-a4ff-7cb7bb900a98 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:55.370454 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d74746-b147-482f-bf30-e3e4aea31a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:55.374389 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d74746-b147-482f-bf30-e3e4aea31a6a admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:55.374870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d74746-b147-482f-bf30-e3e4aea31a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:55.375285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d74746-b147-482f-bf30-e3e4aea31a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:55.378610 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d74746-b147-482f-bf30-e3e4aea31a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:55.384670 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c6543299-c504-4a09-bb92-17ebac60cf2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '288b7d61600b406597ec10874d3811d7', 'request_id': 'req-c6543299-c504-4a09-bb92-17ebac60cf2b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:55.390789 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d74746-b147-482f-bf30-e3e4aea31a6a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:55.416759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 846/1687] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:55.418253 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c06c9a-c7a8-4623-ad15-deb5d14a68ad None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:55.422317 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c06c9a-c7a8-4623-ad15-deb5d14a68ad None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:55.422751 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c06c9a-c7a8-4623-ad15-deb5d14a68ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:55.426238 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c6543299-c504-4a09-bb92-17ebac60cf2b admin admin] The token cache is being invalidate because project 288b7d61600b406597ec10874d3811d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:34:55.426537 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c6543299-c504-4a09-bb92-17ebac60cf2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:55.428656 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c6543299-c504-4a09-bb92-17ebac60cf2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:55.435129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 842/1688] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:34:54 2022] DELETE /identity/v3/projects/288b7d61600b406597ec10874d3811d7 => generated 0 bytes in 1052 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:55.436403 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6543299-c504-4a09-bb92-17ebac60cf2b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:55.438376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c6543299-c504-4a09-bb92-17ebac60cf2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:55.488444 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:55.495390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-40c06c9a-c7a8-4623-ad15-deb5d14a68ad None None] MFA Rules not processed for user `0a11601da6724a97b4f5acc5b06b2811`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:55.496811 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-40c06c9a-c7a8-4623-ad15-deb5d14a68ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:55.557721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6543299-c504-4a09-bb92-17ebac60cf2b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:55.564480 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19345e8-3270-4861-b2de-517f4e06294d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:55.567649 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19345e8-3270-4861-b2de-517f4e06294d service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:55.568251 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19345e8-3270-4861-b2de-517f4e06294d service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:55.569131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19345e8-3270-4861-b2de-517f4e06294d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:55.574483 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d19345e8-3270-4861-b2de-517f4e06294d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:55.598987 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19345e8-3270-4861-b2de-517f4e06294d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:55.600924 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19345e8-3270-4861-b2de-517f4e06294d service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:55.619345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 843/1689] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:34:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:34:55.624188 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 847/1690] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:55.625226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c06c9a-c7a8-4623-ad15-deb5d14a68ad None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:55.626627 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19345e8-3270-4861-b2de-517f4e06294d service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:55.636268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-40c06c9a-c7a8-4623-ad15-deb5d14a68ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:55.637086 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d19345e8-3270-4861-b2de-517f4e06294d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:55.654560 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19345e8-3270-4861-b2de-517f4e06294d service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:55.681270 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:55.688012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b2301-bb6f-457f-8e19-f6015298519c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:55.688650 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b2301-bb6f-457f-8e19-f6015298519c admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:55.690373 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b2301-bb6f-457f-8e19-f6015298519c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:55.690655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b2301-bb6f-457f-8e19-f6015298519c admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:55.691549 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b2301-bb6f-457f-8e19-f6015298519c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:55.694229 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b2301-bb6f-457f-8e19-f6015298519c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:55.698815 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c06c9a-c7a8-4623-ad15-deb5d14a68ad None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:55.710002 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ad258-866f-44a8-aaf3-03268502752f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:55.711986 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ad258-866f-44a8-aaf3-03268502752f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:55.713125 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ad258-866f-44a8-aaf3-03268502752f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:55.713645 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ad258-866f-44a8-aaf3-03268502752f admin admin] PATH_INFO: `/v3/users/4ca30f546d24466bb5b4e1fb79df4739` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:55.716129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ad258-866f-44a8-aaf3-03268502752f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca30f546d24466bb5b4e1fb79df4739)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:55.723946 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 844/1691] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:55.724218 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ad258-866f-44a8-aaf3-03268502752f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:55.724448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab817d0f-d70e-4672-9d14-5683f0c2f1ab None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:55.724732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab817d0f-d70e-4672-9d14-5683f0c2f1ab None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:55.725003 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab817d0f-d70e-4672-9d14-5683f0c2f1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:55.776956 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ab817d0f-d70e-4672-9d14-5683f0c2f1ab None None] MFA Rules not processed for user `737c90cc21dc4da489d15d513dec5932`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:55.778851 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ab817d0f-d70e-4672-9d14-5683f0c2f1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:55.919430 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 845/1692] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:55.919430 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cabcd9-5a14-46d9-83a8-3a4087bf1552 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:55.919430 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cabcd9-5a14-46d9-83a8-3a4087bf1552 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:55.919430 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cabcd9-5a14-46d9-83a8-3a4087bf1552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:55.939728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-50cabcd9-5a14-46d9-83a8-3a4087bf1552 None None] MFA Rules not processed for user `0a11601da6724a97b4f5acc5b06b2811`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:55.941132 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-50cabcd9-5a14-46d9-83a8-3a4087bf1552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:55.948942 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 846/1693] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:55.949930 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cabcd9-5a14-46d9-83a8-3a4087bf1552 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:55.961305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cabcd9-5a14-46d9-83a8-3a4087bf1552 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:55.966106 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333170f-49d1-4232-81ce-1e0c9e8909ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:55.966768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333170f-49d1-4232-81ce-1e0c9e8909ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:55.967044 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333170f-49d1-4232-81ce-1e0c9e8909ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:55.967315 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333170f-49d1-4232-81ce-1e0c9e8909ec admin admin] PATH_INFO: `/v3/projects/654bddc048c443d7824b4d2383fd0949/users/eba66102773d4fdcbf0f8f0096fe9ea6/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:55.985157 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333170f-49d1-4232-81ce-1e0c9e8909ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=654bddc048c443d7824b4d2383fd0949, user_id=eba66102773d4fdcbf0f8f0096fe9ea6, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:55.987894 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333170f-49d1-4232-81ce-1e0c9e8909ec admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:56.099780 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 847/1694] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:34:55 2022] PUT /identity/v3/projects/654bddc048c443d7824b4d2383fd0949/users/eba66102773d4fdcbf0f8f0096fe9ea6/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:56.101145 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333170f-49d1-4232-81ce-1e0c9e8909ec admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:56.110358 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3333170f-49d1-4232-81ce-1e0c9e8909ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:56.111361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6e5ad258-866f-44a8-aaf3-03268502752f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca30f546d24466bb5b4e1fb79df4739'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:56.253883 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6e5ad258-866f-44a8-aaf3-03268502752f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca30f546d24466bb5b4e1fb79df4739'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:56.256606 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333170f-49d1-4232-81ce-1e0c9e8909ec admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:56.271841 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99066aab-5723-473c-957a-f02347c857e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:56.272508 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99066aab-5723-473c-957a-f02347c857e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:56.272793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99066aab-5723-473c-957a-f02347c857e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:56.273096 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99066aab-5723-473c-957a-f02347c857e4 admin admin] PATH_INFO: `/v3/users/672a9c1fc01a4f95835e9391bc1df036` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:56.274964 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99066aab-5723-473c-957a-f02347c857e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=672a9c1fc01a4f95835e9391bc1df036)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:56.276962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99066aab-5723-473c-957a-f02347c857e4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:56.279333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6e5ad258-866f-44a8-aaf3-03268502752f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca30f546d24466bb5b4e1fb79df4739'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:56.282254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6e5ad258-866f-44a8-aaf3-03268502752f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca30f546d24466bb5b4e1fb79df4739'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:56.301609 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6e5ad258-866f-44a8-aaf3-03268502752f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca30f546d24466bb5b4e1fb79df4739'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:56.324248 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 848/1695] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:34:55 2022] DELETE /identity/v3/users/4ca30f546d24466bb5b4e1fb79df4739 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:56.325909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1df29c-aa98-41d4-9df0-bbab09cfdb28 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:56.326209 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1df29c-aa98-41d4-9df0-bbab09cfdb28 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:56.327835 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1df29c-aa98-41d4-9df0-bbab09cfdb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:56.385045 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-2c1df29c-aa98-41d4-9df0-bbab09cfdb28 None None] MFA Rules not processed for user `737c90cc21dc4da489d15d513dec5932`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:56.394283 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2c1df29c-aa98-41d4-9df0-bbab09cfdb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:56.512163 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 849/1696] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:56.512163 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1df29c-aa98-41d4-9df0-bbab09cfdb28 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:56.512163 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2c1df29c-aa98-41d4-9df0-bbab09cfdb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:56.626254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1df29c-aa98-41d4-9df0-bbab09cfdb28 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:56.634124 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f20a67-81a0-498e-a4dd-20d712dacc42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:56.640450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f20a67-81a0-498e-a4dd-20d712dacc42 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:56.640450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f20a67-81a0-498e-a4dd-20d712dacc42 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:56.640450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f20a67-81a0-498e-a4dd-20d712dacc42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:56.640450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-04f20a67-81a0-498e-a4dd-20d712dacc42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:56.669346 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-99066aab-5723-473c-957a-f02347c857e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '672a9c1fc01a4f95835e9391bc1df036'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:56.669860 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-99066aab-5723-473c-957a-f02347c857e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '672a9c1fc01a4f95835e9391bc1df036'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:56.740741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f20a67-81a0-498e-a4dd-20d712dacc42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:56.740741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f20a67-81a0-498e-a4dd-20d712dacc42 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:56.740741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 850/1697] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:34:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:34:56.740741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f5cdf-8607-4ab6-8efb-da05dc84841f None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:56.740741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f5cdf-8607-4ab6-8efb-da05dc84841f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:56.740741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f5cdf-8607-4ab6-8efb-da05dc84841f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:56.760168 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-ef3f5cdf-8607-4ab6-8efb-da05dc84841f None None] MFA Rules not processed for user `eba66102773d4fdcbf0f8f0096fe9ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:56.761459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ef3f5cdf-8607-4ab6-8efb-da05dc84841f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:56.848472 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 851/1698] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:56.848472 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f5cdf-8607-4ab6-8efb-da05dc84841f None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:56.848472 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ef3f5cdf-8607-4ab6-8efb-da05dc84841f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:56.866607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f5cdf-8607-4ab6-8efb-da05dc84841f None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:56.874419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c164498-f37b-4b81-bb55-d1f0fde89d7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:56.875120 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c164498-f37b-4b81-bb55-d1f0fde89d7c service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:56.875404 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c164498-f37b-4b81-bb55-d1f0fde89d7c service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:56.886908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c164498-f37b-4b81-bb55-d1f0fde89d7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:56.886908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6c164498-f37b-4b81-bb55-d1f0fde89d7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:56.904975 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c164498-f37b-4b81-bb55-d1f0fde89d7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:56.906647 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c164498-f37b-4b81-bb55-d1f0fde89d7c service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:56.929773 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 852/1699] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:34:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:34:56.949934 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c164498-f37b-4b81-bb55-d1f0fde89d7c service nova] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:56.960858 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6c164498-f37b-4b81-bb55-d1f0fde89d7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:56.970502 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-99066aab-5723-473c-957a-f02347c857e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '672a9c1fc01a4f95835e9391bc1df036'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:57.000608 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-99066aab-5723-473c-957a-f02347c857e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '672a9c1fc01a4f95835e9391bc1df036'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:57.000608 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-99066aab-5723-473c-957a-f02347c857e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '672a9c1fc01a4f95835e9391bc1df036'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:57.027207 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 848/1700] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:34:56 2022] DELETE /identity/v3/users/672a9c1fc01a4f95835e9391bc1df036 => generated 0 bytes in 926 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:57.027926 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99066aab-5723-473c-957a-f02347c857e4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:57.029446 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-99066aab-5723-473c-957a-f02347c857e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:57.085921 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c164498-f37b-4b81-bb55-d1f0fde89d7c service nova] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:57.188085 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217ac64-690d-4588-9ec8-389a34676f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:57.188914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217ac64-690d-4588-9ec8-389a34676f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:57.189208 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217ac64-690d-4588-9ec8-389a34676f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:57.189491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217ac64-690d-4588-9ec8-389a34676f88 admin admin] PATH_INFO: `/v3/projects/b994edae305a49a984e24071da831eba` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:57.191312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217ac64-690d-4588-9ec8-389a34676f88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b994edae305a49a984e24071da831eba)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:57.193012 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217ac64-690d-4588-9ec8-389a34676f88 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:57.196233 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99066aab-5723-473c-957a-f02347c857e4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:57.204899 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ae981-ed75-47b2-a4d9-0781c96bbfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:57.207638 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ae981-ed75-47b2-a4d9-0781c96bbfc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:57.212174 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ae981-ed75-47b2-a4d9-0781c96bbfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:57.212174 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ae981-ed75-47b2-a4d9-0781c96bbfc0 admin admin] PATH_INFO: `/v3/projects/eb8286cb862c458cb441aae059e34169` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:57.212174 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ae981-ed75-47b2-a4d9-0781c96bbfc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb8286cb862c458cb441aae059e34169)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:57.212816 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ae981-ed75-47b2-a4d9-0781c96bbfc0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:57.491305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3c6ae981-ed75-47b2-a4d9-0781c96bbfc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb8286cb862c458cb441aae059e34169', 'request_id': 'req-3c6ae981-ed75-47b2-a4d9-0781c96bbfc0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:57.506181 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3c6ae981-ed75-47b2-a4d9-0781c96bbfc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb8286cb862c458cb441aae059e34169', 'request_id': 'req-3c6ae981-ed75-47b2-a4d9-0781c96bbfc0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:57.516613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6217ac64-690d-4588-9ec8-389a34676f88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b994edae305a49a984e24071da831eba', 'request_id': 'req-6217ac64-690d-4588-9ec8-389a34676f88'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:57.532979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6217ac64-690d-4588-9ec8-389a34676f88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b994edae305a49a984e24071da831eba', 'request_id': 'req-6217ac64-690d-4588-9ec8-389a34676f88'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:57.698072 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3c6ae981-ed75-47b2-a4d9-0781c96bbfc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb8286cb862c458cb441aae059e34169', 'request_id': 'req-3c6ae981-ed75-47b2-a4d9-0781c96bbfc0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:57.716982 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3c6ae981-ed75-47b2-a4d9-0781c96bbfc0 admin admin] The token cache is being invalidate because project eb8286cb862c458cb441aae059e34169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:34:57.717368 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3c6ae981-ed75-47b2-a4d9-0781c96bbfc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:57.718063 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3c6ae981-ed75-47b2-a4d9-0781c96bbfc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:57.723681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 849/1701] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:34:57 2022] DELETE /identity/v3/projects/eb8286cb862c458cb441aae059e34169 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:57.723681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ae981-ed75-47b2-a4d9-0781c96bbfc0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:57.723681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3c6ae981-ed75-47b2-a4d9-0781c96bbfc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:57.799333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6217ac64-690d-4588-9ec8-389a34676f88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b994edae305a49a984e24071da831eba', 'request_id': 'req-6217ac64-690d-4588-9ec8-389a34676f88'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:57.817311 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6217ac64-690d-4588-9ec8-389a34676f88 admin admin] The token cache is being invalidate because project b994edae305a49a984e24071da831eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:34:57.820504 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6217ac64-690d-4588-9ec8-389a34676f88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:57.822240 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6217ac64-690d-4588-9ec8-389a34676f88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:57.830215 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 853/1702] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:34:56 2022] DELETE /identity/v3/projects/b994edae305a49a984e24071da831eba => generated 0 bytes in 878 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:57.831395 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9650b-e655-4af4-bcdd-d2c4b196ccf9 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:57.833123 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9650b-e655-4af4-bcdd-d2c4b196ccf9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:57.833250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9650b-e655-4af4-bcdd-d2c4b196ccf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:57.875582 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ae981-ed75-47b2-a4d9-0781c96bbfc0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:57.876332 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-cdd9650b-e655-4af4-bcdd-d2c4b196ccf9 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:57.878641 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-cdd9650b-e655-4af4-bcdd-d2c4b196ccf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:58.005895 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f77334-b186-403a-a0df-0954a3e13138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:58.006507 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f77334-b186-403a-a0df-0954a3e13138 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:58.006797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f77334-b186-403a-a0df-0954a3e13138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:58.007076 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f77334-b186-403a-a0df-0954a3e13138 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:58.007785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f77334-b186-403a-a0df-0954a3e13138 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:58.011939 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f77334-b186-403a-a0df-0954a3e13138 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:58.017374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 854/1703] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:58.018937 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff759a-bbae-428c-858c-93bf395b877b None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:58.020071 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff759a-bbae-428c-858c-93bf395b877b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:58.020489 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff759a-bbae-428c-858c-93bf395b877b None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:58.034543 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 855/1704] 10.222.0.23 () {54 vars in 912 bytes} [Mon Sep 5 14:34:58 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:34:58.038186 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052af3e9-39c9-42e0-be6e-36942aff062e None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:58.038186 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052af3e9-39c9-42e0-be6e-36942aff062e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:58.038186 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052af3e9-39c9-42e0-be6e-36942aff062e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:58.075650 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-052af3e9-39c9-42e0-be6e-36942aff062e None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:58.078064 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-052af3e9-39c9-42e0-be6e-36942aff062e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:58.093820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 856/1705] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:58.094795 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052af3e9-39c9-42e0-be6e-36942aff062e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:58.096155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-052af3e9-39c9-42e0-be6e-36942aff062e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:58.128204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052af3e9-39c9-42e0-be6e-36942aff062e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:58.139146 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f53e7-f637-409f-aced-3ec2c86253e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:58.140555 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f53e7-f637-409f-aced-3ec2c86253e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:58.141171 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f53e7-f637-409f-aced-3ec2c86253e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:58.141632 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f53e7-f637-409f-aced-3ec2c86253e6 admin admin] PATH_INFO: `/v3/users/60b3458d8e444878bee4f90fa6024be5` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:58.143275 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f53e7-f637-409f-aced-3ec2c86253e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60b3458d8e444878bee4f90fa6024be5)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:58.146388 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f53e7-f637-409f-aced-3ec2c86253e6 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:58.166122 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 850/1706] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:34:57 2022] POST /identity/v3/projects => generated 369 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:58.167763 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974465d1-0ce2-488e-907a-9b5abd448563 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:58.168058 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974465d1-0ce2-488e-907a-9b5abd448563 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:58.168339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974465d1-0ce2-488e-907a-9b5abd448563 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:58.179286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 851/1707] 10.222.0.23 () {54 vars in 912 bytes} [Mon Sep 5 14:34:58 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:34:58.180289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974465d1-0ce2-488e-907a-9b5abd448563 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:58.183697 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-974465d1-0ce2-488e-907a-9b5abd448563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:58.287334 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974465d1-0ce2-488e-907a-9b5abd448563 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:58.293807 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924fe9dc-ce14-4be8-a87a-71bddf2d8219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:58.294449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fe9dc-ce14-4be8-a87a-71bddf2d8219 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:58.295448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fe9dc-ce14-4be8-a87a-71bddf2d8219 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:58.296002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fe9dc-ce14-4be8-a87a-71bddf2d8219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:58.405367 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-eb4f53e7-f637-409f-aced-3ec2c86253e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60b3458d8e444878bee4f90fa6024be5'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:58.430512 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924fe9dc-ce14-4be8-a87a-71bddf2d8219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:58.432015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924fe9dc-ce14-4be8-a87a-71bddf2d8219 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:58.453297 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 852/1708] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:34:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:34:58.453297 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd7673-2d9f-4caa-9b2f-e3f1904e074f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:58.453297 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd7673-2d9f-4caa-9b2f-e3f1904e074f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:58.453297 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd7673-2d9f-4caa-9b2f-e3f1904e074f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:58.511580 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8ebd7673-2d9f-4caa-9b2f-e3f1904e074f None None] MFA Rules not processed for user `b0ec118e5a114429b3e1c91041f7caf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:58.512848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8ebd7673-2d9f-4caa-9b2f-e3f1904e074f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:58.527219 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-eb4f53e7-f637-409f-aced-3ec2c86253e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60b3458d8e444878bee4f90fa6024be5'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:58.539337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 853/1709] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 5 14:34:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:58.539337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d884d-dec3-4f1c-86a6-88b802211cd3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:58.539337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d884d-dec3-4f1c-86a6-88b802211cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:58.539337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d884d-dec3-4f1c-86a6-88b802211cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:58.551114 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-eb4f53e7-f637-409f-aced-3ec2c86253e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60b3458d8e444878bee4f90fa6024be5'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:58.552144 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-eb4f53e7-f637-409f-aced-3ec2c86253e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60b3458d8e444878bee4f90fa6024be5'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:58.569534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-eb4f53e7-f637-409f-aced-3ec2c86253e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60b3458d8e444878bee4f90fa6024be5'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:58.573038 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:58.591809 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 857/1710] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:34:58 2022] DELETE /identity/v3/users/60b3458d8e444878bee4f90fa6024be5 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:58.592082 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f53e7-f637-409f-aced-3ec2c86253e6 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:58.596280 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-eb4f53e7-f637-409f-aced-3ec2c86253e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:58.653502 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7a2d884d-dec3-4f1c-86a6-88b802211cd3 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:58.653502 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7a2d884d-dec3-4f1c-86a6-88b802211cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:58.804709 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 854/1711] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:58.806188 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40812c71-7cc4-410f-a0eb-147e470644e3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:58.806477 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40812c71-7cc4-410f-a0eb-147e470644e3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:58.806753 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40812c71-7cc4-410f-a0eb-147e470644e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:58.836501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f53e7-f637-409f-aced-3ec2c86253e6 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:58.841124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-40812c71-7cc4-410f-a0eb-147e470644e3 None None] MFA Rules not processed for user `b0ec118e5a114429b3e1c91041f7caf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:58.842418 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-40812c71-7cc4-410f-a0eb-147e470644e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:58.852552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f3d90-1492-4f2f-9494-c982199496b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:58.853509 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f3d90-1492-4f2f-9494-c982199496b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:58.853871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f3d90-1492-4f2f-9494-c982199496b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:58.854363 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f3d90-1492-4f2f-9494-c982199496b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:58.855096 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f3d90-1492-4f2f-9494-c982199496b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:58.861231 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f3d90-1492-4f2f-9494-c982199496b9 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:58.955005 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 855/1712] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 5 14:34:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:58.956360 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40812c71-7cc4-410f-a0eb-147e470644e3 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:58.960239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-40812c71-7cc4-410f-a0eb-147e470644e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:58.980565 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 858/1713] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:34:58 2022] POST /identity/v3/users => generated 291 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:58.986260 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9affb37-f0b5-4b78-91f1-41fc64c5d2c1 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:58.986260 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9affb37-f0b5-4b78-91f1-41fc64c5d2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:58.986260 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9affb37-f0b5-4b78-91f1-41fc64c5d2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:58.986544 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40812c71-7cc4-410f-a0eb-147e470644e3 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:58.994174 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec5390-a880-4ef9-b92e-315685176d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:58.994866 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec5390-a880-4ef9-b92e-315685176d02 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:58.995149 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec5390-a880-4ef9-b92e-315685176d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:58.995425 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec5390-a880-4ef9-b92e-315685176d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:58.997424 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-dcec5390-a880-4ef9-b92e-315685176d02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:59.011128 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec5390-a880-4ef9-b92e-315685176d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:59.012992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec5390-a880-4ef9-b92e-315685176d02 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:59.029381 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 856/1714] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:34:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:34:59.034185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-a9affb37-f0b5-4b78-91f1-41fc64c5d2c1 None None] MFA Rules not processed for user `c74f8acfc15647f4b3606bc46fb16992`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:34:59.046111 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a9affb37-f0b5-4b78-91f1-41fc64c5d2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:59.047576 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec5390-a880-4ef9-b92e-315685176d02 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:59.081844 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec5390-a880-4ef9-b92e-315685176d02 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:59.093999 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c93161-ae42-4079-8051-e7ea610e4158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:59.094637 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c93161-ae42-4079-8051-e7ea610e4158 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:59.094921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c93161-ae42-4079-8051-e7ea610e4158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:59.095592 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c93161-ae42-4079-8051-e7ea610e4158 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:59.096012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c93161-ae42-4079-8051-e7ea610e4158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:34:59.096327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c93161-ae42-4079-8051-e7ea610e4158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:59.099761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c93161-ae42-4079-8051-e7ea610e4158 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:59.136618 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 857/1715] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:34:59.137754 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c93161-ae42-4079-8051-e7ea610e4158 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:59.169619 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c93161-ae42-4079-8051-e7ea610e4158 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:59.182000 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2caff3-d2c6-4d97-a912-68ff29792a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:59.182795 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2caff3-d2c6-4d97-a912-68ff29792a4a admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:59.183086 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2caff3-d2c6-4d97-a912-68ff29792a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:59.183389 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2caff3-d2c6-4d97-a912-68ff29792a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:59.184365 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2caff3-d2c6-4d97-a912-68ff29792a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:59.186516 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2caff3-d2c6-4d97-a912-68ff29792a4a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:59.200996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 858/1716] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:34:59.205336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2caff3-d2c6-4d97-a912-68ff29792a4a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:59.207972 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4d2caff3-d2c6-4d97-a912-68ff29792a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:59.227978 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2caff3-d2c6-4d97-a912-68ff29792a4a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:59.230017 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 859/1717] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:34:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:34:59.231510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9affb37-f0b5-4b78-91f1-41fc64c5d2c1 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:59.236515 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77bc9f-8abf-4314-842a-6bb2e2c15302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:59.237962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77bc9f-8abf-4314-842a-6bb2e2c15302 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:59.237962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77bc9f-8abf-4314-842a-6bb2e2c15302 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:59.237962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77bc9f-8abf-4314-842a-6bb2e2c15302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:59.247836 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9affb37-f0b5-4b78-91f1-41fc64c5d2c1 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:59.254994 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9725f-c8b4-4d41-a116-846ea5b4504d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:59.255910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9725f-c8b4-4d41-a116-846ea5b4504d admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:59.256330 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9725f-c8b4-4d41-a116-846ea5b4504d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:59.256754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9725f-c8b4-4d41-a116-846ea5b4504d admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:59.257771 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9725f-c8b4-4d41-a116-846ea5b4504d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:59.260735 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d77bc9f-8abf-4314-842a-6bb2e2c15302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:59.261463 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9725f-c8b4-4d41-a116-846ea5b4504d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:59.262853 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d77bc9f-8abf-4314-842a-6bb2e2c15302 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:59.274942 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 859/1718] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:34:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:34:59.276464 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77bc9f-8abf-4314-842a-6bb2e2c15302 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:59.306535 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77bc9f-8abf-4314-842a-6bb2e2c15302 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:59.315136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b6688-8c7f-496b-ae70-f60e2310a538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:59.315887 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b6688-8c7f-496b-ae70-f60e2310a538 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:59.316203 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b6688-8c7f-496b-ae70-f60e2310a538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:59.316597 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b6688-8c7f-496b-ae70-f60e2310a538 admin admin] PATH_INFO: `/v3/projects/6a1a1377c5174b668677f0dc0341fdc3/users/f6193083093a4cba9f4e6a45548ecae4/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:59.344957 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b6688-8c7f-496b-ae70-f60e2310a538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1a1377c5174b668677f0dc0341fdc3, user_id=f6193083093a4cba9f4e6a45548ecae4, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:59.349132 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b6688-8c7f-496b-ae70-f60e2310a538 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:59.426803 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 860/1719] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:34:59 2022] POST /identity/v3/projects => generated 367 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:59.428559 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9725f-c8b4-4d41-a116-846ea5b4504d admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:59.430565 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1bc9725f-c8b4-4d41-a116-846ea5b4504d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:59.465915 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 860/1720] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:34:59 2022] PUT /identity/v3/projects/6a1a1377c5174b668677f0dc0341fdc3/users/f6193083093a4cba9f4e6a45548ecae4/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:59.467005 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b6688-8c7f-496b-ae70-f60e2310a538 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:59.558859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b6688-8c7f-496b-ae70-f60e2310a538 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:59.559336 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9725f-c8b4-4d41-a116-846ea5b4504d admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:59.564701 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdbe41-fa1a-4619-ac6b-d9fb2b11d5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:59.565402 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdbe41-fa1a-4619-ac6b-d9fb2b11d5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:59.565737 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdbe41-fa1a-4619-ac6b-d9fb2b11d5af admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:59.566639 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdbe41-fa1a-4619-ac6b-d9fb2b11d5af admin admin] PATH_INFO: `/v3/projects/75aac1d849c04f139c63e244ec26b01c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:59.568330 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdbe41-fa1a-4619-ac6b-d9fb2b11d5af admin admin] RBAC: Authorizing `identity:delete_project(project_id=75aac1d849c04f139c63e244ec26b01c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:59.569152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f83ce-2854-461f-a34f-6fa954816099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:59.569827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdbe41-fa1a-4619-ac6b-d9fb2b11d5af admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:59.570402 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f83ce-2854-461f-a34f-6fa954816099 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:59.570930 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f83ce-2854-461f-a34f-6fa954816099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:59.571949 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f83ce-2854-461f-a34f-6fa954816099 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:59.572797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f83ce-2854-461f-a34f-6fa954816099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:59.575394 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f83ce-2854-461f-a34f-6fa954816099 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:59.719880 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 861/1721] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:34:59 2022] POST /identity/v3/users => generated 284 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:34:59.719880 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f83ce-2854-461f-a34f-6fa954816099 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:59.721189 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3f1f83ce-2854-461f-a34f-6fa954816099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:34:59.758675 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f83ce-2854-461f-a34f-6fa954816099 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:34:59.775747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-28fdbe41-fa1a-4619-ac6b-d9fb2b11d5af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75aac1d849c04f139c63e244ec26b01c', 'request_id': 'req-28fdbe41-fa1a-4619-ac6b-d9fb2b11d5af'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:59.783408 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-28fdbe41-fa1a-4619-ac6b-d9fb2b11d5af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75aac1d849c04f139c63e244ec26b01c', 'request_id': 'req-28fdbe41-fa1a-4619-ac6b-d9fb2b11d5af'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:59.836544 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98961889-7c5f-4cfe-860a-de09d2ba78e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:34:59.837294 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98961889-7c5f-4cfe-860a-de09d2ba78e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:34:59.837544 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98961889-7c5f-4cfe-860a-de09d2ba78e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:34:59.837814 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98961889-7c5f-4cfe-860a-de09d2ba78e8 admin admin] PATH_INFO: `/v3/projects/998d06dae9bd4f7d8bf59c5c8b6cc922` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:34:59.839693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98961889-7c5f-4cfe-860a-de09d2ba78e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=998d06dae9bd4f7d8bf59c5c8b6cc922)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:34:59.841893 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98961889-7c5f-4cfe-860a-de09d2ba78e8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:34:59.917486 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-28fdbe41-fa1a-4619-ac6b-d9fb2b11d5af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75aac1d849c04f139c63e244ec26b01c', 'request_id': 'req-28fdbe41-fa1a-4619-ac6b-d9fb2b11d5af'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:59.981102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-28fdbe41-fa1a-4619-ac6b-d9fb2b11d5af admin admin] The token cache is being invalidate because project 75aac1d849c04f139c63e244ec26b01c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:34:59.981642 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-28fdbe41-fa1a-4619-ac6b-d9fb2b11d5af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:59.985206 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-28fdbe41-fa1a-4619-ac6b-d9fb2b11d5af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:34:59.989097 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 861/1722] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:34:59 2022] DELETE /identity/v3/projects/75aac1d849c04f139c63e244ec26b01c => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:34:59.990148 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdbe41-fa1a-4619-ac6b-d9fb2b11d5af admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:34:59.998631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-28fdbe41-fa1a-4619-ac6b-d9fb2b11d5af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:00.021660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdbe41-fa1a-4619-ac6b-d9fb2b11d5af admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:00.050018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:00.051965 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966b337-5c28-47c6-9a99-73a8b3f8876b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:00.052592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966b337-5c28-47c6-9a99-73a8b3f8876b admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:00.052900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966b337-5c28-47c6-9a99-73a8b3f8876b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:00.053213 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966b337-5c28-47c6-9a99-73a8b3f8876b admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:00.054544 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966b337-5c28-47c6-9a99-73a8b3f8876b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:00.055606 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966b337-5c28-47c6-9a99-73a8b3f8876b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:00.070289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-98961889-7c5f-4cfe-860a-de09d2ba78e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '998d06dae9bd4f7d8bf59c5c8b6cc922', 'request_id': 'req-98961889-7c5f-4cfe-860a-de09d2ba78e8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:00.092305 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 862/1723] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:00.094393 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966b337-5c28-47c6-9a99-73a8b3f8876b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:00.099842 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6966b337-5c28-47c6-9a99-73a8b3f8876b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:00.105583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-98961889-7c5f-4cfe-860a-de09d2ba78e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '998d06dae9bd4f7d8bf59c5c8b6cc922', 'request_id': 'req-98961889-7c5f-4cfe-860a-de09d2ba78e8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:00.152860 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966b337-5c28-47c6-9a99-73a8b3f8876b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:00.220813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-98961889-7c5f-4cfe-860a-de09d2ba78e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '998d06dae9bd4f7d8bf59c5c8b6cc922', 'request_id': 'req-98961889-7c5f-4cfe-860a-de09d2ba78e8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:00.244810 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-98961889-7c5f-4cfe-860a-de09d2ba78e8 admin admin] The token cache is being invalidate because project 998d06dae9bd4f7d8bf59c5c8b6cc922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:00.245154 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-98961889-7c5f-4cfe-860a-de09d2ba78e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:00.250331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-98961889-7c5f-4cfe-860a-de09d2ba78e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:00.257183 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 862/1724] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:34:59 2022] DELETE /identity/v3/projects/998d06dae9bd4f7d8bf59c5c8b6cc922 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:00.258777 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd25b7-0ab8-481b-85f0-e746acccaac4 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:00.259236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd25b7-0ab8-481b-85f0-e746acccaac4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:00.259655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd25b7-0ab8-481b-85f0-e746acccaac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:00.309757 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839f2b7-85fd-4962-b014-e024cb881e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:00.310634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839f2b7-85fd-4962-b014-e024cb881e4c admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:00.311113 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839f2b7-85fd-4962-b014-e024cb881e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:00.311530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839f2b7-85fd-4962-b014-e024cb881e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:00.312325 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839f2b7-85fd-4962-b014-e024cb881e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:00.314371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ccbd25b7-0ab8-481b-85f0-e746acccaac4 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:00.315250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839f2b7-85fd-4962-b014-e024cb881e4c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:00.315629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ccbd25b7-0ab8-481b-85f0-e746acccaac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:00.331956 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 863/1725] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:00.337009 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 863/1726] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:00.338167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd25b7-0ab8-481b-85f0-e746acccaac4 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:00.341050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839f2b7-85fd-4962-b014-e024cb881e4c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:00.343857 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ccbd25b7-0ab8-481b-85f0-e746acccaac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:00.343972 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e839f2b7-85fd-4962-b014-e024cb881e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:00.369233 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd25b7-0ab8-481b-85f0-e746acccaac4 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:00.382933 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d1dcc-02d0-4d19-902e-4f5e003f2835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:00.383951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d1dcc-02d0-4d19-902e-4f5e003f2835 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:00.384406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d1dcc-02d0-4d19-902e-4f5e003f2835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:00.384978 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d1dcc-02d0-4d19-902e-4f5e003f2835 admin admin] PATH_INFO: `/v3/projects/6a1a1377c5174b668677f0dc0341fdc3/users/f6193083093a4cba9f4e6a45548ecae4/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:00.388151 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d1dcc-02d0-4d19-902e-4f5e003f2835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1a1377c5174b668677f0dc0341fdc3, user_id=f6193083093a4cba9f4e6a45548ecae4, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:00.394771 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d1dcc-02d0-4d19-902e-4f5e003f2835 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:00.459121 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 864/1727] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:00 2022] PUT /identity/v3/projects/6a1a1377c5174b668677f0dc0341fdc3/users/f6193083093a4cba9f4e6a45548ecae4/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:00.462850 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a9737-73ec-4a92-9bb0-be3ad1c3d5ce None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:00.463076 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a9737-73ec-4a92-9bb0-be3ad1c3d5ce None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:00.467515 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a9737-73ec-4a92-9bb0-be3ad1c3d5ce None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:00.473320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 865/1728] 10.222.0.23 () {54 vars in 961 bytes} [Mon Sep 5 14:35:00 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:35:00.474936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc82f6-4f34-4c6d-b9b0-6f1b9e327c5b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:00.476388 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc82f6-4f34-4c6d-b9b0-6f1b9e327c5b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:00.478280 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc82f6-4f34-4c6d-b9b0-6f1b9e327c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:00.499958 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839f2b7-85fd-4962-b014-e024cb881e4c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:00.524145 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-63fc82f6-4f34-4c6d-b9b0-6f1b9e327c5b None None] MFA Rules not processed for user `0a11601da6724a97b4f5acc5b06b2811`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:00.525317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-63fc82f6-4f34-4c6d-b9b0-6f1b9e327c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:00.591408 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e6730-927b-4d32-9327-ed2018b7ee9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1880dab32fa424a9356b3fe940d4856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:00.592037 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e6730-927b-4d32-9327-ed2018b7ee9d service placement] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:00.592323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e6730-927b-4d32-9327-ed2018b7ee9d service placement] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:00.592980 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e6730-927b-4d32-9327-ed2018b7ee9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:00.594983 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2b9e6730-927b-4d32-9327-ed2018b7ee9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:00.629197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e6730-927b-4d32-9327-ed2018b7ee9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:00.633931 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e6730-927b-4d32-9327-ed2018b7ee9d service placement] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:00.647189 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 866/1729] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:00.648588 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093a3bc-7c88-479b-b9e7-52986b8a361b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:00.648878 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093a3bc-7c88-479b-b9e7-52986b8a361b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:00.649404 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093a3bc-7c88-479b-b9e7-52986b8a361b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:00.667432 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 864/1730] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:00.668631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e6730-927b-4d32-9327-ed2018b7ee9d service placement] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:00.677219 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2b9e6730-927b-4d32-9327-ed2018b7ee9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:00.713621 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b093a3bc-7c88-479b-b9e7-52986b8a361b None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:00.717309 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b093a3bc-7c88-479b-b9e7-52986b8a361b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:00.876375 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e6730-927b-4d32-9327-ed2018b7ee9d service placement] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:00.887721 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaad6bb-9ba0-4cd8-8cb2-e99f2dce49cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:00.889176 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaad6bb-9ba0-4cd8-8cb2-e99f2dce49cf admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:00.889332 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaad6bb-9ba0-4cd8-8cb2-e99f2dce49cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:00.889716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaad6bb-9ba0-4cd8-8cb2-e99f2dce49cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:00.890947 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaad6bb-9ba0-4cd8-8cb2-e99f2dce49cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:00.898640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaad6bb-9ba0-4cd8-8cb2-e99f2dce49cf admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:00.902082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 867/1731] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:00.904221 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4adf35-f038-4ddb-b55b-9b2778c9f7e7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:00.906486 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4adf35-f038-4ddb-b55b-9b2778c9f7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:00.906843 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4adf35-f038-4ddb-b55b-9b2778c9f7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:00.925480 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 865/1732] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:00.925480 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e09bfd-301c-49de-beb9-69b2d141efe9 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:00.926339 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e09bfd-301c-49de-beb9-69b2d141efe9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:00.926659 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e09bfd-301c-49de-beb9-69b2d141efe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:00.959068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-08e09bfd-301c-49de-beb9-69b2d141efe9 None None] MFA Rules not processed for user `f6193083093a4cba9f4e6a45548ecae4`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:00.960339 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-08e09bfd-301c-49de-beb9-69b2d141efe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:01.006358 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6c4adf35-f038-4ddb-b55b-9b2778c9f7e7 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:01.007637 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6c4adf35-f038-4ddb-b55b-9b2778c9f7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:01.038770 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 868/1733] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:01.038770 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256c37c-c2f8-4e0b-b4f6-574179f732b4 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:01.038770 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256c37c-c2f8-4e0b-b4f6-574179f732b4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:01.038770 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256c37c-c2f8-4e0b-b4f6-574179f732b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:01.084085 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e256c37c-c2f8-4e0b-b4f6-574179f732b4 None None] MFA Rules not processed for user `c1880dab32fa424a9356b3fe940d4856`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:01.085442 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e256c37c-c2f8-4e0b-b4f6-574179f732b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:01.109313 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 869/1734] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Sep 5 14:35:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:01.111313 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736e8c0-9b95-4f93-a760-4108354e7d5f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:01.111764 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736e8c0-9b95-4f93-a760-4108354e7d5f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:01.112188 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736e8c0-9b95-4f93-a760-4108354e7d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:01.141001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9736e8c0-9b95-4f93-a760-4108354e7d5f None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:01.143371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9736e8c0-9b95-4f93-a760-4108354e7d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:01.151577 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 866/1735] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:01.152369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e09bfd-301c-49de-beb9-69b2d141efe9 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:01.153561 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:01.157313 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 870/1736] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:01.157831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736e8c0-9b95-4f93-a760-4108354e7d5f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:01.172529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736e8c0-9b95-4f93-a760-4108354e7d5f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:01.173114 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e09bfd-301c-49de-beb9-69b2d141efe9 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:01.186010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb9ede-bc5d-4559-80ce-c8504096e91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:01.197351 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb9ede-bc5d-4559-80ce-c8504096e91f admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:01.197351 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb9ede-bc5d-4559-80ce-c8504096e91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:01.197351 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb9ede-bc5d-4559-80ce-c8504096e91f admin admin] PATH_INFO: `/v3/projects/2b2b47b6870c4fb798011194f0dd1085/users/c58e02529e6f40aa91cd0fc18eaa0464/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:01.207439 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7a3af-f4b8-47e4-9d76-3e4d3b3579ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:01.207994 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7a3af-f4b8-47e4-9d76-3e4d3b3579ca admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:01.208890 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7a3af-f4b8-47e4-9d76-3e4d3b3579ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:01.208890 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7a3af-f4b8-47e4-9d76-3e4d3b3579ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:01.209440 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7a3af-f4b8-47e4-9d76-3e4d3b3579ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:35:01.209758 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7a3af-f4b8-47e4-9d76-3e4d3b3579ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:01.231415 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7a3af-f4b8-47e4-9d76-3e4d3b3579ca admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:01.246549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb9ede-bc5d-4559-80ce-c8504096e91f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b2b47b6870c4fb798011194f0dd1085, user_id=c58e02529e6f40aa91cd0fc18eaa0464, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:01.249652 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb9ede-bc5d-4559-80ce-c8504096e91f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:01.265858 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 871/1737] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:35:01.266745 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7a3af-f4b8-47e4-9d76-3e4d3b3579ca admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:01.285974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7a3af-f4b8-47e4-9d76-3e4d3b3579ca admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:01.296630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd69a80-d1d5-4708-9c85-1bb28b7857a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1880dab32fa424a9356b3fe940d4856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:01.298548 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd69a80-d1d5-4708-9c85-1bb28b7857a7 service placement] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:01.299501 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd69a80-d1d5-4708-9c85-1bb28b7857a7 service placement] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:01.301278 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd69a80-d1d5-4708-9c85-1bb28b7857a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:01.315007 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd69a80-d1d5-4708-9c85-1bb28b7857a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:01.316925 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd69a80-d1d5-4708-9c85-1bb28b7857a7 service placement] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:01.345196 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 872/1738] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:01.346599 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd69a80-d1d5-4708-9c85-1bb28b7857a7 service placement] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:01.352899 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1dd69a80-d1d5-4708-9c85-1bb28b7857a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:01.395813 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 867/1739] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:01 2022] PUT /identity/v3/projects/2b2b47b6870c4fb798011194f0dd1085/users/c58e02529e6f40aa91cd0fc18eaa0464/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:01.395813 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb9ede-bc5d-4559-80ce-c8504096e91f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:01.516211 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb9ede-bc5d-4559-80ce-c8504096e91f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:01.521558 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd69a80-d1d5-4708-9c85-1bb28b7857a7 service placement] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:01.524637 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa5ad4-2938-4dab-a053-2a9c5869f8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:01.525526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa5ad4-2938-4dab-a053-2a9c5869f8bb admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:01.525901 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa5ad4-2938-4dab-a053-2a9c5869f8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:01.526088 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa5ad4-2938-4dab-a053-2a9c5869f8bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:01.526738 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa5ad4-2938-4dab-a053-2a9c5869f8bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:35:01.527044 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa5ad4-2938-4dab-a053-2a9c5869f8bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:01.528723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa5ad4-2938-4dab-a053-2a9c5869f8bb admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:01.583590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 868/1740] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:35:01.583590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa5ad4-2938-4dab-a053-2a9c5869f8bb admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:01.614802 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa5ad4-2938-4dab-a053-2a9c5869f8bb admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:01.620670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8b64c-02bb-4655-9e0a-1b6fac30b979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:01.621330 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8b64c-02bb-4655-9e0a-1b6fac30b979 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:01.621612 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8b64c-02bb-4655-9e0a-1b6fac30b979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:01.621892 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8b64c-02bb-4655-9e0a-1b6fac30b979 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:01.622836 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8b64c-02bb-4655-9e0a-1b6fac30b979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:01.624837 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8b64c-02bb-4655-9e0a-1b6fac30b979 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:01.681573 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eede71-38cc-4631-b326-b261dd3e5373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:01.682226 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eede71-38cc-4631-b326-b261dd3e5373 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:01.682525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eede71-38cc-4631-b326-b261dd3e5373 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:01.682757 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eede71-38cc-4631-b326-b261dd3e5373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:01.740543 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 869/1741] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:01 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:01.742150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2f046-2c91-40ce-b386-04b9b719dede None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:01.743323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2f046-2c91-40ce-b386-04b9b719dede None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:01.745183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2f046-2c91-40ce-b386-04b9b719dede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:01.869413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-9be2f046-2c91-40ce-b386-04b9b719dede None None] MFA Rules not processed for user `c58e02529e6f40aa91cd0fc18eaa0464`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:01.869413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9be2f046-2c91-40ce-b386-04b9b719dede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:01.904297 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eede71-38cc-4631-b326-b261dd3e5373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:01.904297 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eede71-38cc-4631-b326-b261dd3e5373 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:01.955755 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 873/1742] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:01.962315 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eede71-38cc-4631-b326-b261dd3e5373 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:02.057776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eede71-38cc-4631-b326-b261dd3e5373 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:02.119997 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 870/1743] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:02.123319 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2f046-2c91-40ce-b386-04b9b719dede None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:02.226192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89ced4-64a6-4b8a-b8a2-203f6d48b08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:02.241033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89ced4-64a6-4b8a-b8a2-203f6d48b08b admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:02.241033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89ced4-64a6-4b8a-b8a2-203f6d48b08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:02.241033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a89ced4-64a6-4b8a-b8a2-203f6d48b08b admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:02.241033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89ced4-64a6-4b8a-b8a2-203f6d48b08b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:02.241033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a89ced4-64a6-4b8a-b8a2-203f6d48b08b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:02.267256 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2f046-2c91-40ce-b386-04b9b719dede None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:02.273725 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329c2af-65e2-49f0-9edc-e11c5876ab33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:02.274713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329c2af-65e2-49f0-9edc-e11c5876ab33 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:02.275016 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329c2af-65e2-49f0-9edc-e11c5876ab33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:02.275290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329c2af-65e2-49f0-9edc-e11c5876ab33 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:02.276437 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329c2af-65e2-49f0-9edc-e11c5876ab33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:02.278646 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329c2af-65e2-49f0-9edc-e11c5876ab33 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:02.379124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 874/1744] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:01 2022] POST /identity/v3/projects => generated 377 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:02.380809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89ced4-64a6-4b8a-b8a2-203f6d48b08b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:02.413027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:02.433235 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 871/1745] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:02 2022] POST /identity/v3/users => generated 291 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:02.433235 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329c2af-65e2-49f0-9edc-e11c5876ab33 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:02.491071 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a89ced4-64a6-4b8a-b8a2-203f6d48b08b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:02.492986 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329c2af-65e2-49f0-9edc-e11c5876ab33 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:02.496974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd14bdc-43f7-4ae1-b221-7aef2e745c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:02.497623 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd14bdc-43f7-4ae1-b221-7aef2e745c01 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:02.497904 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd14bdc-43f7-4ae1-b221-7aef2e745c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:02.498182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd14bdc-43f7-4ae1-b221-7aef2e745c01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:02.498823 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd14bdc-43f7-4ae1-b221-7aef2e745c01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:02.500729 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd14bdc-43f7-4ae1-b221-7aef2e745c01 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:02.555362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148e29d-9bd6-4bc4-abe8-64a519f463ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:02.556117 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148e29d-9bd6-4bc4-abe8-64a519f463ca service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:02.556462 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148e29d-9bd6-4bc4-abe8-64a519f463ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:02.556793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148e29d-9bd6-4bc4-abe8-64a519f463ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:02.558816 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4148e29d-9bd6-4bc4-abe8-64a519f463ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:02.671534 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 875/1746] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:02 2022] POST /identity/v3/projects => generated 367 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:02.672792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd14bdc-43f7-4ae1-b221-7aef2e745c01 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:02.704898 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148e29d-9bd6-4bc4-abe8-64a519f463ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:02.707661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148e29d-9bd6-4bc4-abe8-64a519f463ca service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:02.721953 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 872/1747] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:02.723288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148e29d-9bd6-4bc4-abe8-64a519f463ca service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:02.740741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148e29d-9bd6-4bc4-abe8-64a519f463ca service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:02.802963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd14bdc-43f7-4ae1-b221-7aef2e745c01 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:02.818383 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376e611-70f5-41e3-8ca8-878fec233378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:02.820962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376e611-70f5-41e3-8ca8-878fec233378 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:02.823008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376e611-70f5-41e3-8ca8-878fec233378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:02.823444 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376e611-70f5-41e3-8ca8-878fec233378 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:02.825200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376e611-70f5-41e3-8ca8-878fec233378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:02.827864 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8245e6-92a5-439d-a55c-c9e4d25223a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:02.828765 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8245e6-92a5-439d-a55c-c9e4d25223a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:02.830407 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8245e6-92a5-439d-a55c-c9e4d25223a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:02.830407 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8245e6-92a5-439d-a55c-c9e4d25223a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:02.830631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376e611-70f5-41e3-8ca8-878fec233378 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:02.833127 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8245e6-92a5-439d-a55c-c9e4d25223a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:02.834873 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8245e6-92a5-439d-a55c-c9e4d25223a5 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:02.862244 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 873/1748] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:02.863551 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8245e6-92a5-439d-a55c-c9e4d25223a5 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:02.880909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8245e6-92a5-439d-a55c-c9e4d25223a5 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:02.898806 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb86fb-f9a9-41a8-b1e2-56f31a07192f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:02.901683 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb86fb-f9a9-41a8-b1e2-56f31a07192f admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:02.902193 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb86fb-f9a9-41a8-b1e2-56f31a07192f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:02.902485 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb86fb-f9a9-41a8-b1e2-56f31a07192f admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:02.905389 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb86fb-f9a9-41a8-b1e2-56f31a07192f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:02.910174 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb86fb-f9a9-41a8-b1e2-56f31a07192f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:02.941469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 876/1749] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:02 2022] POST /identity/v3/users => generated 289 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:02.942725 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376e611-70f5-41e3-8ca8-878fec233378 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:02.970235 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376e611-70f5-41e3-8ca8-878fec233378 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:02.982708 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48b62b-8811-46f0-97e9-b61e5fc04d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:02.983411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48b62b-8811-46f0-97e9-b61e5fc04d07 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:02.983575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48b62b-8811-46f0-97e9-b61e5fc04d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:02.983893 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48b62b-8811-46f0-97e9-b61e5fc04d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:02.984546 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48b62b-8811-46f0-97e9-b61e5fc04d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:02.987252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48b62b-8811-46f0-97e9-b61e5fc04d07 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:03.009519 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 877/1750] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:03.009519 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48b62b-8811-46f0-97e9-b61e5fc04d07 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:03.020384 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48b62b-8811-46f0-97e9-b61e5fc04d07 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:03.024270 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0055dac-3525-4efa-86a5-44be2a4a453d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:03.024890 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0055dac-3525-4efa-86a5-44be2a4a453d admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:03.025344 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0055dac-3525-4efa-86a5-44be2a4a453d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:03.025662 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0055dac-3525-4efa-86a5-44be2a4a453d admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:03.026243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0055dac-3525-4efa-86a5-44be2a4a453d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:03.027807 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0055dac-3525-4efa-86a5-44be2a4a453d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:03.041084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 878/1751] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:03.041084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0055dac-3525-4efa-86a5-44be2a4a453d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:03.055329 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 874/1752] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:02 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:03.056836 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb86fb-f9a9-41a8-b1e2-56f31a07192f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:03.072428 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb86fb-f9a9-41a8-b1e2-56f31a07192f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:03.073079 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0055dac-3525-4efa-86a5-44be2a4a453d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:03.078426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7fd72-3e55-4c76-ab15-8732b9a91fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:03.079157 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7fd72-3e55-4c76-ab15-8732b9a91fae admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:03.079441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7fd72-3e55-4c76-ab15-8732b9a91fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:03.079762 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7fd72-3e55-4c76-ab15-8732b9a91fae admin admin] PATH_INFO: `/v3/projects/ad2d0863809349c6982151d67b390613/users/b63040a3e42e43568ea27d12f9a15322/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:03.081578 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5423d-b042-4f09-b492-e9fdfd62999b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:03.082471 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5423d-b042-4f09-b492-e9fdfd62999b admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:03.083289 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5423d-b042-4f09-b492-e9fdfd62999b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:03.085279 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5423d-b042-4f09-b492-e9fdfd62999b admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:03.086164 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5423d-b042-4f09-b492-e9fdfd62999b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:03.089162 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5423d-b042-4f09-b492-e9fdfd62999b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:03.103003 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7fd72-3e55-4c76-ab15-8732b9a91fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad2d0863809349c6982151d67b390613, user_id=b63040a3e42e43568ea27d12f9a15322, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:03.105833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7fd72-3e55-4c76-ab15-8732b9a91fae admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:03.109184 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 875/1753] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:03.109184 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5423d-b042-4f09-b492-e9fdfd62999b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:03.123009 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5423d-b042-4f09-b492-e9fdfd62999b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:03.127857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdee60-c732-4266-b9d8-ec5d41c9fe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:03.129968 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdee60-c732-4266-b9d8-ec5d41c9fe6b admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:03.130318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdee60-c732-4266-b9d8-ec5d41c9fe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:03.130696 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdee60-c732-4266-b9d8-ec5d41c9fe6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:03.131564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdee60-c732-4266-b9d8-ec5d41c9fe6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:03.133337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdee60-c732-4266-b9d8-ec5d41c9fe6b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:03.147860 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 876/1754] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:03.147860 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdee60-c732-4266-b9d8-ec5d41c9fe6b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:03.162920 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdee60-c732-4266-b9d8-ec5d41c9fe6b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:03.196880 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b5d3d-9849-4caf-bb9d-eae4f06a31ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:03.198058 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b5d3d-9849-4caf-bb9d-eae4f06a31ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:03.203269 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b5d3d-9849-4caf-bb9d-eae4f06a31ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:03.203269 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b5d3d-9849-4caf-bb9d-eae4f06a31ac admin admin] PATH_INFO: `/v3/projects/cfa814cc45a84ddc9106628d4de2acc9/users/6d8d42699562417c97306525d75d470d/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:03.215469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 879/1755] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:03 2022] PUT /identity/v3/projects/ad2d0863809349c6982151d67b390613/users/b63040a3e42e43568ea27d12f9a15322/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:03.217280 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7fd72-3e55-4c76-ab15-8732b9a91fae admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:03.248973 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b5d3d-9849-4caf-bb9d-eae4f06a31ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa814cc45a84ddc9106628d4de2acc9, user_id=6d8d42699562417c97306525d75d470d, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:03.255121 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b5d3d-9849-4caf-bb9d-eae4f06a31ac admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:03.317713 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7fd72-3e55-4c76-ab15-8732b9a91fae admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:03.322566 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2078bed-f657-457f-b233-469577085a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:03.323193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2078bed-f657-457f-b233-469577085a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:03.323453 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2078bed-f657-457f-b233-469577085a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:03.323730 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2078bed-f657-457f-b233-469577085a50 admin admin] PATH_INFO: `/v3/projects/72abe8bf64b44a5a8f2b12f0aef11401/users/eddd622920bf49d49cefa39b8d347bbd/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:03.338779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2078bed-f657-457f-b233-469577085a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72abe8bf64b44a5a8f2b12f0aef11401, user_id=eddd622920bf49d49cefa39b8d347bbd, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:03.341871 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2078bed-f657-457f-b233-469577085a50 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:03.410263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 877/1756] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:03 2022] PUT /identity/v3/projects/cfa814cc45a84ddc9106628d4de2acc9/users/6d8d42699562417c97306525d75d470d/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:03.411754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92573d-b146-44f4-8282-2bff7e651886 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:03.412056 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92573d-b146-44f4-8282-2bff7e651886 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:03.412312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92573d-b146-44f4-8282-2bff7e651886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:03.453688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-eb92573d-b146-44f4-8282-2bff7e651886 None None] MFA Rules not processed for user `b63040a3e42e43568ea27d12f9a15322`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:03.454924 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-eb92573d-b146-44f4-8282-2bff7e651886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:03.476040 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 880/1757] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:03 2022] PUT /identity/v3/projects/72abe8bf64b44a5a8f2b12f0aef11401/users/eddd622920bf49d49cefa39b8d347bbd/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:03.478103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd11e5-3799-409b-b940-491450461b4b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:03.478672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd11e5-3799-409b-b940-491450461b4b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:03.479089 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd11e5-3799-409b-b940-491450461b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:03.519021 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-37bd11e5-3799-409b-b940-491450461b4b None None] MFA Rules not processed for user `6d8d42699562417c97306525d75d470d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:03.520687 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-37bd11e5-3799-409b-b940-491450461b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:03.579185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 878/1758] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:03.580067 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92573d-b146-44f4-8282-2bff7e651886 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:03.607517 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 881/1759] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:03.608163 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd11e5-3799-409b-b940-491450461b4b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:03.657974 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92573d-b146-44f4-8282-2bff7e651886 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:03.687662 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd11e5-3799-409b-b940-491450461b4b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:03.699284 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84b5ae-6711-4ecc-8c39-38652cf3176f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:03.699965 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84b5ae-6711-4ecc-8c39-38652cf3176f admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:03.700246 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84b5ae-6711-4ecc-8c39-38652cf3176f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:03.707012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84b5ae-6711-4ecc-8c39-38652cf3176f admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:03.707012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84b5ae-6711-4ecc-8c39-38652cf3176f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:03.707012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84b5ae-6711-4ecc-8c39-38652cf3176f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:03.782208 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb8de4-27e5-4ae5-8d25-aef1ecbc2100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:03.782208 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb8de4-27e5-4ae5-8d25-aef1ecbc2100 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:03.782208 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb8de4-27e5-4ae5-8d25-aef1ecbc2100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:03.782208 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb8de4-27e5-4ae5-8d25-aef1ecbc2100 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:03.782767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb8de4-27e5-4ae5-8d25-aef1ecbc2100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:03.784165 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb8de4-27e5-4ae5-8d25-aef1ecbc2100 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:03.817816 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 879/1760] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:03.823101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb8de4-27e5-4ae5-8d25-aef1ecbc2100 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:03.836162 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb8de4-27e5-4ae5-8d25-aef1ecbc2100 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:03.841326 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2c192-60ca-440f-9541-6c920a2f421d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:03.842031 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2c192-60ca-440f-9541-6c920a2f421d admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:03.842383 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2c192-60ca-440f-9541-6c920a2f421d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:03.842743 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2c192-60ca-440f-9541-6c920a2f421d admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:03.843433 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2c192-60ca-440f-9541-6c920a2f421d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:03.845622 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2c192-60ca-440f-9541-6c920a2f421d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:03.899373 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 882/1761] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:03 2022] POST /identity/v3/projects => generated 381 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:03.900296 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84b5ae-6711-4ecc-8c39-38652cf3176f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:03.983688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 880/1762] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:03 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:03.983688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2c192-60ca-440f-9541-6c920a2f421d admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:03.983961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84b5ae-6711-4ecc-8c39-38652cf3176f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:04.051060 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefe853-897a-40dc-a06e-02e066d7d5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:04.052712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2c192-60ca-440f-9541-6c920a2f421d admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:04.053548 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefe853-897a-40dc-a06e-02e066d7d5e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:04.054067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefe853-897a-40dc-a06e-02e066d7d5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:04.054648 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefe853-897a-40dc-a06e-02e066d7d5e1 admin admin] PATH_INFO: `/v3/projects/72abe8bf64b44a5a8f2b12f0aef11401/users/eddd622920bf49d49cefa39b8d347bbd/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:04.057139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefe853-897a-40dc-a06e-02e066d7d5e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72abe8bf64b44a5a8f2b12f0aef11401, user_id=eddd622920bf49d49cefa39b8d347bbd, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:04.057453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944cbf3-9baf-4505-a476-00be0465a6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:04.058018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944cbf3-9baf-4505-a476-00be0465a6ab admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:04.058294 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944cbf3-9baf-4505-a476-00be0465a6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:04.058561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944cbf3-9baf-4505-a476-00be0465a6ab admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:04.059452 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944cbf3-9baf-4505-a476-00be0465a6ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:04.061140 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefe853-897a-40dc-a06e-02e066d7d5e1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:04.061553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944cbf3-9baf-4505-a476-00be0465a6ab admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:04.077546 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 883/1763] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:03 2022] PUT /identity/v3/projects/72abe8bf64b44a5a8f2b12f0aef11401/users/eddd622920bf49d49cefa39b8d347bbd/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:04.078567 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefe853-897a-40dc-a06e-02e066d7d5e1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:04.083694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:04.167689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefe853-897a-40dc-a06e-02e066d7d5e1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:04.172508 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfe548-f3a4-40db-8473-4032513d49b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:04.173140 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfe548-f3a4-40db-8473-4032513d49b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:04.173421 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfe548-f3a4-40db-8473-4032513d49b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:04.173693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfe548-f3a4-40db-8473-4032513d49b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:04.174354 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfe548-f3a4-40db-8473-4032513d49b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:04.176669 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfe548-f3a4-40db-8473-4032513d49b5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:04.228389 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 881/1764] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:03 2022] POST /identity/v3/users => generated 297 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:04.229807 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2c876-6a82-4a0f-a389-437d8af34f11 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:04.230108 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2c876-6a82-4a0f-a389-437d8af34f11 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:04.230386 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2c876-6a82-4a0f-a389-437d8af34f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:04.268072 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-f0a2c876-6a82-4a0f-a389-437d8af34f11 None None] MFA Rules not processed for user `eddd622920bf49d49cefa39b8d347bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:04.271865 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f0a2c876-6a82-4a0f-a389-437d8af34f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:04.313851 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 884/1765] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:04 2022] POST /identity/v3/users => generated 295 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:04.315144 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfe548-f3a4-40db-8473-4032513d49b5 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:04.343410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfe548-f3a4-40db-8473-4032513d49b5 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:04.362183 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a9cb0-327b-4dc3-953d-4dab1ce4f34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:04.364140 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a9cb0-327b-4dc3-953d-4dab1ce4f34a admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:04.364494 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a9cb0-327b-4dc3-953d-4dab1ce4f34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:04.364837 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a9cb0-327b-4dc3-953d-4dab1ce4f34a admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:04.366962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a9cb0-327b-4dc3-953d-4dab1ce4f34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:04.368707 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a9cb0-327b-4dc3-953d-4dab1ce4f34a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:04.397997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 885/1766] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:04.398918 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a9cb0-327b-4dc3-953d-4dab1ce4f34a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:04.422195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 882/1767] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:04.422195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2c876-6a82-4a0f-a389-437d8af34f11 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:04.422423 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a9cb0-327b-4dc3-953d-4dab1ce4f34a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:04.428474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661274f0-5558-4c14-8ab2-9d73d95d7ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:04.430427 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661274f0-5558-4c14-8ab2-9d73d95d7ece admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:04.430427 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661274f0-5558-4c14-8ab2-9d73d95d7ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:04.430427 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661274f0-5558-4c14-8ab2-9d73d95d7ece admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:04.432693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661274f0-5558-4c14-8ab2-9d73d95d7ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:04.434716 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661274f0-5558-4c14-8ab2-9d73d95d7ece admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:04.443352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2c876-6a82-4a0f-a389-437d8af34f11 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:04.446745 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 886/1768] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:04.447824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661274f0-5558-4c14-8ab2-9d73d95d7ece admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:04.450661 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-661274f0-5558-4c14-8ab2-9d73d95d7ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:04.453433 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa50880-499c-4f59-a2f4-fd80c7266dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:04.454830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa50880-499c-4f59-a2f4-fd80c7266dbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:04.456271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa50880-499c-4f59-a2f4-fd80c7266dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:04.465372 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa50880-499c-4f59-a2f4-fd80c7266dbf admin admin] PATH_INFO: `/v3/projects/5730a9061517461b82242f9179c8522a/users/ff6adccf6bf34053bdd1ab36f9a64664/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:04.483477 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa50880-499c-4f59-a2f4-fd80c7266dbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5730a9061517461b82242f9179c8522a, user_id=ff6adccf6bf34053bdd1ab36f9a64664, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:04.488230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa50880-499c-4f59-a2f4-fd80c7266dbf admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:04.531579 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661274f0-5558-4c14-8ab2-9d73d95d7ece admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:04.535774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadeb22-7a4c-494b-8f61-d167d03c9fbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:04.536466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadeb22-7a4c-494b-8f61-d167d03c9fbe service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:04.536752 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadeb22-7a4c-494b-8f61-d167d03c9fbe service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:04.537035 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadeb22-7a4c-494b-8f61-d167d03c9fbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:04.548799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadeb22-7a4c-494b-8f61-d167d03c9fbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:04.550508 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadeb22-7a4c-494b-8f61-d167d03c9fbe service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:04.563240 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 887/1769] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:04.564312 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadeb22-7a4c-494b-8f61-d167d03c9fbe service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:04.577022 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadeb22-7a4c-494b-8f61-d167d03c9fbe service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:04.578005 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 883/1770] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:04 2022] PUT /identity/v3/projects/5730a9061517461b82242f9179c8522a/users/ff6adccf6bf34053bdd1ab36f9a64664/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:04.582078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa50880-499c-4f59-a2f4-fd80c7266dbf admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:04.695349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff03b7a-d19c-464e-8840-e5a6292b8d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:04.696219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff03b7a-d19c-464e-8840-e5a6292b8d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:04.696507 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff03b7a-d19c-464e-8840-e5a6292b8d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:04.696805 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff03b7a-d19c-464e-8840-e5a6292b8d41 admin admin] PATH_INFO: `/v3/projects/b6a6d91980ec486d848072307526b840/users/a7d0ae86a1dd41ebac4589b555faa0f3/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:04.710179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa50880-499c-4f59-a2f4-fd80c7266dbf admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:04.729267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30340116-d08c-4bb7-a379-1d3c267ef112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:04.730332 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30340116-d08c-4bb7-a379-1d3c267ef112 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:04.730619 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30340116-d08c-4bb7-a379-1d3c267ef112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:04.730894 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30340116-d08c-4bb7-a379-1d3c267ef112 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:04.731611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30340116-d08c-4bb7-a379-1d3c267ef112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:04.734634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30340116-d08c-4bb7-a379-1d3c267ef112 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:04.739441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff03b7a-d19c-464e-8840-e5a6292b8d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a6d91980ec486d848072307526b840, user_id=a7d0ae86a1dd41ebac4589b555faa0f3, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:04.742177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff03b7a-d19c-464e-8840-e5a6292b8d41 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:04.778376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 884/1771] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:04.786379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30340116-d08c-4bb7-a379-1d3c267ef112 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:04.826962 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30340116-d08c-4bb7-a379-1d3c267ef112 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:04.842014 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f420c-3a32-431c-9351-ef311eb941de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:04.848087 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f420c-3a32-431c-9351-ef311eb941de admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:04.848412 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f420c-3a32-431c-9351-ef311eb941de admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:04.848695 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f420c-3a32-431c-9351-ef311eb941de admin admin] PATH_INFO: `/v3/projects/5730a9061517461b82242f9179c8522a/users/ff6adccf6bf34053bdd1ab36f9a64664/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:04.872818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f420c-3a32-431c-9351-ef311eb941de admin admin] RBAC: Authorizing `identity:create_grant(project_id=5730a9061517461b82242f9179c8522a, user_id=ff6adccf6bf34053bdd1ab36f9a64664, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:04.882287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 888/1772] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:04 2022] PUT /identity/v3/projects/b6a6d91980ec486d848072307526b840/users/a7d0ae86a1dd41ebac4589b555faa0f3/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:04.882603 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f420c-3a32-431c-9351-ef311eb941de admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:04.884982 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff03b7a-d19c-464e-8840-e5a6292b8d41 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:04.927589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 885/1773] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:04 2022] PUT /identity/v3/projects/5730a9061517461b82242f9179c8522a/users/ff6adccf6bf34053bdd1ab36f9a64664/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:04.941272 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ae8c2-d3f9-4d76-bf1f-e49f31ae03b6 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:04.941552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ae8c2-d3f9-4d76-bf1f-e49f31ae03b6 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:04.941854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ae8c2-d3f9-4d76-bf1f-e49f31ae03b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:04.993085 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-f50ae8c2-d3f9-4d76-bf1f-e49f31ae03b6 None None] MFA Rules not processed for user `ff6adccf6bf34053bdd1ab36f9a64664`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:04.994598 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f50ae8c2-d3f9-4d76-bf1f-e49f31ae03b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:05.038056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff03b7a-d19c-464e-8840-e5a6292b8d41 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:05.093493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 886/1774] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:05.100961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041015ec-c1aa-4ac0-93b5-1ded64e28c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:05.101620 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041015ec-c1aa-4ac0-93b5-1ded64e28c36 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:05.101912 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041015ec-c1aa-4ac0-93b5-1ded64e28c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:05.102316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041015ec-c1aa-4ac0-93b5-1ded64e28c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:05.103018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041015ec-c1aa-4ac0-93b5-1ded64e28c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:05.104661 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041015ec-c1aa-4ac0-93b5-1ded64e28c36 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:05.116953 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 889/1775] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:05.120244 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ae8c2-d3f9-4d76-bf1f-e49f31ae03b6 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:05.130900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ae8c2-d3f9-4d76-bf1f-e49f31ae03b6 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:05.135550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b497d45-09a1-432f-984d-ac326f8d3d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:05.136210 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b497d45-09a1-432f-984d-ac326f8d3d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:05.136536 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b497d45-09a1-432f-984d-ac326f8d3d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:05.136813 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b497d45-09a1-432f-984d-ac326f8d3d3d admin admin] PATH_INFO: `/v3/projects/b6a6d91980ec486d848072307526b840/users/a7d0ae86a1dd41ebac4589b555faa0f3/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:05.138802 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b497d45-09a1-432f-984d-ac326f8d3d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a6d91980ec486d848072307526b840, user_id=a7d0ae86a1dd41ebac4589b555faa0f3, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:05.141501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b497d45-09a1-432f-984d-ac326f8d3d3d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:05.152461 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 887/1776] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:05 2022] PUT /identity/v3/projects/b6a6d91980ec486d848072307526b840/users/a7d0ae86a1dd41ebac4589b555faa0f3/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:05.167019 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc8e1a-49c5-4005-921b-eafe99e9be24 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:05.167311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc8e1a-49c5-4005-921b-eafe99e9be24 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:05.167593 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc8e1a-49c5-4005-921b-eafe99e9be24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:05.195171 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b497d45-09a1-432f-984d-ac326f8d3d3d admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:05.211361 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-badc8e1a-49c5-4005-921b-eafe99e9be24 None None] MFA Rules not processed for user `a7d0ae86a1dd41ebac4589b555faa0f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:05.214089 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-badc8e1a-49c5-4005-921b-eafe99e9be24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:05.217537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:05.306769 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b497d45-09a1-432f-984d-ac326f8d3d3d admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:05.310673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46acbf4-240c-49fc-b198-6461e212de0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:05.311256 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46acbf4-240c-49fc-b198-6461e212de0e service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:05.311527 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46acbf4-240c-49fc-b198-6461e212de0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:05.311816 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46acbf4-240c-49fc-b198-6461e212de0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:05.339922 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 890/1777] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:05.373507 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46acbf4-240c-49fc-b198-6461e212de0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:05.374935 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46acbf4-240c-49fc-b198-6461e212de0e service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:05.385015 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 888/1778] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:05.553174 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc8e1a-49c5-4005-921b-eafe99e9be24 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:05.564385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc8e1a-49c5-4005-921b-eafe99e9be24 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:05.570101 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eadac-8ef2-4100-a987-f5200afcee8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:05.570724 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eadac-8ef2-4100-a987-f5200afcee8b service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:05.571005 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eadac-8ef2-4100-a987-f5200afcee8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:05.575647 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eadac-8ef2-4100-a987-f5200afcee8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:05.638865 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967eadac-8ef2-4100-a987-f5200afcee8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:05.640306 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967eadac-8ef2-4100-a987-f5200afcee8b service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:05.651597 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 891/1779] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:06.925178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f689a26-1a56-43ce-9eb7-d285ff713d62 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:06.925178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f689a26-1a56-43ce-9eb7-d285ff713d62 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:06.925178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f689a26-1a56-43ce-9eb7-d285ff713d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:06.967519 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eadac-8ef2-4100-a987-f5200afcee8b service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:06.977913 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eadac-8ef2-4100-a987-f5200afcee8b service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:06.998531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03a170-0ac7-4198-8e52-1d983632a6ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:06.999227 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03a170-0ac7-4198-8e52-1d983632a6ea service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:06.999517 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03a170-0ac7-4198-8e52-1d983632a6ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:06.999799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03a170-0ac7-4198-8e52-1d983632a6ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:07.058591 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-8f689a26-1a56-43ce-9eb7-d285ff713d62 None None] MFA Rules not processed for user `635e47d0a5a34fdfb5c8967a96a87828`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:07.061817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8f689a26-1a56-43ce-9eb7-d285ff713d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:07.092269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03a170-0ac7-4198-8e52-1d983632a6ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:07.094114 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03a170-0ac7-4198-8e52-1d983632a6ea service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:07.108937 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 892/1780] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:35:07.251002 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 889/1781] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 5 14:35:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:07.542067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:07.772292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936ad2f-c7a5-4b6a-ab17-c72d6eb47cd8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:07.772654 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936ad2f-c7a5-4b6a-ab17-c72d6eb47cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:07.773126 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936ad2f-c7a5-4b6a-ab17-c72d6eb47cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:07.795520 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f689a26-1a56-43ce-9eb7-d285ff713d62 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:07.800347 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8f689a26-1a56-43ce-9eb7-d285ff713d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:07.856948 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3936ad2f-c7a5-4b6a-ab17-c72d6eb47cd8 None None] MFA Rules not processed for user `b0ec118e5a114429b3e1c91041f7caf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:07.860688 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3936ad2f-c7a5-4b6a-ab17-c72d6eb47cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:08.028316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 893/1782] 10.222.0.44 () {58 vars in 1015 bytes} [Mon Sep 5 14:35:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:08.059284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f689a26-1a56-43ce-9eb7-d285ff713d62 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:08.066750 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4bcc4-aba1-43b7-bea3-7178822ea2b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed60e9eecb94ef39c2f4a5e5f50d670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:08.072842 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4bcc4-aba1-43b7-bea3-7178822ea2b7 service swift] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:08.072842 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4bcc4-aba1-43b7-bea3-7178822ea2b7 service swift] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:08.072842 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4bcc4-aba1-43b7-bea3-7178822ea2b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:08.084099 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4bcc4-aba1-43b7-bea3-7178822ea2b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:08.086403 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4bcc4-aba1-43b7-bea3-7178822ea2b7 service swift] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:08.120827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 890/1783] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 5 14:35:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 05 14:35:08.150062 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936ad2f-c7a5-4b6a-ab17-c72d6eb47cd8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:08.151510 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3936ad2f-c7a5-4b6a-ab17-c72d6eb47cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:08.180935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936ad2f-c7a5-4b6a-ab17-c72d6eb47cd8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:08.226817 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5dd3b-b664-42d0-babf-9acc15043d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:08.227686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5dd3b-b664-42d0-babf-9acc15043d87 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:08.236569 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5dd3b-b664-42d0-babf-9acc15043d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:08.237008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5dd3b-b664-42d0-babf-9acc15043d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:08.246677 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4bcc4-aba1-43b7-bea3-7178822ea2b7 service swift] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:08.248596 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-12c4bcc4-aba1-43b7-bea3-7178822ea2b7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:08.285323 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5dd3b-b664-42d0-babf-9acc15043d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:08.286315 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4bcc4-aba1-43b7-bea3-7178822ea2b7 service swift] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:08.292281 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5dd3b-b664-42d0-babf-9acc15043d87 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:08.307171 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492bab8-ca17-44e4-b97d-47899ef090f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:08.309166 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492bab8-ca17-44e4-b97d-47899ef090f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:08.314895 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492bab8-ca17-44e4-b97d-47899ef090f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:08.315402 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492bab8-ca17-44e4-b97d-47899ef090f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:08.324674 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 894/1784] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:08.346817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492bab8-ca17-44e4-b97d-47899ef090f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:08.351879 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492bab8-ca17-44e4-b97d-47899ef090f9 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:08.377498 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 891/1785] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:08.454933 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5dd3b-b664-42d0-babf-9acc15043d87 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:08.476419 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5dd3b-b664-42d0-babf-9acc15043d87 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:08.489215 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058ceff-c76a-4269-8a2c-24cb89f8aaf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:08.492319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058ceff-c76a-4269-8a2c-24cb89f8aaf3 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:08.492319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058ceff-c76a-4269-8a2c-24cb89f8aaf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:08.492319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058ceff-c76a-4269-8a2c-24cb89f8aaf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:08.535186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058ceff-c76a-4269-8a2c-24cb89f8aaf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:08.538815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058ceff-c76a-4269-8a2c-24cb89f8aaf3 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:08.570652 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 895/1786] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:09.188389 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:09.927925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bd023-af0c-4834-8278-b26a234e605c None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:09.927925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bd023-af0c-4834-8278-b26a234e605c None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:09.927925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bd023-af0c-4834-8278-b26a234e605c None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:09.927925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 892/1787] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 5 14:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:35:09.931080 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031caad-b657-4ade-ba7e-7c6781c0c2ca None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:09.932416 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031caad-b657-4ade-ba7e-7c6781c0c2ca None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:09.932709 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031caad-b657-4ade-ba7e-7c6781c0c2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:09.965192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a031caad-b657-4ade-ba7e-7c6781c0c2ca None None] MFA Rules not processed for user `d5515accf3b64006bc41422265a641bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:09.966896 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a031caad-b657-4ade-ba7e-7c6781c0c2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:10.071701 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 896/1788] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 5 14:35:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:10.083729 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bd023-af0c-4834-8278-b26a234e605c None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:10.085603 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fc3bd023-af0c-4834-8278-b26a234e605c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:10.123582 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bd023-af0c-4834-8278-b26a234e605c None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:10.131405 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34e571-79ea-4591-b27c-e5b7753e5cdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:10.132663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34e571-79ea-4591-b27c-e5b7753e5cdd service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:10.133121 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34e571-79ea-4591-b27c-e5b7753e5cdd service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:10.133627 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34e571-79ea-4591-b27c-e5b7753e5cdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:10.155440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34e571-79ea-4591-b27c-e5b7753e5cdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:10.157335 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34e571-79ea-4591-b27c-e5b7753e5cdd service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:10.185245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 893/1789] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:11.224044 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:12.224764 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:12.984707 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc733a-1bcd-44d0-96e8-d20208ce54b9 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:12.990447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc733a-1bcd-44d0-96e8-d20208ce54b9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:12.990447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc733a-1bcd-44d0-96e8-d20208ce54b9 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:12.990447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 897/1790] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 5 14:35:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:35:13.016648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27595786-f9bb-490a-877f-d6ab92bc1979 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:13.017677 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27595786-f9bb-490a-877f-d6ab92bc1979 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:13.018129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27595786-f9bb-490a-877f-d6ab92bc1979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:13.073110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-27595786-f9bb-490a-877f-d6ab92bc1979 None None] MFA Rules not processed for user `d5515accf3b64006bc41422265a641bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:13.084937 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-27595786-f9bb-490a-877f-d6ab92bc1979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:13.114444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 894/1791] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 5 14:35:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:13.214793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc733a-1bcd-44d0-96e8-d20208ce54b9 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:13.260478 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27595786-f9bb-490a-877f-d6ab92bc1979 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:13.264098 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-27595786-f9bb-490a-877f-d6ab92bc1979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:13.287226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27595786-f9bb-490a-877f-d6ab92bc1979 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:13.299047 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf69353-ea1e-49b6-a4a0-4559a8b27d5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:13.300510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf69353-ea1e-49b6-a4a0-4559a8b27d5b service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:13.301142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf69353-ea1e-49b6-a4a0-4559a8b27d5b service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:13.301750 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf69353-ea1e-49b6-a4a0-4559a8b27d5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:13.317813 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf69353-ea1e-49b6-a4a0-4559a8b27d5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:13.320535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf69353-ea1e-49b6-a4a0-4559a8b27d5b service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:13.337667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 895/1792] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:35:13.398197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc733a-1bcd-44d0-96e8-d20208ce54b9 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:13.404400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55934d73-ebfd-4ae8-8007-97e439b5895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:13.405225 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55934d73-ebfd-4ae8-8007-97e439b5895d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:13.405589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55934d73-ebfd-4ae8-8007-97e439b5895d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:13.405918 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55934d73-ebfd-4ae8-8007-97e439b5895d admin admin] PATH_INFO: `/v3/users/eba66102773d4fdcbf0f8f0096fe9ea6` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:13.407219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55934d73-ebfd-4ae8-8007-97e439b5895d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eba66102773d4fdcbf0f8f0096fe9ea6)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:13.409998 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55934d73-ebfd-4ae8-8007-97e439b5895d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:13.559194 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:13.612761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-55934d73-ebfd-4ae8-8007-97e439b5895d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eba66102773d4fdcbf0f8f0096fe9ea6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:13.614643 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-55934d73-ebfd-4ae8-8007-97e439b5895d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eba66102773d4fdcbf0f8f0096fe9ea6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:13.709890 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-55934d73-ebfd-4ae8-8007-97e439b5895d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eba66102773d4fdcbf0f8f0096fe9ea6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:13.745832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-55934d73-ebfd-4ae8-8007-97e439b5895d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eba66102773d4fdcbf0f8f0096fe9ea6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:13.750252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-55934d73-ebfd-4ae8-8007-97e439b5895d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eba66102773d4fdcbf0f8f0096fe9ea6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:13.792082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 898/1793] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:13 2022] DELETE /identity/v3/users/eba66102773d4fdcbf0f8f0096fe9ea6 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:13.796448 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241be248-78d7-4830-9d88-b1bb466d9102 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:13.796908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241be248-78d7-4830-9d88-b1bb466d9102 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:13.797630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241be248-78d7-4830-9d88-b1bb466d9102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:13.864464 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-241be248-78d7-4830-9d88-b1bb466d9102 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:13.865735 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-241be248-78d7-4830-9d88-b1bb466d9102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:13.986808 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 896/1794] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:14.025865 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55934d73-ebfd-4ae8-8007-97e439b5895d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:14.027340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-55934d73-ebfd-4ae8-8007-97e439b5895d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:14.148783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55934d73-ebfd-4ae8-8007-97e439b5895d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:14.154120 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445e8dd-e1c4-4976-ad3f-83b596bb13fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:14.155695 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445e8dd-e1c4-4976-ad3f-83b596bb13fa service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:14.156260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445e8dd-e1c4-4976-ad3f-83b596bb13fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:14.156937 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445e8dd-e1c4-4976-ad3f-83b596bb13fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:14.169949 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445e8dd-e1c4-4976-ad3f-83b596bb13fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:14.171762 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445e8dd-e1c4-4976-ad3f-83b596bb13fa service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:14.197647 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 899/1795] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:35:14.884455 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:14.991473 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241be248-78d7-4830-9d88-b1bb466d9102 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:14.993323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-241be248-78d7-4830-9d88-b1bb466d9102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:15.032210 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241be248-78d7-4830-9d88-b1bb466d9102 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:15.059621 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8ad2b-af17-45fb-a314-946b9f033f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:15.060253 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8ad2b-af17-45fb-a314-946b9f033f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:15.060537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8ad2b-af17-45fb-a314-946b9f033f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:15.060816 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8ad2b-af17-45fb-a314-946b9f033f88 admin admin] PATH_INFO: `/v3/projects/654bddc048c443d7824b4d2383fd0949` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:15.065947 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8ad2b-af17-45fb-a314-946b9f033f88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=654bddc048c443d7824b4d2383fd0949)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:15.082752 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8ad2b-af17-45fb-a314-946b9f033f88 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:15.327548 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5ea8ad2b-af17-45fb-a314-946b9f033f88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '654bddc048c443d7824b4d2383fd0949', 'request_id': 'req-5ea8ad2b-af17-45fb-a314-946b9f033f88'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:15.340322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5ea8ad2b-af17-45fb-a314-946b9f033f88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '654bddc048c443d7824b4d2383fd0949', 'request_id': 'req-5ea8ad2b-af17-45fb-a314-946b9f033f88'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:15.477137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5ea8ad2b-af17-45fb-a314-946b9f033f88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '654bddc048c443d7824b4d2383fd0949', 'request_id': 'req-5ea8ad2b-af17-45fb-a314-946b9f033f88'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:15.488727 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5ea8ad2b-af17-45fb-a314-946b9f033f88 admin admin] The token cache is being invalidate because project 654bddc048c443d7824b4d2383fd0949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:15.489042 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5ea8ad2b-af17-45fb-a314-946b9f033f88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:15.489884 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5ea8ad2b-af17-45fb-a314-946b9f033f88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:15.494484 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 897/1796] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:14 2022] DELETE /identity/v3/projects/654bddc048c443d7824b4d2383fd0949 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:15.495824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445e8dd-e1c4-4976-ad3f-83b596bb13fa service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:15.516415 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445e8dd-e1c4-4976-ad3f-83b596bb13fa service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:15.598039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8ad2b-af17-45fb-a314-946b9f033f88 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:15.599469 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5ea8ad2b-af17-45fb-a314-946b9f033f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:15.661881 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b4e34-f96d-4992-b809-45610eab0274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:15.663908 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b4e34-f96d-4992-b809-45610eab0274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:15.664331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b4e34-f96d-4992-b809-45610eab0274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:15.665408 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b4e34-f96d-4992-b809-45610eab0274 admin admin] PATH_INFO: `/v3/users/f6193083093a4cba9f4e6a45548ecae4` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:15.668282 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b4e34-f96d-4992-b809-45610eab0274 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6193083093a4cba9f4e6a45548ecae4)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:15.679497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b4e34-f96d-4992-b809-45610eab0274 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:15.775711 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8ad2b-af17-45fb-a314-946b9f033f88 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:15.788487 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775fa69-39ec-4c0e-bc4f-166f9835a154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:15.789610 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775fa69-39ec-4c0e-bc4f-166f9835a154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:15.790165 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775fa69-39ec-4c0e-bc4f-166f9835a154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:15.790638 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775fa69-39ec-4c0e-bc4f-166f9835a154 admin admin] PATH_INFO: `/v3/users/6d8d42699562417c97306525d75d470d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:15.792077 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775fa69-39ec-4c0e-bc4f-166f9835a154 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d8d42699562417c97306525d75d470d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:15.794592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775fa69-39ec-4c0e-bc4f-166f9835a154 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:15.954412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cc9b4e34-f96d-4992-b809-45610eab0274 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6193083093a4cba9f4e6a45548ecae4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:15.955315 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cc9b4e34-f96d-4992-b809-45610eab0274 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6193083093a4cba9f4e6a45548ecae4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:16.083521 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cc9b4e34-f96d-4992-b809-45610eab0274 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6193083093a4cba9f4e6a45548ecae4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:16.109454 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cc9b4e34-f96d-4992-b809-45610eab0274 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6193083093a4cba9f4e6a45548ecae4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:16.110949 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cc9b4e34-f96d-4992-b809-45610eab0274 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6193083093a4cba9f4e6a45548ecae4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:16.117983 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1775fa69-39ec-4c0e-bc4f-166f9835a154 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d8d42699562417c97306525d75d470d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:16.140386 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 900/1797] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:15 2022] DELETE /identity/v3/users/f6193083093a4cba9f4e6a45548ecae4 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:35:16.141668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b4e34-f96d-4992-b809-45610eab0274 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:16.146208 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cc9b4e34-f96d-4992-b809-45610eab0274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:16.206457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1775fa69-39ec-4c0e-bc4f-166f9835a154 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d8d42699562417c97306525d75d470d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:16.248493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1775fa69-39ec-4c0e-bc4f-166f9835a154 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d8d42699562417c97306525d75d470d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:16.256081 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1775fa69-39ec-4c0e-bc4f-166f9835a154 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d8d42699562417c97306525d75d470d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:16.281935 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1775fa69-39ec-4c0e-bc4f-166f9835a154 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d8d42699562417c97306525d75d470d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:16.306209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b4e34-f96d-4992-b809-45610eab0274 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:16.307043 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 898/1798] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:15 2022] DELETE /identity/v3/users/6d8d42699562417c97306525d75d470d => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:16.309698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211b98b-e9d9-43a4-9871-d52b64c4f4ef None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:16.310208 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211b98b-e9d9-43a4-9871-d52b64c4f4ef None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:16.311717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211b98b-e9d9-43a4-9871-d52b64c4f4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:16.349473 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-e211b98b-e9d9-43a4-9871-d52b64c4f4ef None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:16.352667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e211b98b-e9d9-43a4-9871-d52b64c4f4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:16.448357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098876d-a140-408f-906a-4dc187f632e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:16.449364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098876d-a140-408f-906a-4dc187f632e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:16.449470 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098876d-a140-408f-906a-4dc187f632e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:16.449779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098876d-a140-408f-906a-4dc187f632e8 admin admin] PATH_INFO: `/v3/users/c58e02529e6f40aa91cd0fc18eaa0464` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:16.454062 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098876d-a140-408f-906a-4dc187f632e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c58e02529e6f40aa91cd0fc18eaa0464)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:16.456169 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098876d-a140-408f-906a-4dc187f632e8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:16.586301 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 899/1799] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:16.601233 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211b98b-e9d9-43a4-9871-d52b64c4f4ef None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:16.605783 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e211b98b-e9d9-43a4-9871-d52b64c4f4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:16.762536 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211b98b-e9d9-43a4-9871-d52b64c4f4ef None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:16.772563 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f1397-8068-4447-bd98-4deb67b0f9a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:16.773225 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f1397-8068-4447-bd98-4deb67b0f9a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:16.773605 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f1397-8068-4447-bd98-4deb67b0f9a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:16.773785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f1397-8068-4447-bd98-4deb67b0f9a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:16.803683 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f1397-8068-4447-bd98-4deb67b0f9a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:16.807158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f1397-8068-4447-bd98-4deb67b0f9a9 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:16.849243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 900/1800] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:16.856191 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6098876d-a140-408f-906a-4dc187f632e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c58e02529e6f40aa91cd0fc18eaa0464'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:16.857484 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6098876d-a140-408f-906a-4dc187f632e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c58e02529e6f40aa91cd0fc18eaa0464'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:16.952454 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f1397-8068-4447-bd98-4deb67b0f9a9 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:16.953581 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6098876d-a140-408f-906a-4dc187f632e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c58e02529e6f40aa91cd0fc18eaa0464'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:16.957498 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c62f1397-8068-4447-bd98-4deb67b0f9a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:16.984378 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f1397-8068-4447-bd98-4deb67b0f9a9 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:16.990314 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f04e59-f1f6-4434-a229-89bc9c0e7588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:16.991195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f04e59-f1f6-4434-a229-89bc9c0e7588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:16.991578 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f04e59-f1f6-4434-a229-89bc9c0e7588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:16.991954 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f04e59-f1f6-4434-a229-89bc9c0e7588 admin admin] PATH_INFO: `/v3/projects/6a1a1377c5174b668677f0dc0341fdc3` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:16.993468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f04e59-f1f6-4434-a229-89bc9c0e7588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a1a1377c5174b668677f0dc0341fdc3)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:16.995789 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f04e59-f1f6-4434-a229-89bc9c0e7588 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:16.998170 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6098876d-a140-408f-906a-4dc187f632e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c58e02529e6f40aa91cd0fc18eaa0464'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:17.000858 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6098876d-a140-408f-906a-4dc187f632e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c58e02529e6f40aa91cd0fc18eaa0464'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:17.035514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 901/1801] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:16 2022] DELETE /identity/v3/users/c58e02529e6f40aa91cd0fc18eaa0464 => generated 0 bytes in 894 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:17.040204 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d86d1-c783-445a-88e8-1cfd0cfc9134 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:17.040493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d86d1-c783-445a-88e8-1cfd0cfc9134 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:17.040766 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d86d1-c783-445a-88e8-1cfd0cfc9134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:17.068129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3c5d86d1-c783-445a-88e8-1cfd0cfc9134 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:17.069837 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3c5d86d1-c783-445a-88e8-1cfd0cfc9134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:17.177712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-74f04e59-f1f6-4434-a229-89bc9c0e7588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1a1377c5174b668677f0dc0341fdc3', 'request_id': 'req-74f04e59-f1f6-4434-a229-89bc9c0e7588'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:17.188087 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-74f04e59-f1f6-4434-a229-89bc9c0e7588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1a1377c5174b668677f0dc0341fdc3', 'request_id': 'req-74f04e59-f1f6-4434-a229-89bc9c0e7588'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:17.231093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 902/1802] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:35:17.266958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d86d1-c783-445a-88e8-1cfd0cfc9134 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:17.269378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3c5d86d1-c783-445a-88e8-1cfd0cfc9134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:17.307319 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-74f04e59-f1f6-4434-a229-89bc9c0e7588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1a1377c5174b668677f0dc0341fdc3', 'request_id': 'req-74f04e59-f1f6-4434-a229-89bc9c0e7588'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:17.330286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-74f04e59-f1f6-4434-a229-89bc9c0e7588 admin admin] The token cache is being invalidate because project 6a1a1377c5174b668677f0dc0341fdc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:17.332493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-74f04e59-f1f6-4434-a229-89bc9c0e7588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:17.334894 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-74f04e59-f1f6-4434-a229-89bc9c0e7588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:17.342874 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 901/1803] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:16 2022] DELETE /identity/v3/projects/6a1a1377c5174b668677f0dc0341fdc3 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:35:17.351264 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f86ea8-36d6-47b4-b64a-2b298838dee4 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:17.351659 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f86ea8-36d6-47b4-b64a-2b298838dee4 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:17.351951 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f86ea8-36d6-47b4-b64a-2b298838dee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:17.378627 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d86d1-c783-445a-88e8-1cfd0cfc9134 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:17.394846 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c2f86ea8-36d6-47b4-b64a-2b298838dee4 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:17.398023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c2f86ea8-36d6-47b4-b64a-2b298838dee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:17.488896 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3210ec1-05c6-4941-9d83-1082333126bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:17.491477 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:17.493355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3210ec1-05c6-4941-9d83-1082333126bd service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:17.493644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3210ec1-05c6-4941-9d83-1082333126bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:17.494199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3210ec1-05c6-4941-9d83-1082333126bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:17.496387 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e3210ec1-05c6-4941-9d83-1082333126bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:17.530317 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 902/1804] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:35:17.552925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186a698-0f38-47e5-b81c-79757de62934 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:17.552925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186a698-0f38-47e5-b81c-79757de62934 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:17.554912 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186a698-0f38-47e5-b81c-79757de62934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:17.585313 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d186a698-0f38-47e5-b81c-79757de62934 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:17.585313 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d186a698-0f38-47e5-b81c-79757de62934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:17.593045 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 903/1805] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:17.596063 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3210ec1-05c6-4941-9d83-1082333126bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:17.597932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186a698-0f38-47e5-b81c-79757de62934 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:17.598578 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3210ec1-05c6-4941-9d83-1082333126bd service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:17.610475 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 903/1806] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:17.614910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186a698-0f38-47e5-b81c-79757de62934 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:17.624141 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2962cbe-7b2c-46e8-959d-39a4e7e74ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:17.624141 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2962cbe-7b2c-46e8-959d-39a4e7e74ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:17.624141 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2962cbe-7b2c-46e8-959d-39a4e7e74ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:17.624141 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2962cbe-7b2c-46e8-959d-39a4e7e74ce2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:17.624892 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2962cbe-7b2c-46e8-959d-39a4e7e74ce2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:35:17.625283 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2962cbe-7b2c-46e8-959d-39a4e7e74ce2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:17.627330 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2962cbe-7b2c-46e8-959d-39a4e7e74ce2 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:17.650694 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 904/1807] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:35:17.685586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3210ec1-05c6-4941-9d83-1082333126bd service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:17.699788 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3210ec1-05c6-4941-9d83-1082333126bd service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:17.704715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8935bb-15e0-4972-8d14-cf4db68ebbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:17.705524 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8935bb-15e0-4972-8d14-cf4db68ebbc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:17.705861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8935bb-15e0-4972-8d14-cf4db68ebbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:17.706934 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8935bb-15e0-4972-8d14-cf4db68ebbc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:17.707934 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8935bb-15e0-4972-8d14-cf4db68ebbc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:17.710063 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8935bb-15e0-4972-8d14-cf4db68ebbc0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:17.778192 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2962cbe-7b2c-46e8-959d-39a4e7e74ce2 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:17.780929 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f2962cbe-7b2c-46e8-959d-39a4e7e74ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:17.813560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2962cbe-7b2c-46e8-959d-39a4e7e74ce2 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:17.821767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ebaef-035a-47a3-8228-804f8757d728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:17.824097 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ebaef-035a-47a3-8228-804f8757d728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:17.824097 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ebaef-035a-47a3-8228-804f8757d728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:17.824097 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ebaef-035a-47a3-8228-804f8757d728 admin admin] PATH_INFO: `/v3/projects/cfa814cc45a84ddc9106628d4de2acc9` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:17.824657 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ebaef-035a-47a3-8228-804f8757d728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa814cc45a84ddc9106628d4de2acc9)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:17.829023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ebaef-035a-47a3-8228-804f8757d728 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:17.853526 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 904/1808] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:17 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:17.865485 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8935bb-15e0-4972-8d14-cf4db68ebbc0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:18.014425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-454ebaef-035a-47a3-8228-804f8757d728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa814cc45a84ddc9106628d4de2acc9', 'request_id': 'req-454ebaef-035a-47a3-8228-804f8757d728'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:18.031328 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-454ebaef-035a-47a3-8228-804f8757d728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa814cc45a84ddc9106628d4de2acc9', 'request_id': 'req-454ebaef-035a-47a3-8228-804f8757d728'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:18.034764 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8935bb-15e0-4972-8d14-cf4db68ebbc0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:18.132160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e383e-33a8-4bfb-a16a-dff28e7df951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:18.132842 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e383e-33a8-4bfb-a16a-dff28e7df951 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:18.133165 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e383e-33a8-4bfb-a16a-dff28e7df951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:18.133436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e383e-33a8-4bfb-a16a-dff28e7df951 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:18.134248 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e383e-33a8-4bfb-a16a-dff28e7df951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:18.136241 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e383e-33a8-4bfb-a16a-dff28e7df951 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:18.164258 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-454ebaef-035a-47a3-8228-804f8757d728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa814cc45a84ddc9106628d4de2acc9', 'request_id': 'req-454ebaef-035a-47a3-8228-804f8757d728'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:18.192456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-454ebaef-035a-47a3-8228-804f8757d728 admin admin] The token cache is being invalidate because project cfa814cc45a84ddc9106628d4de2acc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:18.193301 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-454ebaef-035a-47a3-8228-804f8757d728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:18.194228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-454ebaef-035a-47a3-8228-804f8757d728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:18.198782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 905/1809] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:17 2022] DELETE /identity/v3/projects/cfa814cc45a84ddc9106628d4de2acc9 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:35:18.204273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ebaef-035a-47a3-8228-804f8757d728 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:18.205938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-454ebaef-035a-47a3-8228-804f8757d728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:18.226872 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ebaef-035a-47a3-8228-804f8757d728 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:18.236084 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ff36d-184a-45b6-b7cf-f753a077f60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:18.240888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ff36d-184a-45b6-b7cf-f753a077f60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:18.240888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ff36d-184a-45b6-b7cf-f753a077f60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:18.240888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ff36d-184a-45b6-b7cf-f753a077f60b admin admin] PATH_INFO: `/v3/users/a7d0ae86a1dd41ebac4589b555faa0f3` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:18.240888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ff36d-184a-45b6-b7cf-f753a077f60b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7d0ae86a1dd41ebac4589b555faa0f3)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:18.241232 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ff36d-184a-45b6-b7cf-f753a077f60b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:18.272364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 905/1810] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:17 2022] POST /identity/v3/users => generated 290 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:18.273809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e383e-33a8-4bfb-a16a-dff28e7df951 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:18.275612 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f95e383e-33a8-4bfb-a16a-dff28e7df951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:18.306670 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e383e-33a8-4bfb-a16a-dff28e7df951 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:18.313425 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4167f-8e06-4683-9836-b13d57e3c7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:18.314057 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4167f-8e06-4683-9836-b13d57e3c7ff admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:18.314409 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4167f-8e06-4683-9836-b13d57e3c7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:18.314689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4167f-8e06-4683-9836-b13d57e3c7ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:18.315587 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4167f-8e06-4683-9836-b13d57e3c7ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:18.317356 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4167f-8e06-4683-9836-b13d57e3c7ff admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:18.329465 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 906/1811] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:35:18.334076 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4167f-8e06-4683-9836-b13d57e3c7ff admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:18.347237 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4167f-8e06-4683-9836-b13d57e3c7ff admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:18.352771 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e223864-d512-4eb7-95ef-7a64cbc090fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:18.353431 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e223864-d512-4eb7-95ef-7a64cbc090fb admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:18.353837 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e223864-d512-4eb7-95ef-7a64cbc090fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:18.354067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e223864-d512-4eb7-95ef-7a64cbc090fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:18.354792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e223864-d512-4eb7-95ef-7a64cbc090fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:18.356462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e223864-d512-4eb7-95ef-7a64cbc090fb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:18.377277 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 907/1812] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:35:18.379856 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e223864-d512-4eb7-95ef-7a64cbc090fb admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:18.391668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e223864-d512-4eb7-95ef-7a64cbc090fb admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:18.403297 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa4106-14da-4df4-9041-64d8a27e2d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:18.404165 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa4106-14da-4df4-9041-64d8a27e2d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:18.404448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa4106-14da-4df4-9041-64d8a27e2d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:18.405385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa4106-14da-4df4-9041-64d8a27e2d26 admin admin] PATH_INFO: `/v3/projects/20215b678a0240978ad1e4ae2923a791/users/5c76c3371fbd44f9ad75d177f9d210af/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:18.446832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa4106-14da-4df4-9041-64d8a27e2d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20215b678a0240978ad1e4ae2923a791, user_id=5c76c3371fbd44f9ad75d177f9d210af, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:18.452100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa4106-14da-4df4-9041-64d8a27e2d26 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:18.540907 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-499ff36d-184a-45b6-b7cf-f753a077f60b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7d0ae86a1dd41ebac4589b555faa0f3'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:18.548952 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 908/1813] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:18 2022] PUT /identity/v3/projects/20215b678a0240978ad1e4ae2923a791/users/5c76c3371fbd44f9ad75d177f9d210af/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:18.551832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13929f66-5656-4d12-bcdd-86bd221f541c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:18.552120 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13929f66-5656-4d12-bcdd-86bd221f541c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:18.554918 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13929f66-5656-4d12-bcdd-86bd221f541c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:18.618452 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-499ff36d-184a-45b6-b7cf-f753a077f60b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7d0ae86a1dd41ebac4589b555faa0f3'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:18.618666 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-13929f66-5656-4d12-bcdd-86bd221f541c None None] MFA Rules not processed for user `5c76c3371fbd44f9ad75d177f9d210af`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:18.619911 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-13929f66-5656-4d12-bcdd-86bd221f541c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:18.649666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-499ff36d-184a-45b6-b7cf-f753a077f60b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7d0ae86a1dd41ebac4589b555faa0f3'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:18.653486 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-499ff36d-184a-45b6-b7cf-f753a077f60b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7d0ae86a1dd41ebac4589b555faa0f3'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:18.666742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-499ff36d-184a-45b6-b7cf-f753a077f60b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7d0ae86a1dd41ebac4589b555faa0f3'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:18.682077 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 906/1814] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:18 2022] DELETE /identity/v3/users/a7d0ae86a1dd41ebac4589b555faa0f3 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:18.853558 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ff36d-184a-45b6-b7cf-f753a077f60b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:18.854232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 909/1815] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:18.855202 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-499ff36d-184a-45b6-b7cf-f753a077f60b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:18.881375 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:19.010948 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ff36d-184a-45b6-b7cf-f753a077f60b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:19.016546 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a5bc9-aedf-4c23-aee2-7bf7bfc13243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:19.017208 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a5bc9-aedf-4c23-aee2-7bf7bfc13243 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:19.017486 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a5bc9-aedf-4c23-aee2-7bf7bfc13243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:19.017758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a5bc9-aedf-4c23-aee2-7bf7bfc13243 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:19.019297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a5bc9-aedf-4c23-aee2-7bf7bfc13243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:19.022444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a5bc9-aedf-4c23-aee2-7bf7bfc13243 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:19.088308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13929f66-5656-4d12-bcdd-86bd221f541c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:19.092985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-13929f66-5656-4d12-bcdd-86bd221f541c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:19.196472 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 907/1816] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:18 2022] POST /identity/v3/projects => generated 379 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:19.198944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a5bc9-aedf-4c23-aee2-7bf7bfc13243 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:19.261975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13929f66-5656-4d12-bcdd-86bd221f541c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:19.355911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a5bc9-aedf-4c23-aee2-7bf7bfc13243 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:19.365794 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27c7cb-c240-4727-bbe0-e7e5e958c22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:19.366439 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27c7cb-c240-4727-bbe0-e7e5e958c22c admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:19.366723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27c7cb-c240-4727-bbe0-e7e5e958c22c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:19.367000 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27c7cb-c240-4727-bbe0-e7e5e958c22c admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:19.367802 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27c7cb-c240-4727-bbe0-e7e5e958c22c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:19.376758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27c7cb-c240-4727-bbe0-e7e5e958c22c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:19.392282 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cffcd-cf2c-491e-9c70-3a25f599dcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:19.392839 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cffcd-cf2c-491e-9c70-3a25f599dcb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:19.394086 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cffcd-cf2c-491e-9c70-3a25f599dcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:19.394086 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cffcd-cf2c-491e-9c70-3a25f599dcb1 admin admin] PATH_INFO: `/v3/projects/2b2b47b6870c4fb798011194f0dd1085` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:19.395311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cffcd-cf2c-491e-9c70-3a25f599dcb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b2b47b6870c4fb798011194f0dd1085)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:19.396879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cffcd-cf2c-491e-9c70-3a25f599dcb1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:19.563804 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 908/1817] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:19 2022] POST /identity/v3/users => generated 290 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:19.564954 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27c7cb-c240-4727-bbe0-e7e5e958c22c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:19.569462 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2a27c7cb-c240-4727-bbe0-e7e5e958c22c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:19.586940 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-323cffcd-cf2c-491e-9c70-3a25f599dcb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b2b47b6870c4fb798011194f0dd1085', 'request_id': 'req-323cffcd-cf2c-491e-9c70-3a25f599dcb1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:19.591121 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27c7cb-c240-4727-bbe0-e7e5e958c22c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:19.594993 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-323cffcd-cf2c-491e-9c70-3a25f599dcb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b2b47b6870c4fb798011194f0dd1085', 'request_id': 'req-323cffcd-cf2c-491e-9c70-3a25f599dcb1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:19.668771 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9093e3-c5cc-471c-b9f6-f5658d8d24bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:19.669379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9093e3-c5cc-471c-b9f6-f5658d8d24bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:19.669673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9093e3-c5cc-471c-b9f6-f5658d8d24bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:19.670044 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9093e3-c5cc-471c-b9f6-f5658d8d24bf admin admin] PATH_INFO: `/v3/projects/b6a6d91980ec486d848072307526b840` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:19.671183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9093e3-c5cc-471c-b9f6-f5658d8d24bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6a6d91980ec486d848072307526b840)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:19.673216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9093e3-c5cc-471c-b9f6-f5658d8d24bf admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:19.720328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-323cffcd-cf2c-491e-9c70-3a25f599dcb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b2b47b6870c4fb798011194f0dd1085', 'request_id': 'req-323cffcd-cf2c-491e-9c70-3a25f599dcb1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:19.732773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-323cffcd-cf2c-491e-9c70-3a25f599dcb1 admin admin] The token cache is being invalidate because project 2b2b47b6870c4fb798011194f0dd1085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:19.733090 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-323cffcd-cf2c-491e-9c70-3a25f599dcb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:19.733928 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-323cffcd-cf2c-491e-9c70-3a25f599dcb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:19.735650 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 910/1818] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:19 2022] DELETE /identity/v3/projects/2b2b47b6870c4fb798011194f0dd1085 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:19.737580 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cffcd-cf2c-491e-9c70-3a25f599dcb1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:19.739081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-323cffcd-cf2c-491e-9c70-3a25f599dcb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:19.752513 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cffcd-cf2c-491e-9c70-3a25f599dcb1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:19.758301 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be9ec5-674f-4075-95cf-f34bb6e22e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:19.759593 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be9ec5-674f-4075-95cf-f34bb6e22e4c admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:19.759880 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be9ec5-674f-4075-95cf-f34bb6e22e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:19.760153 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be9ec5-674f-4075-95cf-f34bb6e22e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:19.760881 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be9ec5-674f-4075-95cf-f34bb6e22e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:19.767459 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be9ec5-674f-4075-95cf-f34bb6e22e4c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:19.781573 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 911/1819] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:19.782405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be9ec5-674f-4075-95cf-f34bb6e22e4c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:19.784677 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-37be9ec5-674f-4075-95cf-f34bb6e22e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:19.798432 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be9ec5-674f-4075-95cf-f34bb6e22e4c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:19.804121 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695650b9-cf8b-426a-bc64-f5b211d35a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:19.804780 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695650b9-cf8b-426a-bc64-f5b211d35a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:19.805166 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695650b9-cf8b-426a-bc64-f5b211d35a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:19.805451 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695650b9-cf8b-426a-bc64-f5b211d35a6d admin admin] PATH_INFO: `/v3/users/eddd622920bf49d49cefa39b8d347bbd` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:19.806578 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695650b9-cf8b-426a-bc64-f5b211d35a6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eddd622920bf49d49cefa39b8d347bbd)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:19.808617 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695650b9-cf8b-426a-bc64-f5b211d35a6d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:19.833828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6f9093e3-c5cc-471c-b9f6-f5658d8d24bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6a6d91980ec486d848072307526b840', 'request_id': 'req-6f9093e3-c5cc-471c-b9f6-f5658d8d24bf'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:19.839554 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6f9093e3-c5cc-471c-b9f6-f5658d8d24bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6a6d91980ec486d848072307526b840', 'request_id': 'req-6f9093e3-c5cc-471c-b9f6-f5658d8d24bf'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:19.929931 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6f9093e3-c5cc-471c-b9f6-f5658d8d24bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6a6d91980ec486d848072307526b840', 'request_id': 'req-6f9093e3-c5cc-471c-b9f6-f5658d8d24bf'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:19.943646 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6f9093e3-c5cc-471c-b9f6-f5658d8d24bf admin admin] The token cache is being invalidate because project b6a6d91980ec486d848072307526b840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:19.943939 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6f9093e3-c5cc-471c-b9f6-f5658d8d24bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:19.944648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6f9093e3-c5cc-471c-b9f6-f5658d8d24bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:19.946383 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 909/1820] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:19 2022] DELETE /identity/v3/projects/b6a6d91980ec486d848072307526b840 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:19.947139 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9093e3-c5cc-471c-b9f6-f5658d8d24bf admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:19.948530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6f9093e3-c5cc-471c-b9f6-f5658d8d24bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:20.015514 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9093e3-c5cc-471c-b9f6-f5658d8d24bf admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:20.021355 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ea4e6-75de-4eb3-a7fd-7fc6d2e8d110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:20.023577 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ea4e6-75de-4eb3-a7fd-7fc6d2e8d110 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:20.023577 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ea4e6-75de-4eb3-a7fd-7fc6d2e8d110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:20.023577 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ea4e6-75de-4eb3-a7fd-7fc6d2e8d110 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:20.023577 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ea4e6-75de-4eb3-a7fd-7fc6d2e8d110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:20.024943 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ea4e6-75de-4eb3-a7fd-7fc6d2e8d110 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:20.043413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 910/1821] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:20.043413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdf584-966e-47ca-a332-56f1d2e5b58b None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:20.043413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdf584-966e-47ca-a332-56f1d2e5b58b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:20.043413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdf584-966e-47ca-a332-56f1d2e5b58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:20.069894 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:20.074616 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-80cdf584-966e-47ca-a332-56f1d2e5b58b None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:20.075838 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-80cdf584-966e-47ca-a332-56f1d2e5b58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:20.083763 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-695650b9-cf8b-426a-bc64-f5b211d35a6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eddd622920bf49d49cefa39b8d347bbd'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:20.084665 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-695650b9-cf8b-426a-bc64-f5b211d35a6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eddd622920bf49d49cefa39b8d347bbd'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:20.085092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 911/1822] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:20.085882 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cdf584-966e-47ca-a332-56f1d2e5b58b None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:20.101837 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cdf584-966e-47ca-a332-56f1d2e5b58b None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:20.113783 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7877be-0674-40b6-a8f4-a3482dd949c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:20.113783 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7877be-0674-40b6-a8f4-a3482dd949c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:20.113783 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7877be-0674-40b6-a8f4-a3482dd949c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:20.113783 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7877be-0674-40b6-a8f4-a3482dd949c3 admin admin] PATH_INFO: `/v3/projects/dd61366c17c94030be0a2ba9c085789f/users/461cbbd3715d4d488066ed41ca107841/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:20.139105 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7877be-0674-40b6-a8f4-a3482dd949c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd61366c17c94030be0a2ba9c085789f, user_id=461cbbd3715d4d488066ed41ca107841, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:20.142318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7877be-0674-40b6-a8f4-a3482dd949c3 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:20.529587 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-695650b9-cf8b-426a-bc64-f5b211d35a6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eddd622920bf49d49cefa39b8d347bbd'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:20.537318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 912/1823] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:20 2022] PUT /identity/v3/projects/dd61366c17c94030be0a2ba9c085789f/users/461cbbd3715d4d488066ed41ca107841/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:20.546520 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a966f-02a1-45b1-ab1e-c7fbee2cdb43 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:20.546520 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a966f-02a1-45b1-ab1e-c7fbee2cdb43 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:20.546520 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a966f-02a1-45b1-ab1e-c7fbee2cdb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:20.546738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-695650b9-cf8b-426a-bc64-f5b211d35a6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eddd622920bf49d49cefa39b8d347bbd'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:20.546738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-695650b9-cf8b-426a-bc64-f5b211d35a6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eddd622920bf49d49cefa39b8d347bbd'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:20.557618 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 912/1824] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:19 2022] DELETE /identity/v3/users/eddd622920bf49d49cefa39b8d347bbd => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:20.559147 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f381b-3739-4a50-805c-55fee91722a7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:20.559436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f381b-3739-4a50-805c-55fee91722a7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:20.559713 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f381b-3739-4a50-805c-55fee91722a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:20.586017 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-273a966f-02a1-45b1-ab1e-c7fbee2cdb43 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:20.587290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-273a966f-02a1-45b1-ab1e-c7fbee2cdb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:20.590077 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-319f381b-3739-4a50-805c-55fee91722a7 None None] MFA Rules not processed for user `461cbbd3715d4d488066ed41ca107841`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:20.591380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-319f381b-3739-4a50-805c-55fee91722a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:20.682708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 913/1825] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:20.685182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 913/1826] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:20.686782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a966f-02a1-45b1-ab1e-c7fbee2cdb43 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:20.689302 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f381b-3739-4a50-805c-55fee91722a7 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:20.691040 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-319f381b-3739-4a50-805c-55fee91722a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:20.699726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a966f-02a1-45b1-ab1e-c7fbee2cdb43 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:20.706347 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbce2fb-b9ce-47de-8983-eebbf2a06c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:20.707371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f381b-3739-4a50-805c-55fee91722a7 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:20.708325 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbce2fb-b9ce-47de-8983-eebbf2a06c46 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:20.708325 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbce2fb-b9ce-47de-8983-eebbf2a06c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:20.708325 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbce2fb-b9ce-47de-8983-eebbf2a06c46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:20.709782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbce2fb-b9ce-47de-8983-eebbf2a06c46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:35:20.710200 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbce2fb-b9ce-47de-8983-eebbf2a06c46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:20.712551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953586e1-20fe-4b01-934b-0463c6e8e05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:20.712854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbce2fb-b9ce-47de-8983-eebbf2a06c46 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:20.713365 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953586e1-20fe-4b01-934b-0463c6e8e05f admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:20.713718 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953586e1-20fe-4b01-934b-0463c6e8e05f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:20.714054 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953586e1-20fe-4b01-934b-0463c6e8e05f admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:20.714861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953586e1-20fe-4b01-934b-0463c6e8e05f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:20.717562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953586e1-20fe-4b01-934b-0463c6e8e05f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:20.727896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 914/1827] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:35:20.733916 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbce2fb-b9ce-47de-8983-eebbf2a06c46 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:20.747011 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbce2fb-b9ce-47de-8983-eebbf2a06c46 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:20.751891 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614801b6-a909-45f4-b0c8-7b753eae7b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:20.752552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614801b6-a909-45f4-b0c8-7b753eae7b6f admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:20.753031 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614801b6-a909-45f4-b0c8-7b753eae7b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:20.753518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614801b6-a909-45f4-b0c8-7b753eae7b6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:20.754480 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614801b6-a909-45f4-b0c8-7b753eae7b6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:20.756708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614801b6-a909-45f4-b0c8-7b753eae7b6f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:20.815088 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 914/1828] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:20 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:20.816499 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953586e1-20fe-4b01-934b-0463c6e8e05f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:20.844983 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 915/1829] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:20 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:20.852500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614801b6-a909-45f4-b0c8-7b753eae7b6f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:20.901017 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953586e1-20fe-4b01-934b-0463c6e8e05f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:20.936758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614801b6-a909-45f4-b0c8-7b753eae7b6f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:20.939721 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d386b44-d641-4929-b942-cead8c688e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:20.940405 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d386b44-d641-4929-b942-cead8c688e73 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:20.940685 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d386b44-d641-4929-b942-cead8c688e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:20.941039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d386b44-d641-4929-b942-cead8c688e73 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:20.941743 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d386b44-d641-4929-b942-cead8c688e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:20.943751 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d386b44-d641-4929-b942-cead8c688e73 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:20.970005 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbbc71-1110-450f-b412-348a4997983b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:20.970629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbbc71-1110-450f-b412-348a4997983b admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:20.970912 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbbc71-1110-450f-b412-348a4997983b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:20.971214 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbbc71-1110-450f-b412-348a4997983b admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:20.972442 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fbbc71-1110-450f-b412-348a4997983b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:20.974453 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fbbc71-1110-450f-b412-348a4997983b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:21.093004 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 916/1830] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:20 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:21.093004 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d386b44-d641-4929-b942-cead8c688e73 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:21.096941 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5d386b44-d641-4929-b942-cead8c688e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:21.108188 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d386b44-d641-4929-b942-cead8c688e73 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:21.114517 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db2840-0a85-4f1d-96d2-ed3a4db8ec92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:21.116730 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db2840-0a85-4f1d-96d2-ed3a4db8ec92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:21.117425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db2840-0a85-4f1d-96d2-ed3a4db8ec92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:21.117599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db2840-0a85-4f1d-96d2-ed3a4db8ec92 admin admin] PATH_INFO: `/v3/users/b63040a3e42e43568ea27d12f9a15322` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:21.121328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 915/1831] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:20 2022] POST /identity/v3/users => generated 295 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:35:21.122269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbbc71-1110-450f-b412-348a4997983b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:21.122959 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db2840-0a85-4f1d-96d2-ed3a4db8ec92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b63040a3e42e43568ea27d12f9a15322)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:21.124044 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-36fbbc71-1110-450f-b412-348a4997983b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:21.125089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db2840-0a85-4f1d-96d2-ed3a4db8ec92 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:21.136629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbbc71-1110-450f-b412-348a4997983b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:21.142287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21178d-4624-4e29-9012-23e455baa156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:21.142922 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21178d-4624-4e29-9012-23e455baa156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:21.143733 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21178d-4624-4e29-9012-23e455baa156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:21.144008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21178d-4624-4e29-9012-23e455baa156 admin admin] PATH_INFO: `/v3/projects/72abe8bf64b44a5a8f2b12f0aef11401` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:21.145160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21178d-4624-4e29-9012-23e455baa156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72abe8bf64b44a5a8f2b12f0aef11401)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:21.147060 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21178d-4624-4e29-9012-23e455baa156 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:21.341902 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a2db2840-0a85-4f1d-96d2-ed3a4db8ec92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b63040a3e42e43568ea27d12f9a15322'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:21.342787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6a21178d-4624-4e29-9012-23e455baa156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72abe8bf64b44a5a8f2b12f0aef11401', 'request_id': 'req-6a21178d-4624-4e29-9012-23e455baa156'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:21.350293 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6a21178d-4624-4e29-9012-23e455baa156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72abe8bf64b44a5a8f2b12f0aef11401', 'request_id': 'req-6a21178d-4624-4e29-9012-23e455baa156'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:21.512821 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a2db2840-0a85-4f1d-96d2-ed3a4db8ec92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b63040a3e42e43568ea27d12f9a15322'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:21.525555 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a2db2840-0a85-4f1d-96d2-ed3a4db8ec92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b63040a3e42e43568ea27d12f9a15322'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:21.526212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a2db2840-0a85-4f1d-96d2-ed3a4db8ec92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b63040a3e42e43568ea27d12f9a15322'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:21.533330 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a2db2840-0a85-4f1d-96d2-ed3a4db8ec92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b63040a3e42e43568ea27d12f9a15322'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:21.540065 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 917/1832] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:21 2022] DELETE /identity/v3/users/b63040a3e42e43568ea27d12f9a15322 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:21.543602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db2840-0a85-4f1d-96d2-ed3a4db8ec92 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:21.543602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a2db2840-0a85-4f1d-96d2-ed3a4db8ec92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:21.610511 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db2840-0a85-4f1d-96d2-ed3a4db8ec92 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:21.616337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a4d81-c9bb-40c7-b569-18df8fc951e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:21.616967 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a4d81-c9bb-40c7-b569-18df8fc951e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:21.617276 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a4d81-c9bb-40c7-b569-18df8fc951e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:21.617548 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a4d81-c9bb-40c7-b569-18df8fc951e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:21.618207 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a4d81-c9bb-40c7-b569-18df8fc951e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:21.619917 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2a4d81-c9bb-40c7-b569-18df8fc951e4 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:21.630005 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 918/1833] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:21.632000 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a4d81-c9bb-40c7-b569-18df8fc951e4 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:21.632451 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9f2a4d81-c9bb-40c7-b569-18df8fc951e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:21.645633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a4d81-c9bb-40c7-b569-18df8fc951e4 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:21.650157 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecf278-24bf-48be-9e81-219db934e191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:21.650774 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecf278-24bf-48be-9e81-219db934e191 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:21.651045 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecf278-24bf-48be-9e81-219db934e191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:21.651313 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecf278-24bf-48be-9e81-219db934e191 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:21.651938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecf278-24bf-48be-9e81-219db934e191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:21.652194 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6a21178d-4624-4e29-9012-23e455baa156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72abe8bf64b44a5a8f2b12f0aef11401', 'request_id': 'req-6a21178d-4624-4e29-9012-23e455baa156'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:21.653566 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecf278-24bf-48be-9e81-219db934e191 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:21.664359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 919/1834] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:21.665686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b94c2-e4fd-4389-9c64-385e5fbf99e9 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:21.665958 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b94c2-e4fd-4389-9c64-385e5fbf99e9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:21.666234 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b94c2-e4fd-4389-9c64-385e5fbf99e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:21.666649 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6a21178d-4624-4e29-9012-23e455baa156 admin admin] The token cache is being invalidate because project 72abe8bf64b44a5a8f2b12f0aef11401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:21.666946 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6a21178d-4624-4e29-9012-23e455baa156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:21.667849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6a21178d-4624-4e29-9012-23e455baa156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:21.669362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 916/1835] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:21 2022] DELETE /identity/v3/projects/72abe8bf64b44a5a8f2b12f0aef11401 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:21.670743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21178d-4624-4e29-9012-23e455baa156 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:21.678859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6a21178d-4624-4e29-9012-23e455baa156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:21.687250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-5d6b94c2-e4fd-4389-9c64-385e5fbf99e9 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:21.688454 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5d6b94c2-e4fd-4389-9c64-385e5fbf99e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:21.696950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 920/1836] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:21.697900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b94c2-e4fd-4389-9c64-385e5fbf99e9 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:21.699159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5d6b94c2-e4fd-4389-9c64-385e5fbf99e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:21.714032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b94c2-e4fd-4389-9c64-385e5fbf99e9 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:21.723088 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481de8d-05e9-4ae5-81b6-47fdd755cebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:21.723718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481de8d-05e9-4ae5-81b6-47fdd755cebe admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:21.724031 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481de8d-05e9-4ae5-81b6-47fdd755cebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:21.724401 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481de8d-05e9-4ae5-81b6-47fdd755cebe admin admin] PATH_INFO: `/v3/projects/d65805401c204f4792b4ea13edf942b1/users/9c640e788c114bcab0bbe4ddaa6474db/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:21.741413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481de8d-05e9-4ae5-81b6-47fdd755cebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d65805401c204f4792b4ea13edf942b1, user_id=9c640e788c114bcab0bbe4ddaa6474db, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:21.744184 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481de8d-05e9-4ae5-81b6-47fdd755cebe admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:21.752469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21178d-4624-4e29-9012-23e455baa156 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:21.757480 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30994b22-8ddc-4687-a169-c316089acccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:21.758104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30994b22-8ddc-4687-a169-c316089acccb admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:21.758410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30994b22-8ddc-4687-a169-c316089acccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:21.758692 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30994b22-8ddc-4687-a169-c316089acccb admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:21.759399 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30994b22-8ddc-4687-a169-c316089acccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:21.761071 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30994b22-8ddc-4687-a169-c316089acccb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:21.775482 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 917/1837] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:21.775482 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed231c00-c595-4e7d-b16b-06b418d73f60 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:21.775482 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed231c00-c595-4e7d-b16b-06b418d73f60 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:21.775482 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed231c00-c595-4e7d-b16b-06b418d73f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:21.795593 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ed231c00-c595-4e7d-b16b-06b418d73f60 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:21.797181 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ed231c00-c595-4e7d-b16b-06b418d73f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:21.818325 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 918/1838] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:21.818325 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed231c00-c595-4e7d-b16b-06b418d73f60 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:21.818325 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ed231c00-c595-4e7d-b16b-06b418d73f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:21.833691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 921/1839] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:21 2022] PUT /identity/v3/projects/d65805401c204f4792b4ea13edf942b1/users/9c640e788c114bcab0bbe4ddaa6474db/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:21.835013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481de8d-05e9-4ae5-81b6-47fdd755cebe admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:21.920679 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed231c00-c595-4e7d-b16b-06b418d73f60 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:21.932476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481de8d-05e9-4ae5-81b6-47fdd755cebe admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:21.937996 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ec71c-f4b3-4123-86f7-eca71e195a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:21.938669 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ec71c-f4b3-4123-86f7-eca71e195a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:21.938947 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ec71c-f4b3-4123-86f7-eca71e195a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:21.939216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ec71c-f4b3-4123-86f7-eca71e195a99 admin admin] PATH_INFO: `/v3/projects/624a6d87c34e4c5ebc1e85470ef84b65/users/fce34e0b9b0248fb8fb192e21f809ed5/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:21.960346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ec71c-f4b3-4123-86f7-eca71e195a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=624a6d87c34e4c5ebc1e85470ef84b65, user_id=fce34e0b9b0248fb8fb192e21f809ed5, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:21.963250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ec71c-f4b3-4123-86f7-eca71e195a99 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:21.986353 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc892c6-5135-4a7f-9a58-2de686d5427c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:21.987436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc892c6-5135-4a7f-9a58-2de686d5427c service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:21.987936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc892c6-5135-4a7f-9a58-2de686d5427c service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:21.988414 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc892c6-5135-4a7f-9a58-2de686d5427c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:22.000880 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc892c6-5135-4a7f-9a58-2de686d5427c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:22.003164 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc892c6-5135-4a7f-9a58-2de686d5427c service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:22.014316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 919/1840] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:22.015943 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc4fd2-6b47-460d-be7d-9e2fc88223d2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:22.016331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc4fd2-6b47-460d-be7d-9e2fc88223d2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:22.016774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc4fd2-6b47-460d-be7d-9e2fc88223d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:22.043631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-bcdc4fd2-6b47-460d-be7d-9e2fc88223d2 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:22.044905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bcdc4fd2-6b47-460d-be7d-9e2fc88223d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:22.053268 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 920/1841] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:22.054191 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc4fd2-6b47-460d-be7d-9e2fc88223d2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:22.066296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 922/1842] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:21 2022] PUT /identity/v3/projects/624a6d87c34e4c5ebc1e85470ef84b65/users/fce34e0b9b0248fb8fb192e21f809ed5/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:22.067774 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ec71c-f4b3-4123-86f7-eca71e195a99 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:22.067899 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc4fd2-6b47-460d-be7d-9e2fc88223d2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:22.149527 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ec71c-f4b3-4123-86f7-eca71e195a99 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:22.156833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cf3a1-00de-49b6-9db9-7afb33e2e852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:22.157639 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cf3a1-00de-49b6-9db9-7afb33e2e852 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:22.158107 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cf3a1-00de-49b6-9db9-7afb33e2e852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:22.158532 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cf3a1-00de-49b6-9db9-7afb33e2e852 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:22.159440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cf3a1-00de-49b6-9db9-7afb33e2e852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:35:22.160103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cf3a1-00de-49b6-9db9-7afb33e2e852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:22.161454 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7ffeb-ee84-42df-97d0-f3c050cf6df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:22.162157 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cf3a1-00de-49b6-9db9-7afb33e2e852 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:22.162290 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7ffeb-ee84-42df-97d0-f3c050cf6df9 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:22.162462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7ffeb-ee84-42df-97d0-f3c050cf6df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:22.162858 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7ffeb-ee84-42df-97d0-f3c050cf6df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:22.163900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7ffeb-ee84-42df-97d0-f3c050cf6df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:22.166228 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7ffeb-ee84-42df-97d0-f3c050cf6df9 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:22.182324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 923/1843] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:35:22.185959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 921/1844] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:22.188710 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7ffeb-ee84-42df-97d0-f3c050cf6df9 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:22.189140 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5294f6-58ea-4412-a3fc-0c0b9e2caa4d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:22.189668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5294f6-58ea-4412-a3fc-0c0b9e2caa4d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:22.190757 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5294f6-58ea-4412-a3fc-0c0b9e2caa4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:22.211285 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7ffeb-ee84-42df-97d0-f3c050cf6df9 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:22.218939 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06c188-a985-4d30-84f8-36fdf18a7d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:22.220124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06c188-a985-4d30-84f8-36fdf18a7d74 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:22.220124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06c188-a985-4d30-84f8-36fdf18a7d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:22.220318 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06c188-a985-4d30-84f8-36fdf18a7d74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:22.220994 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06c188-a985-4d30-84f8-36fdf18a7d74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:22.223798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06c188-a985-4d30-84f8-36fdf18a7d74 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:22.226109 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-be5294f6-58ea-4412-a3fc-0c0b9e2caa4d None None] MFA Rules not processed for user `fce34e0b9b0248fb8fb192e21f809ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:22.227634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-be5294f6-58ea-4412-a3fc-0c0b9e2caa4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:22.308232 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 924/1845] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:22.309275 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5294f6-58ea-4412-a3fc-0c0b9e2caa4d None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:22.324960 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5294f6-58ea-4412-a3fc-0c0b9e2caa4d None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:22.329742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73c118-1a75-45ed-ab73-33865b26f2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:22.330394 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73c118-1a75-45ed-ab73-33865b26f2d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:22.331348 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73c118-1a75-45ed-ab73-33865b26f2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:22.331626 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73c118-1a75-45ed-ab73-33865b26f2d6 admin admin] PATH_INFO: `/v3/projects/d65805401c204f4792b4ea13edf942b1/users/9c640e788c114bcab0bbe4ddaa6474db/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:22.333875 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73c118-1a75-45ed-ab73-33865b26f2d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d65805401c204f4792b4ea13edf942b1, user_id=9c640e788c114bcab0bbe4ddaa6474db, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:22.337415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73c118-1a75-45ed-ab73-33865b26f2d6 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:22.349592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 925/1846] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:22 2022] PUT /identity/v3/projects/d65805401c204f4792b4ea13edf942b1/users/9c640e788c114bcab0bbe4ddaa6474db/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:22.350551 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73c118-1a75-45ed-ab73-33865b26f2d6 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:22.374539 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 922/1847] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:22 2022] POST /identity/v3/projects => generated 363 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:22.376891 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e90472-b424-4b1f-abea-be97b1454a34 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:22.377217 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e90472-b424-4b1f-abea-be97b1454a34 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:22.378182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e90472-b424-4b1f-abea-be97b1454a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:22.441649 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-89e90472-b424-4b1f-abea-be97b1454a34 None None] MFA Rules not processed for user `9c640e788c114bcab0bbe4ddaa6474db`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:22.443155 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-89e90472-b424-4b1f-abea-be97b1454a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:22.471087 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73c118-1a75-45ed-ab73-33865b26f2d6 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:22.562123 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667f343-ae9b-4605-b5e3-e7f107cbb378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:22.562851 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667f343-ae9b-4605-b5e3-e7f107cbb378 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:22.563105 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667f343-ae9b-4605-b5e3-e7f107cbb378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:22.563484 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667f343-ae9b-4605-b5e3-e7f107cbb378 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:22.565032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667f343-ae9b-4605-b5e3-e7f107cbb378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:22.569630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667f343-ae9b-4605-b5e3-e7f107cbb378 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:22.572499 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 923/1848] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:22.573517 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e90472-b424-4b1f-abea-be97b1454a34 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:22.608035 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e90472-b424-4b1f-abea-be97b1454a34 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:22.623117 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f394760-39d7-480f-a3db-98dfa54f5571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:22.623745 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f394760-39d7-480f-a3db-98dfa54f5571 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:22.624019 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f394760-39d7-480f-a3db-98dfa54f5571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:22.624286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f394760-39d7-480f-a3db-98dfa54f5571 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:22.624927 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f394760-39d7-480f-a3db-98dfa54f5571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:22.627042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f394760-39d7-480f-a3db-98dfa54f5571 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:22.695883 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 926/1849] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:22 2022] POST /identity/v3/projects => generated 385 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:22.696899 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667f343-ae9b-4605-b5e3-e7f107cbb378 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:22.698774 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3667f343-ae9b-4605-b5e3-e7f107cbb378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:22.762916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 924/1850] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:22 2022] POST /identity/v3/users => generated 282 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:22.763764 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f394760-39d7-480f-a3db-98dfa54f5571 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:22.777870 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f394760-39d7-480f-a3db-98dfa54f5571 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:22.786948 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667f343-ae9b-4605-b5e3-e7f107cbb378 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:22.795289 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0fa81-793e-4246-ac02-e51cacafea76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:22.795932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0fa81-793e-4246-ac02-e51cacafea76 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:22.796258 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0fa81-793e-4246-ac02-e51cacafea76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:22.796547 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0fa81-793e-4246-ac02-e51cacafea76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:22.823875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:22.898639 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701ed5d-8e49-4cbf-aca8-e47511f67e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:22.899254 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701ed5d-8e49-4cbf-aca8-e47511f67e46 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:22.899541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701ed5d-8e49-4cbf-aca8-e47511f67e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:22.899869 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701ed5d-8e49-4cbf-aca8-e47511f67e46 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:22.900043 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0fa81-793e-4246-ac02-e51cacafea76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:22.900577 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701ed5d-8e49-4cbf-aca8-e47511f67e46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:22.901662 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0fa81-793e-4246-ac02-e51cacafea76 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:22.902567 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701ed5d-8e49-4cbf-aca8-e47511f67e46 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:22.908586 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:22.915074 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 927/1851] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:22.917366 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0fa81-793e-4246-ac02-e51cacafea76 service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:22.933340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0fa81-793e-4246-ac02-e51cacafea76 service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:22.939030 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe6853-adb5-4e8b-8a50-09b0eb2860c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:22.940565 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe6853-adb5-4e8b-8a50-09b0eb2860c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:22.940565 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe6853-adb5-4e8b-8a50-09b0eb2860c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:22.940730 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe6853-adb5-4e8b-8a50-09b0eb2860c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:22.941432 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe6853-adb5-4e8b-8a50-09b0eb2860c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:22.943064 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe6853-adb5-4e8b-8a50-09b0eb2860c1 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:22.952936 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 928/1852] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:22.953748 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe6853-adb5-4e8b-8a50-09b0eb2860c1 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:22.955323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-bebe6853-adb5-4e8b-8a50-09b0eb2860c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:22.968371 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe6853-adb5-4e8b-8a50-09b0eb2860c1 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:22.975910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226c9f0-a724-40c4-b448-5fc3c1047e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:22.975910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226c9f0-a724-40c4-b448-5fc3c1047e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:22.975910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226c9f0-a724-40c4-b448-5fc3c1047e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:22.975910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226c9f0-a724-40c4-b448-5fc3c1047e32 admin admin] PATH_INFO: `/v3/projects/ad2d0863809349c6982151d67b390613` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:22.976284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226c9f0-a724-40c4-b448-5fc3c1047e32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad2d0863809349c6982151d67b390613)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:22.977236 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226c9f0-a724-40c4-b448-5fc3c1047e32 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:23.057434 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 925/1853] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:22 2022] POST /identity/v3/users => generated 299 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:23.057434 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701ed5d-8e49-4cbf-aca8-e47511f67e46 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:23.070580 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701ed5d-8e49-4cbf-aca8-e47511f67e46 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:23.075667 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac19c3-2830-4ecc-a451-2fdd1724e813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:23.076287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac19c3-2830-4ecc-a451-2fdd1724e813 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:23.076571 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac19c3-2830-4ecc-a451-2fdd1724e813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:23.076844 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac19c3-2830-4ecc-a451-2fdd1724e813 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:23.077529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac19c3-2830-4ecc-a451-2fdd1724e813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:23.079164 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac19c3-2830-4ecc-a451-2fdd1724e813 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:23.090408 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 926/1854] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:23.091424 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac19c3-2830-4ecc-a451-2fdd1724e813 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:23.101792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac19c3-2830-4ecc-a451-2fdd1724e813 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:23.106809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a195c8e-b33c-45a9-a54c-dd15bf53e23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:23.107812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a195c8e-b33c-45a9-a54c-dd15bf53e23f admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:23.108101 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a195c8e-b33c-45a9-a54c-dd15bf53e23f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:23.108375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a195c8e-b33c-45a9-a54c-dd15bf53e23f admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:23.109017 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a195c8e-b33c-45a9-a54c-dd15bf53e23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:23.110657 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a195c8e-b33c-45a9-a54c-dd15bf53e23f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:23.124148 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 927/1855] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:23.125866 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a195c8e-b33c-45a9-a54c-dd15bf53e23f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:23.128715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3a195c8e-b33c-45a9-a54c-dd15bf53e23f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:23.142474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a195c8e-b33c-45a9-a54c-dd15bf53e23f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:23.149176 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e226c9f0-a724-40c4-b448-5fc3c1047e32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad2d0863809349c6982151d67b390613', 'request_id': 'req-e226c9f0-a724-40c4-b448-5fc3c1047e32'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:23.155001 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e226c9f0-a724-40c4-b448-5fc3c1047e32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad2d0863809349c6982151d67b390613', 'request_id': 'req-e226c9f0-a724-40c4-b448-5fc3c1047e32'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:23.197907 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d4cf5-5ef3-4d9d-aa6f-6915714041a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:23.198517 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d4cf5-5ef3-4d9d-aa6f-6915714041a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:23.198798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d4cf5-5ef3-4d9d-aa6f-6915714041a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:23.199074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d4cf5-5ef3-4d9d-aa6f-6915714041a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:23.200930 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-554d4cf5-5ef3-4d9d-aa6f-6915714041a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:23.259002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d4cf5-5ef3-4d9d-aa6f-6915714041a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:23.260422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d4cf5-5ef3-4d9d-aa6f-6915714041a2 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:23.269332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 928/1856] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:23.270102 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d4cf5-5ef3-4d9d-aa6f-6915714041a2 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:23.335773 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e226c9f0-a724-40c4-b448-5fc3c1047e32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad2d0863809349c6982151d67b390613', 'request_id': 'req-e226c9f0-a724-40c4-b448-5fc3c1047e32'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:23.335959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d4cf5-5ef3-4d9d-aa6f-6915714041a2 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:23.338710 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2444d7-e03e-4c53-8f87-4bdbe43fcd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:23.339554 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2444d7-e03e-4c53-8f87-4bdbe43fcd46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:23.339886 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2444d7-e03e-4c53-8f87-4bdbe43fcd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:23.340275 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2444d7-e03e-4c53-8f87-4bdbe43fcd46 admin admin] PATH_INFO: `/v3/projects/0fd61cd096164b8785f75279916bf3a7/users/7642fb95b84f44dab4bca9ead1127b90/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:23.342742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e226c9f0-a724-40c4-b448-5fc3c1047e32 admin admin] The token cache is being invalidate because project ad2d0863809349c6982151d67b390613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:23.343131 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e226c9f0-a724-40c4-b448-5fc3c1047e32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:23.343852 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e226c9f0-a724-40c4-b448-5fc3c1047e32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:23.345450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 929/1857] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:22 2022] DELETE /identity/v3/projects/ad2d0863809349c6982151d67b390613 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:23.348509 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226c9f0-a724-40c4-b448-5fc3c1047e32 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:23.348509 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e226c9f0-a724-40c4-b448-5fc3c1047e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:23.355591 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2444d7-e03e-4c53-8f87-4bdbe43fcd46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd61cd096164b8785f75279916bf3a7, user_id=7642fb95b84f44dab4bca9ead1127b90, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:23.358494 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2444d7-e03e-4c53-8f87-4bdbe43fcd46 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:23.360291 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226c9f0-a724-40c4-b448-5fc3c1047e32 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:23.365742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856a3a5-8f31-4fd5-9551-b708f1d9cef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:23.366377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856a3a5-8f31-4fd5-9551-b708f1d9cef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:23.366655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856a3a5-8f31-4fd5-9551-b708f1d9cef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:23.366929 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856a3a5-8f31-4fd5-9551-b708f1d9cef9 admin admin] PATH_INFO: `/v3/projects/45b993b976ad496a9a09cc223fe078b9/users/e13634357c584df082fd92a6531099d5/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:23.382097 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856a3a5-8f31-4fd5-9551-b708f1d9cef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45b993b976ad496a9a09cc223fe078b9, user_id=e13634357c584df082fd92a6531099d5, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:23.384828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856a3a5-8f31-4fd5-9551-b708f1d9cef9 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:23.473637 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 930/1858] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:23 2022] PUT /identity/v3/projects/45b993b976ad496a9a09cc223fe078b9/users/e13634357c584df082fd92a6531099d5/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:23.482279 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856a3a5-8f31-4fd5-9551-b708f1d9cef9 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:23.482799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 929/1859] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:23 2022] PUT /identity/v3/projects/0fd61cd096164b8785f75279916bf3a7/users/7642fb95b84f44dab4bca9ead1127b90/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:23.482907 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1856a3a5-8f31-4fd5-9551-b708f1d9cef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:23.493766 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2444d7-e03e-4c53-8f87-4bdbe43fcd46 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:23.560510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856a3a5-8f31-4fd5-9551-b708f1d9cef9 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:23.583915 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2444d7-e03e-4c53-8f87-4bdbe43fcd46 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:23.591087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf0d6c-981b-41c5-bf15-db7a596c8d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:23.591728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf0d6c-981b-41c5-bf15-db7a596c8d39 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:23.592023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf0d6c-981b-41c5-bf15-db7a596c8d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:23.592284 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf0d6c-981b-41c5-bf15-db7a596c8d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:23.592929 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf0d6c-981b-41c5-bf15-db7a596c8d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:23.594740 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf0d6c-981b-41c5-bf15-db7a596c8d39 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:23.606241 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 930/1860] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:23.607653 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69839b27-5398-4281-bc3d-cf6f2cc7424c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:23.607946 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69839b27-5398-4281-bc3d-cf6f2cc7424c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:23.608226 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69839b27-5398-4281-bc3d-cf6f2cc7424c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:23.636360 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc001da3-f529-4133-a6a9-6779ece30fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:23.636955 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc001da3-f529-4133-a6a9-6779ece30fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:23.637263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc001da3-f529-4133-a6a9-6779ece30fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:23.637536 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc001da3-f529-4133-a6a9-6779ece30fd6 admin admin] PATH_INFO: `/v3/users/ff6adccf6bf34053bdd1ab36f9a64664` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:23.639649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc001da3-f529-4133-a6a9-6779ece30fd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff6adccf6bf34053bdd1ab36f9a64664)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:23.642045 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc001da3-f529-4133-a6a9-6779ece30fd6 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:23.650098 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-69839b27-5398-4281-bc3d-cf6f2cc7424c None None] MFA Rules not processed for user `7642fb95b84f44dab4bca9ead1127b90`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:23.651526 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-69839b27-5398-4281-bc3d-cf6f2cc7424c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:23.731322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 931/1861] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:23.732474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69839b27-5398-4281-bc3d-cf6f2cc7424c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:23.748153 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69839b27-5398-4281-bc3d-cf6f2cc7424c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:23.753768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa1138-3671-41be-9f41-96d35c2f44a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:23.754437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa1138-3671-41be-9f41-96d35c2f44a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:23.754720 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa1138-3671-41be-9f41-96d35c2f44a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:23.755014 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa1138-3671-41be-9f41-96d35c2f44a5 admin admin] PATH_INFO: `/v3/projects/45b993b976ad496a9a09cc223fe078b9/users/e13634357c584df082fd92a6531099d5/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:23.757013 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa1138-3671-41be-9f41-96d35c2f44a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45b993b976ad496a9a09cc223fe078b9, user_id=e13634357c584df082fd92a6531099d5, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:23.760071 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa1138-3671-41be-9f41-96d35c2f44a5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:23.771132 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 932/1862] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:23 2022] PUT /identity/v3/projects/45b993b976ad496a9a09cc223fe078b9/users/e13634357c584df082fd92a6531099d5/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:23.771864 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa1138-3671-41be-9f41-96d35c2f44a5 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:23.778960 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-43fa1138-3671-41be-9f41-96d35c2f44a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:23.868373 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa1138-3671-41be-9f41-96d35c2f44a5 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:23.869220 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fc001da3-f529-4133-a6a9-6779ece30fd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff6adccf6bf34053bdd1ab36f9a64664'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:23.874452 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06306da-7a18-4ced-9300-5faffea9c13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:23.876722 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06306da-7a18-4ced-9300-5faffea9c13c admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:23.877099 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06306da-7a18-4ced-9300-5faffea9c13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:23.877500 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06306da-7a18-4ced-9300-5faffea9c13c admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:23.878224 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06306da-7a18-4ced-9300-5faffea9c13c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:23.880225 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06306da-7a18-4ced-9300-5faffea9c13c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:23.886370 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:23.970118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fc001da3-f529-4133-a6a9-6779ece30fd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff6adccf6bf34053bdd1ab36f9a64664'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:23.982932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 933/1863] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:23 2022] POST /identity/v3/projects => generated 365 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:23.984520 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a210ea-cfee-4a80-a8d8-6ff290de0c18 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:23.985284 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a210ea-cfee-4a80-a8d8-6ff290de0c18 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:23.985910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a210ea-cfee-4a80-a8d8-6ff290de0c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:23.986296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fc001da3-f529-4133-a6a9-6779ece30fd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff6adccf6bf34053bdd1ab36f9a64664'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:23.987685 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fc001da3-f529-4133-a6a9-6779ece30fd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff6adccf6bf34053bdd1ab36f9a64664'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:23.999330 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fc001da3-f529-4133-a6a9-6779ece30fd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff6adccf6bf34053bdd1ab36f9a64664'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:24.006302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 931/1864] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:23 2022] DELETE /identity/v3/users/ff6adccf6bf34053bdd1ab36f9a64664 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:24.007301 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc001da3-f529-4133-a6a9-6779ece30fd6 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:24.008455 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fc001da3-f529-4133-a6a9-6779ece30fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:24.040082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-40a210ea-cfee-4a80-a8d8-6ff290de0c18 None None] MFA Rules not processed for user `e13634357c584df082fd92a6531099d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:24.041360 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-40a210ea-cfee-4a80-a8d8-6ff290de0c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:24.100255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc001da3-f529-4133-a6a9-6779ece30fd6 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:24.106419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2a0a3-14d7-43ef-94a2-1c36488dd110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:24.107052 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2a0a3-14d7-43ef-94a2-1c36488dd110 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:24.107332 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2a0a3-14d7-43ef-94a2-1c36488dd110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:24.107606 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2a0a3-14d7-43ef-94a2-1c36488dd110 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:24.108314 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2a0a3-14d7-43ef-94a2-1c36488dd110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:24.110318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2a0a3-14d7-43ef-94a2-1c36488dd110 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:24.173582 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 934/1865] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:24.179436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a210ea-cfee-4a80-a8d8-6ff290de0c18 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:24.179788 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-40a210ea-cfee-4a80-a8d8-6ff290de0c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:24.210906 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 932/1866] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:24 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:24.214909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2a0a3-14d7-43ef-94a2-1c36488dd110 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:24.226724 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2a0a3-14d7-43ef-94a2-1c36488dd110 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:24.238399 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473a129-d9be-4ae1-a480-61776c8e9801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:24.239069 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473a129-d9be-4ae1-a480-61776c8e9801 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:24.239382 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473a129-d9be-4ae1-a480-61776c8e9801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:24.239680 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473a129-d9be-4ae1-a480-61776c8e9801 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:24.240416 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473a129-d9be-4ae1-a480-61776c8e9801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:24.242262 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473a129-d9be-4ae1-a480-61776c8e9801 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:24.254328 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 933/1867] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:24.259089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473a129-d9be-4ae1-a480-61776c8e9801 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:24.264751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a210ea-cfee-4a80-a8d8-6ff290de0c18 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:24.269662 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d838018-29b6-4855-b900-4dc9b384a6d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:24.270615 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d838018-29b6-4855-b900-4dc9b384a6d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:24.270994 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d838018-29b6-4855-b900-4dc9b384a6d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:24.271344 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d838018-29b6-4855-b900-4dc9b384a6d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:24.283191 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473a129-d9be-4ae1-a480-61776c8e9801 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:24.287021 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d838018-29b6-4855-b900-4dc9b384a6d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:24.287021 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d838018-29b6-4855-b900-4dc9b384a6d6 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:24.298552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a52974-7082-4877-8268-6ab4a10cfc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:24.299286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a52974-7082-4877-8268-6ab4a10cfc65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:24.300221 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a52974-7082-4877-8268-6ab4a10cfc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:24.300346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a52974-7082-4877-8268-6ab4a10cfc65 admin admin] PATH_INFO: `/v3/projects/46b0f36353cf449eb7e5571c7f570027/users/b4111c795b15495e8936711c0a5ce0cb/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:24.301528 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 935/1868] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:24.357978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a52974-7082-4877-8268-6ab4a10cfc65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b0f36353cf449eb7e5571c7f570027, user_id=b4111c795b15495e8936711c0a5ce0cb, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:24.363023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a52974-7082-4877-8268-6ab4a10cfc65 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:24.471701 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 934/1869] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:24 2022] PUT /identity/v3/projects/46b0f36353cf449eb7e5571c7f570027/users/b4111c795b15495e8936711c0a5ce0cb/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:24.475878 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d838018-29b6-4855-b900-4dc9b384a6d6 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:24.489019 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d838018-29b6-4855-b900-4dc9b384a6d6 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:24.569141 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28606f64-a960-4f82-a9d1-3bad8e300ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:24.569849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28606f64-a960-4f82-a9d1-3bad8e300ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:24.570074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28606f64-a960-4f82-a9d1-3bad8e300ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:24.570406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28606f64-a960-4f82-a9d1-3bad8e300ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:24.570940 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28606f64-a960-4f82-a9d1-3bad8e300ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:24.572621 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28606f64-a960-4f82-a9d1-3bad8e300ae6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:24.584142 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 936/1870] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:24.590834 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a52974-7082-4877-8268-6ab4a10cfc65 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:24.601631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a52974-7082-4877-8268-6ab4a10cfc65 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:24.606660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bcdbc5-f14c-416e-acb5-085f1684408a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:24.610816 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcdbc5-f14c-416e-acb5-085f1684408a admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:24.610816 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcdbc5-f14c-416e-acb5-085f1684408a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:24.610816 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcdbc5-f14c-416e-acb5-085f1684408a admin admin] PATH_INFO: `/v3/projects/46b0f36353cf449eb7e5571c7f570027/users/b4111c795b15495e8936711c0a5ce0cb/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:24.614259 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28606f64-a960-4f82-a9d1-3bad8e300ae6 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:24.615372 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bcdbc5-f14c-416e-acb5-085f1684408a admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b0f36353cf449eb7e5571c7f570027, user_id=b4111c795b15495e8936711c0a5ce0cb, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:24.616506 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-28606f64-a960-4f82-a9d1-3bad8e300ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:24.618125 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bcdbc5-f14c-416e-acb5-085f1684408a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:24.633564 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28606f64-a960-4f82-a9d1-3bad8e300ae6 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:24.637700 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 935/1871] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:24 2022] PUT /identity/v3/projects/46b0f36353cf449eb7e5571c7f570027/users/b4111c795b15495e8936711c0a5ce0cb/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:24.639400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:24.661192 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a567b7d-d4ab-48c5-be08-a4cff725ef73 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:24.661539 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a567b7d-d4ab-48c5-be08-a4cff725ef73 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:24.661823 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a567b7d-d4ab-48c5-be08-a4cff725ef73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:24.695326 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-8a567b7d-d4ab-48c5-be08-a4cff725ef73 None None] MFA Rules not processed for user `b4111c795b15495e8936711c0a5ce0cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:24.696709 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8a567b7d-d4ab-48c5-be08-a4cff725ef73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:24.697508 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b3185-9c84-41a4-9500-a1abe79112f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:24.698170 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b3185-9c84-41a4-9500-a1abe79112f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:24.698464 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b3185-9c84-41a4-9500-a1abe79112f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:24.698795 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b3185-9c84-41a4-9500-a1abe79112f3 admin admin] PATH_INFO: `/v3/projects/5730a9061517461b82242f9179c8522a` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:24.699888 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b3185-9c84-41a4-9500-a1abe79112f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5730a9061517461b82242f9179c8522a)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:24.701930 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b3185-9c84-41a4-9500-a1abe79112f3 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:24.775798 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 936/1872] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:35:24.819237 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-619b3185-9c84-41a4-9500-a1abe79112f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5730a9061517461b82242f9179c8522a', 'request_id': 'req-619b3185-9c84-41a4-9500-a1abe79112f3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:24.824995 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-619b3185-9c84-41a4-9500-a1abe79112f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5730a9061517461b82242f9179c8522a', 'request_id': 'req-619b3185-9c84-41a4-9500-a1abe79112f3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:24.859705 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a567b7d-d4ab-48c5-be08-a4cff725ef73 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:24.930492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-619b3185-9c84-41a4-9500-a1abe79112f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5730a9061517461b82242f9179c8522a', 'request_id': 'req-619b3185-9c84-41a4-9500-a1abe79112f3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:24.945680 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-619b3185-9c84-41a4-9500-a1abe79112f3 admin admin] The token cache is being invalidate because project 5730a9061517461b82242f9179c8522a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:24.946522 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-619b3185-9c84-41a4-9500-a1abe79112f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:24.947449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-619b3185-9c84-41a4-9500-a1abe79112f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:24.950130 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 937/1873] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:24 2022] DELETE /identity/v3/projects/5730a9061517461b82242f9179c8522a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:24.955259 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce6b7f-80ff-4ed0-a62f-10117e036351 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:24.955891 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce6b7f-80ff-4ed0-a62f-10117e036351 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:24.956848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a567b7d-d4ab-48c5-be08-a4cff725ef73 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:24.957243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce6b7f-80ff-4ed0-a62f-10117e036351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:25.013844 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c0ce6b7f-80ff-4ed0-a62f-10117e036351 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:25.019917 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c0ce6b7f-80ff-4ed0-a62f-10117e036351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:25.032329 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5261a5b-502c-4fd6-ab84-47da7fa0773e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:25.033038 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5261a5b-502c-4fd6-ab84-47da7fa0773e service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:25.033423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5261a5b-502c-4fd6-ab84-47da7fa0773e service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:25.034468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5261a5b-502c-4fd6-ab84-47da7fa0773e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:25.036721 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e5261a5b-502c-4fd6-ab84-47da7fa0773e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:25.131068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5261a5b-502c-4fd6-ab84-47da7fa0773e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:25.132650 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5261a5b-502c-4fd6-ab84-47da7fa0773e service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:25.153283 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 937/1874] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:35:25.183028 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 938/1875] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:35:25.192468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098baa0-fd5c-43aa-8f4d-4e1a3b1a0330 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:25.193091 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098baa0-fd5c-43aa-8f4d-4e1a3b1a0330 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:25.193406 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098baa0-fd5c-43aa-8f4d-4e1a3b1a0330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:25.221485 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-5098baa0-fd5c-43aa-8f4d-4e1a3b1a0330 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:25.222924 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5098baa0-fd5c-43aa-8f4d-4e1a3b1a0330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:25.236591 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce6b7f-80ff-4ed0-a62f-10117e036351 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:25.237147 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 938/1876] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:25.250427 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce6b7f-80ff-4ed0-a62f-10117e036351 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:25.256408 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36798c-5f46-41e4-97d5-b5bcb411b23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:25.257023 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36798c-5f46-41e4-97d5-b5bcb411b23b admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:25.257335 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36798c-5f46-41e4-97d5-b5bcb411b23b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:25.257662 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36798c-5f46-41e4-97d5-b5bcb411b23b admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:25.258325 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36798c-5f46-41e4-97d5-b5bcb411b23b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:35:25.258631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36798c-5f46-41e4-97d5-b5bcb411b23b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:25.260628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36798c-5f46-41e4-97d5-b5bcb411b23b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:25.276185 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 939/1877] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:35:25.280878 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098baa0-fd5c-43aa-8f4d-4e1a3b1a0330 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:25.290564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098baa0-fd5c-43aa-8f4d-4e1a3b1a0330 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:25.296398 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3f5a8-4a6f-44df-b035-d85bfcea8caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:25.297220 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3f5a8-4a6f-44df-b035-d85bfcea8caf admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:25.297638 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3f5a8-4a6f-44df-b035-d85bfcea8caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:25.298038 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3f5a8-4a6f-44df-b035-d85bfcea8caf admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:25.298918 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3f5a8-4a6f-44df-b035-d85bfcea8caf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:25.301617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3f5a8-4a6f-44df-b035-d85bfcea8caf admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:26.282996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36798c-5f46-41e4-97d5-b5bcb411b23b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:26.290134 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 939/1878] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:25 2022] POST /identity/v3/projects => generated 357 bytes in 1010 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:26.294503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36798c-5f46-41e4-97d5-b5bcb411b23b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:26.364542 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e301bb5-4a05-4672-aeeb-9c5c2ee468d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:26.365623 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e301bb5-4a05-4672-aeeb-9c5c2ee468d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:26.366331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e301bb5-4a05-4672-aeeb-9c5c2ee468d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:26.367227 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e301bb5-4a05-4672-aeeb-9c5c2ee468d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:26.368168 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e301bb5-4a05-4672-aeeb-9c5c2ee468d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:26.370477 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e301bb5-4a05-4672-aeeb-9c5c2ee468d4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:26.546791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 940/1879] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:26 2022] POST /identity/v3/users => generated 279 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:35:26.550816 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3f5a8-4a6f-44df-b035-d85bfcea8caf admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:26.561421 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3f5a8-4a6f-44df-b035-d85bfcea8caf admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:26.566650 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49459b4-7890-4a27-a69e-79c060cb046d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:26.567252 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49459b4-7890-4a27-a69e-79c060cb046d admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:26.567531 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49459b4-7890-4a27-a69e-79c060cb046d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:26.567839 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49459b4-7890-4a27-a69e-79c060cb046d admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:26.568506 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49459b4-7890-4a27-a69e-79c060cb046d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:26.570128 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49459b4-7890-4a27-a69e-79c060cb046d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:26.580222 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 940/1880] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:26.591424 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e301bb5-4a05-4672-aeeb-9c5c2ee468d4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:26.602327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e301bb5-4a05-4672-aeeb-9c5c2ee468d4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:26.606513 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:26.614589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3916d-ec48-4a87-a95b-68f0daac026c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:26.614589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3916d-ec48-4a87-a95b-68f0daac026c admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:26.614589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3916d-ec48-4a87-a95b-68f0daac026c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:26.614589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3916d-ec48-4a87-a95b-68f0daac026c admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:26.615007 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3916d-ec48-4a87-a95b-68f0daac026c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:26.616266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3916d-ec48-4a87-a95b-68f0daac026c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:26.632996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 941/1881] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:26.634984 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49459b4-7890-4a27-a69e-79c060cb046d admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:26.661576 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49459b4-7890-4a27-a69e-79c060cb046d admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:26.676697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074b778-3eb5-47be-aa9d-668e4718aa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:26.677484 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074b778-3eb5-47be-aa9d-668e4718aa2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:26.677976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074b778-3eb5-47be-aa9d-668e4718aa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:26.678289 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074b778-3eb5-47be-aa9d-668e4718aa2f admin admin] PATH_INFO: `/v3/projects/f604a638cf9c48a69dd4cb74eb6150ac/users/0894f53eeba7496e97ecd8607f94645d/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:26.706621 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074b778-3eb5-47be-aa9d-668e4718aa2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f604a638cf9c48a69dd4cb74eb6150ac, user_id=0894f53eeba7496e97ecd8607f94645d, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:26.710725 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074b778-3eb5-47be-aa9d-668e4718aa2f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:26.823436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46901db4-bf73-467d-8246-3109dab30b3e None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:26.823771 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46901db4-bf73-467d-8246-3109dab30b3e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:26.824141 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46901db4-bf73-467d-8246-3109dab30b3e None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:26.826363 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 942/1882] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 5 14:35:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:35:26.835787 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 941/1883] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:26 2022] PUT /identity/v3/projects/f604a638cf9c48a69dd4cb74eb6150ac/users/0894f53eeba7496e97ecd8607f94645d/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:26.843835 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e34c0-49e8-4f2d-b8ca-526b8a26b95e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:26.844389 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e34c0-49e8-4f2d-b8ca-526b8a26b95e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:26.844878 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e34c0-49e8-4f2d-b8ca-526b8a26b95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:26.852001 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423ed19-bce8-4e26-85e0-7029300e82b7 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:26.854423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423ed19-bce8-4e26-85e0-7029300e82b7 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:26.855910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423ed19-bce8-4e26-85e0-7029300e82b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:26.880038 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1e6e34c0-49e8-4f2d-b8ca-526b8a26b95e None None] MFA Rules not processed for user `d5515accf3b64006bc41422265a641bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:26.881597 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1e6e34c0-49e8-4f2d-b8ca-526b8a26b95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:26.903559 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b423ed19-bce8-4e26-85e0-7029300e82b7 None None] MFA Rules not processed for user `0894f53eeba7496e97ecd8607f94645d`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:26.904868 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b423ed19-bce8-4e26-85e0-7029300e82b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:26.952496 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 943/1884] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 5 14:35:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:26.976568 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e34c0-49e8-4f2d-b8ca-526b8a26b95e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:26.976568 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1e6e34c0-49e8-4f2d-b8ca-526b8a26b95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:26.981194 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 942/1885] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:26.984101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423ed19-bce8-4e26-85e0-7029300e82b7 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:26.991730 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e34c0-49e8-4f2d-b8ca-526b8a26b95e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:27.003435 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19b3f7-109f-44fb-b7ae-b8d3f9bde7fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:27.004206 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19b3f7-109f-44fb-b7ae-b8d3f9bde7fc service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:27.004488 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19b3f7-109f-44fb-b7ae-b8d3f9bde7fc service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:27.004757 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19b3f7-109f-44fb-b7ae-b8d3f9bde7fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:27.014665 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19b3f7-109f-44fb-b7ae-b8d3f9bde7fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:27.016330 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19b3f7-109f-44fb-b7ae-b8d3f9bde7fc service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:27.031270 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 944/1886] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:35:27.033380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19b3f7-109f-44fb-b7ae-b8d3f9bde7fc service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:27.035255 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ee19b3f7-109f-44fb-b7ae-b8d3f9bde7fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:27.089617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423ed19-bce8-4e26-85e0-7029300e82b7 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:27.089617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a85a95-2753-4677-9cb0-f62331689697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:27.089617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a85a95-2753-4677-9cb0-f62331689697 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:27.089617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a85a95-2753-4677-9cb0-f62331689697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:27.089964 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a85a95-2753-4677-9cb0-f62331689697 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:27.089964 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a85a95-2753-4677-9cb0-f62331689697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:27.089964 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a85a95-2753-4677-9cb0-f62331689697 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:27.119033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19b3f7-109f-44fb-b7ae-b8d3f9bde7fc service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:27.126043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c993cb-3da6-4006-b96d-e1e5c790663e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:27.126043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c993cb-3da6-4006-b96d-e1e5c790663e service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:27.126043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c993cb-3da6-4006-b96d-e1e5c790663e service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:27.126043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c993cb-3da6-4006-b96d-e1e5c790663e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:27.127075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-31c993cb-3da6-4006-b96d-e1e5c790663e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:27.206243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c993cb-3da6-4006-b96d-e1e5c790663e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:27.207617 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c993cb-3da6-4006-b96d-e1e5c790663e service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:27.216595 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 945/1887] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:27.233152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 943/1888] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:26 2022] POST /identity/v3/projects => generated 357 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:27.237422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c993cb-3da6-4006-b96d-e1e5c790663e service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:27.250103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c993cb-3da6-4006-b96d-e1e5c790663e service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:27.317721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac8440-c4aa-4a91-a166-49435e29c2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:27.318391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac8440-c4aa-4a91-a166-49435e29c2fe admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:27.318676 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac8440-c4aa-4a91-a166-49435e29c2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:27.318880 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac8440-c4aa-4a91-a166-49435e29c2fe admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:27.319534 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac8440-c4aa-4a91-a166-49435e29c2fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:27.321540 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac8440-c4aa-4a91-a166-49435e29c2fe admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:27.341596 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:27.457126 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 946/1889] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:27 2022] POST /identity/v3/users => generated 285 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:27.461434 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a85a95-2753-4677-9cb0-f62331689697 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:27.475093 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a85a95-2753-4677-9cb0-f62331689697 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:27.489376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ec222-a681-468b-b96d-2d05eec24413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:27.489376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ec222-a681-468b-b96d-2d05eec24413 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:27.489727 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ec222-a681-468b-b96d-2d05eec24413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:27.490069 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ec222-a681-468b-b96d-2d05eec24413 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:27.490841 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ec222-a681-468b-b96d-2d05eec24413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:27.494011 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ec222-a681-468b-b96d-2d05eec24413 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:27.515114 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 944/1890] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:35:27.520075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac8440-c4aa-4a91-a166-49435e29c2fe admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:27.532135 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac8440-c4aa-4a91-a166-49435e29c2fe admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:27.544919 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25977a46-b9a9-445f-917c-07f6b9681ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:27.547168 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25977a46-b9a9-445f-917c-07f6b9681ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:27.558249 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25977a46-b9a9-445f-917c-07f6b9681ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:27.558249 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25977a46-b9a9-445f-917c-07f6b9681ee4 admin admin] PATH_INFO: `/v3/projects/5f41ba97988143a98a9dbaf6962e512c/users/b22e0d1d27074b77b2a7b5707f155c5b/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:27.568766 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25977a46-b9a9-445f-917c-07f6b9681ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f41ba97988143a98a9dbaf6962e512c, user_id=b22e0d1d27074b77b2a7b5707f155c5b, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:27.572616 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25977a46-b9a9-445f-917c-07f6b9681ee4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:27.707284 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 947/1891] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:27 2022] PUT /identity/v3/projects/5f41ba97988143a98a9dbaf6962e512c/users/b22e0d1d27074b77b2a7b5707f155c5b/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:27.711015 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ec222-a681-468b-b96d-2d05eec24413 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:27.730055 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ec222-a681-468b-b96d-2d05eec24413 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:27.825695 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f163bc9-72f9-4f81-bfc2-61fd308c9040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:27.826400 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f163bc9-72f9-4f81-bfc2-61fd308c9040 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:27.826723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f163bc9-72f9-4f81-bfc2-61fd308c9040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:27.827246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f163bc9-72f9-4f81-bfc2-61fd308c9040 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:27.828040 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f163bc9-72f9-4f81-bfc2-61fd308c9040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:27.829938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f163bc9-72f9-4f81-bfc2-61fd308c9040 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:27.841675 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 945/1892] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:27.845813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25977a46-b9a9-445f-917c-07f6b9681ee4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:27.857952 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25977a46-b9a9-445f-917c-07f6b9681ee4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:27.863709 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc86d0-a4ac-4640-b7db-47d9ea33d969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:27.864544 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc86d0-a4ac-4640-b7db-47d9ea33d969 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:27.864892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc86d0-a4ac-4640-b7db-47d9ea33d969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:27.865298 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc86d0-a4ac-4640-b7db-47d9ea33d969 admin admin] PATH_INFO: `/v3/projects/5f41ba97988143a98a9dbaf6962e512c/users/b22e0d1d27074b77b2a7b5707f155c5b/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:27.868237 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc86d0-a4ac-4640-b7db-47d9ea33d969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f41ba97988143a98a9dbaf6962e512c, user_id=b22e0d1d27074b77b2a7b5707f155c5b, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:27.872570 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc86d0-a4ac-4640-b7db-47d9ea33d969 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:27.907546 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 948/1893] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:27 2022] PUT /identity/v3/projects/5f41ba97988143a98a9dbaf6962e512c/users/b22e0d1d27074b77b2a7b5707f155c5b/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:27.920281 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f9910-f224-4252-9bb9-eaf222264ff9 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:27.921043 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f9910-f224-4252-9bb9-eaf222264ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:27.921546 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f9910-f224-4252-9bb9-eaf222264ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:27.957801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-1f1f9910-f224-4252-9bb9-eaf222264ff9 None None] MFA Rules not processed for user `b22e0d1d27074b77b2a7b5707f155c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:27.959421 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1f1f9910-f224-4252-9bb9-eaf222264ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:28.019572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc86d0-a4ac-4640-b7db-47d9ea33d969 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:28.021363 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f7fc86d0-a4ac-4640-b7db-47d9ea33d969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:28.092289 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 946/1894] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:27 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:28.110769 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc86d0-a4ac-4640-b7db-47d9ea33d969 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:28.115457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ac859-0989-4259-82d0-c59d9cdd84eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:28.116086 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ac859-0989-4259-82d0-c59d9cdd84eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:28.116366 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ac859-0989-4259-82d0-c59d9cdd84eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:28.116666 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ac859-0989-4259-82d0-c59d9cdd84eb admin admin] PATH_INFO: `/v3/users/fce34e0b9b0248fb8fb192e21f809ed5` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:28.117837 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ac859-0989-4259-82d0-c59d9cdd84eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fce34e0b9b0248fb8fb192e21f809ed5)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:28.119845 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ac859-0989-4259-82d0-c59d9cdd84eb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:28.155996 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f9910-f224-4252-9bb9-eaf222264ff9 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:28.214737 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f9910-f224-4252-9bb9-eaf222264ff9 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:28.215788 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd73db-945d-4f22-9ce1-ed1c6f64aeb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:28.216457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd73db-945d-4f22-9ce1-ed1c6f64aeb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:28.216734 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd73db-945d-4f22-9ce1-ed1c6f64aeb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:28.217004 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd73db-945d-4f22-9ce1-ed1c6f64aeb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:28.227370 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd73db-945d-4f22-9ce1-ed1c6f64aeb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:28.228857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd73db-945d-4f22-9ce1-ed1c6f64aeb7 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:28.243457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 947/1895] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:28 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:35:28.326636 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:28.375240 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-272ac859-0989-4259-82d0-c59d9cdd84eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fce34e0b9b0248fb8fb192e21f809ed5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:28.376254 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-272ac859-0989-4259-82d0-c59d9cdd84eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fce34e0b9b0248fb8fb192e21f809ed5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:28.457965 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-272ac859-0989-4259-82d0-c59d9cdd84eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fce34e0b9b0248fb8fb192e21f809ed5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:28.474301 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-272ac859-0989-4259-82d0-c59d9cdd84eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fce34e0b9b0248fb8fb192e21f809ed5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:28.475979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-272ac859-0989-4259-82d0-c59d9cdd84eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fce34e0b9b0248fb8fb192e21f809ed5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:28.488832 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd73db-945d-4f22-9ce1-ed1c6f64aeb7 service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:28.493437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 949/1896] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:28 2022] DELETE /identity/v3/users/fce34e0b9b0248fb8fb192e21f809ed5 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:35:28.497884 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5a3ce-365f-43df-b8c3-9494852bcf24 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:28.498591 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5a3ce-365f-43df-b8c3-9494852bcf24 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:28.499074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5a3ce-365f-43df-b8c3-9494852bcf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:28.501276 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd73db-945d-4f22-9ce1-ed1c6f64aeb7 service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:28.521169 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-01f5a3ce-365f-43df-b8c3-9494852bcf24 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:28.522403 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-01f5a3ce-365f-43df-b8c3-9494852bcf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:28.562826 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398347a-b42c-4159-8e87-60c2d867fef4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:28.563707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398347a-b42c-4159-8e87-60c2d867fef4 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:28.563991 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398347a-b42c-4159-8e87-60c2d867fef4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:28.564307 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398347a-b42c-4159-8e87-60c2d867fef4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:28.567108 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e398347a-b42c-4159-8e87-60c2d867fef4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:28.609565 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 950/1897] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:35:28.617778 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5a3ce-365f-43df-b8c3-9494852bcf24 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:28.619258 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-01f5a3ce-365f-43df-b8c3-9494852bcf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:28.632450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398347a-b42c-4159-8e87-60c2d867fef4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:28.634023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398347a-b42c-4159-8e87-60c2d867fef4 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:28.648320 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 948/1898] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:35:28.701398 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5a3ce-365f-43df-b8c3-9494852bcf24 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:28.705409 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70878a-c6c2-454f-b458-9aad78c8d154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:28.706189 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70878a-c6c2-454f-b458-9aad78c8d154 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:28.706481 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70878a-c6c2-454f-b458-9aad78c8d154 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:28.707577 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70878a-c6c2-454f-b458-9aad78c8d154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:28.717859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70878a-c6c2-454f-b458-9aad78c8d154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:28.719436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70878a-c6c2-454f-b458-9aad78c8d154 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:28.732462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 951/1899] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:29.189798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:29.257168 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398347a-b42c-4159-8e87-60c2d867fef4 service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:29.258407 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e398347a-b42c-4159-8e87-60c2d867fef4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:29.283749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398347a-b42c-4159-8e87-60c2d867fef4 service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:29.288882 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfa683-5237-4217-a99c-ff103e368271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:29.289895 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfa683-5237-4217-a99c-ff103e368271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:29.290672 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfa683-5237-4217-a99c-ff103e368271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:29.291129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfa683-5237-4217-a99c-ff103e368271 admin admin] PATH_INFO: `/v3/projects/624a6d87c34e4c5ebc1e85470ef84b65` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:29.292826 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bfa683-5237-4217-a99c-ff103e368271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=624a6d87c34e4c5ebc1e85470ef84b65)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:29.294876 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bfa683-5237-4217-a99c-ff103e368271 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:29.460368 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-96bfa683-5237-4217-a99c-ff103e368271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '624a6d87c34e4c5ebc1e85470ef84b65', 'request_id': 'req-96bfa683-5237-4217-a99c-ff103e368271'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:29.466114 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-96bfa683-5237-4217-a99c-ff103e368271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '624a6d87c34e4c5ebc1e85470ef84b65', 'request_id': 'req-96bfa683-5237-4217-a99c-ff103e368271'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:29.583410 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-96bfa683-5237-4217-a99c-ff103e368271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '624a6d87c34e4c5ebc1e85470ef84b65', 'request_id': 'req-96bfa683-5237-4217-a99c-ff103e368271'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:29.595441 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-96bfa683-5237-4217-a99c-ff103e368271 admin admin] The token cache is being invalidate because project 624a6d87c34e4c5ebc1e85470ef84b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:29.595770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-96bfa683-5237-4217-a99c-ff103e368271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:29.598586 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-96bfa683-5237-4217-a99c-ff103e368271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:29.598586 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 949/1900] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:29 2022] DELETE /identity/v3/projects/624a6d87c34e4c5ebc1e85470ef84b65 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:29.602675 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70878a-c6c2-454f-b458-9aad78c8d154 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:29.613308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70878a-c6c2-454f-b458-9aad78c8d154 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:29.673248 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f0ded-6272-4fcc-b4a5-f3ecd16d5ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:29.673897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f0ded-6272-4fcc-b4a5-f3ecd16d5ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:29.674730 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f0ded-6272-4fcc-b4a5-f3ecd16d5ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:29.675670 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f0ded-6272-4fcc-b4a5-f3ecd16d5ef3 admin admin] PATH_INFO: `/v3/users/e13634357c584df082fd92a6531099d5` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:29.676821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f0ded-6272-4fcc-b4a5-f3ecd16d5ef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e13634357c584df082fd92a6531099d5)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:29.678858 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f0ded-6272-4fcc-b4a5-f3ecd16d5ef3 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:29.909166 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-184f0ded-6272-4fcc-b4a5-f3ecd16d5ef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e13634357c584df082fd92a6531099d5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:29.909834 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-184f0ded-6272-4fcc-b4a5-f3ecd16d5ef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e13634357c584df082fd92a6531099d5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:30.016490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-184f0ded-6272-4fcc-b4a5-f3ecd16d5ef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e13634357c584df082fd92a6531099d5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:30.029501 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-184f0ded-6272-4fcc-b4a5-f3ecd16d5ef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e13634357c584df082fd92a6531099d5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:30.030164 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-184f0ded-6272-4fcc-b4a5-f3ecd16d5ef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e13634357c584df082fd92a6531099d5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:30.042674 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 952/1901] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:29 2022] DELETE /identity/v3/users/e13634357c584df082fd92a6531099d5 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:30.234789 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:30.500667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfa683-5237-4217-a99c-ff103e368271 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:30.502465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-96bfa683-5237-4217-a99c-ff103e368271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:30.519425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfa683-5237-4217-a99c-ff103e368271 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:30.584452 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df44f3e-c6af-4f27-b338-8488f252a405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:30.586173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df44f3e-c6af-4f27-b338-8488f252a405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:30.586466 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df44f3e-c6af-4f27-b338-8488f252a405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:30.586977 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df44f3e-c6af-4f27-b338-8488f252a405 admin admin] PATH_INFO: `/v3/users/5c76c3371fbd44f9ad75d177f9d210af` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:30.588358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df44f3e-c6af-4f27-b338-8488f252a405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c76c3371fbd44f9ad75d177f9d210af)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:30.590361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df44f3e-c6af-4f27-b338-8488f252a405 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:30.626388 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f0ded-6272-4fcc-b4a5-f3ecd16d5ef3 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:30.626388 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-184f0ded-6272-4fcc-b4a5-f3ecd16d5ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:30.640488 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f0ded-6272-4fcc-b4a5-f3ecd16d5ef3 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:30.646777 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd72074-3ac3-4d13-b9c9-56dd0299c11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:30.649590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd72074-3ac3-4d13-b9c9-56dd0299c11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:30.649590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd72074-3ac3-4d13-b9c9-56dd0299c11e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:30.649590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd72074-3ac3-4d13-b9c9-56dd0299c11e admin admin] PATH_INFO: `/v3/projects/45b993b976ad496a9a09cc223fe078b9` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:30.649590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd72074-3ac3-4d13-b9c9-56dd0299c11e admin admin] RBAC: Authorizing `identity:delete_project(project_id=45b993b976ad496a9a09cc223fe078b9)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:30.651542 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd72074-3ac3-4d13-b9c9-56dd0299c11e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:30.861376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fbd72074-3ac3-4d13-b9c9-56dd0299c11e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45b993b976ad496a9a09cc223fe078b9', 'request_id': 'req-fbd72074-3ac3-4d13-b9c9-56dd0299c11e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:30.862211 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0df44f3e-c6af-4f27-b338-8488f252a405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c76c3371fbd44f9ad75d177f9d210af'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:30.867544 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fbd72074-3ac3-4d13-b9c9-56dd0299c11e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45b993b976ad496a9a09cc223fe078b9', 'request_id': 'req-fbd72074-3ac3-4d13-b9c9-56dd0299c11e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:30.972118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0df44f3e-c6af-4f27-b338-8488f252a405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c76c3371fbd44f9ad75d177f9d210af'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:30.985479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0df44f3e-c6af-4f27-b338-8488f252a405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c76c3371fbd44f9ad75d177f9d210af'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:30.986184 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0df44f3e-c6af-4f27-b338-8488f252a405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c76c3371fbd44f9ad75d177f9d210af'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:30.994038 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0df44f3e-c6af-4f27-b338-8488f252a405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c76c3371fbd44f9ad75d177f9d210af'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:31.004933 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 950/1902] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:30 2022] DELETE /identity/v3/users/5c76c3371fbd44f9ad75d177f9d210af => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:31.007444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b1876-bd81-41c1-9f8a-f7cefc212917 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:31.007729 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b1876-bd81-41c1-9f8a-f7cefc212917 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:31.008002 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b1876-bd81-41c1-9f8a-f7cefc212917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:31.036293 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-a24b1876-bd81-41c1-9f8a-f7cefc212917 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:31.037617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a24b1876-bd81-41c1-9f8a-f7cefc212917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:31.060494 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fbd72074-3ac3-4d13-b9c9-56dd0299c11e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45b993b976ad496a9a09cc223fe078b9', 'request_id': 'req-fbd72074-3ac3-4d13-b9c9-56dd0299c11e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:31.074337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fbd72074-3ac3-4d13-b9c9-56dd0299c11e admin admin] The token cache is being invalidate because project 45b993b976ad496a9a09cc223fe078b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:31.074738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fbd72074-3ac3-4d13-b9c9-56dd0299c11e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:31.075661 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fbd72074-3ac3-4d13-b9c9-56dd0299c11e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:31.077760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 953/1903] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:30 2022] DELETE /identity/v3/projects/45b993b976ad496a9a09cc223fe078b9 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:31.083147 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2bc3d-8f7a-4368-b47c-c9ef4b70266b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:31.083434 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2bc3d-8f7a-4368-b47c-c9ef4b70266b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:31.083712 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2bc3d-8f7a-4368-b47c-c9ef4b70266b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:31.102261 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 951/1904] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:35:31.112522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b1876-bd81-41c1-9f8a-f7cefc212917 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:31.113265 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3ba2bc3d-8f7a-4368-b47c-c9ef4b70266b None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:31.113958 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a24b1876-bd81-41c1-9f8a-f7cefc212917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:31.114785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3ba2bc3d-8f7a-4368-b47c-c9ef4b70266b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:31.124972 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 954/1905] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:35:31.134931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518af9f-2249-4f22-a3a7-e2634e069d69 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:31.135725 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518af9f-2249-4f22-a3a7-e2634e069d69 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:31.136475 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518af9f-2249-4f22-a3a7-e2634e069d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:31.146447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:31.158765 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7518af9f-2249-4f22-a3a7-e2634e069d69 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:31.159957 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7518af9f-2249-4f22-a3a7-e2634e069d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:31.172072 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 955/1906] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:31.179837 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518af9f-2249-4f22-a3a7-e2634e069d69 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:31.181868 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b1876-bd81-41c1-9f8a-f7cefc212917 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:31.182451 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518af9f-2249-4f22-a3a7-e2634e069d69 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:31.186823 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c6fb9-1069-4c16-b622-f980990c4a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:31.187432 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c6fb9-1069-4c16-b622-f980990c4a32 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:31.187641 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a0536-23c2-4305-aa3c-e6ab138a5299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:31.187797 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c6fb9-1069-4c16-b622-f980990c4a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:31.188066 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c6fb9-1069-4c16-b622-f980990c4a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:31.188438 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a0536-23c2-4305-aa3c-e6ab138a5299 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:31.188774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a0536-23c2-4305-aa3c-e6ab138a5299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:31.189136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a0536-23c2-4305-aa3c-e6ab138a5299 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:31.190374 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a0536-23c2-4305-aa3c-e6ab138a5299 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:35:31.190736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a0536-23c2-4305-aa3c-e6ab138a5299 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:31.192675 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a0536-23c2-4305-aa3c-e6ab138a5299 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:31.198629 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c6fb9-1069-4c16-b622-f980990c4a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:31.200661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c6fb9-1069-4c16-b622-f980990c4a32 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:31.225594 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 956/1907] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:35:31.225594 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a0536-23c2-4305-aa3c-e6ab138a5299 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:31.225955 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 952/1908] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:35:31.227167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a0536-23c2-4305-aa3c-e6ab138a5299 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:31.232528 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199fb66-77e9-4fb7-8385-c81ac316096f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:31.233185 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199fb66-77e9-4fb7-8385-c81ac316096f admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:31.233529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199fb66-77e9-4fb7-8385-c81ac316096f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:31.233771 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199fb66-77e9-4fb7-8385-c81ac316096f admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:31.234430 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199fb66-77e9-4fb7-8385-c81ac316096f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:31.236317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199fb66-77e9-4fb7-8385-c81ac316096f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:31.379017 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 957/1909] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:31 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:35:31.383238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c6fb9-1069-4c16-b622-f980990c4a32 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:31.393865 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c6fb9-1069-4c16-b622-f980990c4a32 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:31.477329 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb64087-0032-472b-a335-4a97ce041c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:31.477329 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb64087-0032-472b-a335-4a97ce041c90 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:31.477329 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb64087-0032-472b-a335-4a97ce041c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:31.477329 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb64087-0032-472b-a335-4a97ce041c90 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:31.477666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb64087-0032-472b-a335-4a97ce041c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:31.477666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb64087-0032-472b-a335-4a97ce041c90 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:31.636336 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 953/1910] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:31 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:31.640328 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199fb66-77e9-4fb7-8385-c81ac316096f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:31.657795 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199fb66-77e9-4fb7-8385-c81ac316096f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:31.683012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14562d3-7d30-49ae-ba76-1b3c5234c86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:31.686114 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14562d3-7d30-49ae-ba76-1b3c5234c86e admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:31.686569 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14562d3-7d30-49ae-ba76-1b3c5234c86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:31.687133 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14562d3-7d30-49ae-ba76-1b3c5234c86e admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:31.688563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14562d3-7d30-49ae-ba76-1b3c5234c86e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:31.692844 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14562d3-7d30-49ae-ba76-1b3c5234c86e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:31.723146 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 958/1911] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:35:31.728102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb64087-0032-472b-a335-4a97ce041c90 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:31.746658 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb64087-0032-472b-a335-4a97ce041c90 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:31.753813 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e6fd0-6adf-4d5d-955a-a6c34dc59044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:31.755698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e6fd0-6adf-4d5d-955a-a6c34dc59044 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:31.756124 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e6fd0-6adf-4d5d-955a-a6c34dc59044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:31.756542 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e6fd0-6adf-4d5d-955a-a6c34dc59044 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:31.757431 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e6fd0-6adf-4d5d-955a-a6c34dc59044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:31.759302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e6fd0-6adf-4d5d-955a-a6c34dc59044 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:31.772386 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 954/1912] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:31.777298 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14562d3-7d30-49ae-ba76-1b3c5234c86e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:31.791064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14562d3-7d30-49ae-ba76-1b3c5234c86e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:31.797288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7400307-5dcb-43bf-815e-ac0580e4fd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:31.798354 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7400307-5dcb-43bf-815e-ac0580e4fd2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:31.806007 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7400307-5dcb-43bf-815e-ac0580e4fd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:31.806381 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7400307-5dcb-43bf-815e-ac0580e4fd2c admin admin] PATH_INFO: `/v3/projects/b576a7cfc213499eb724cc9979709ae8/users/4734aaa009d0499ea3fb754e240c0b12/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:31.840639 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7400307-5dcb-43bf-815e-ac0580e4fd2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b576a7cfc213499eb724cc9979709ae8, user_id=4734aaa009d0499ea3fb754e240c0b12, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:31.843968 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7400307-5dcb-43bf-815e-ac0580e4fd2c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:31.975937 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e6fd0-6adf-4d5d-955a-a6c34dc59044 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:31.978448 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2e9e6fd0-6adf-4d5d-955a-a6c34dc59044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:31.987522 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 959/1913] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:31 2022] PUT /identity/v3/projects/b576a7cfc213499eb724cc9979709ae8/users/4734aaa009d0499ea3fb754e240c0b12/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:31.999028 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac96498-3f61-473a-80ce-7b924b1f1662 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:31.999541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac96498-3f61-473a-80ce-7b924b1f1662 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:32.000281 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac96498-3f61-473a-80ce-7b924b1f1662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:32.016050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e6fd0-6adf-4d5d-955a-a6c34dc59044 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:32.051139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5ac96498-3f61-473a-80ce-7b924b1f1662 None None] MFA Rules not processed for user `4734aaa009d0499ea3fb754e240c0b12`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:32.052466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5ac96498-3f61-473a-80ce-7b924b1f1662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:32.135700 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac87e4e-96c9-4ae8-9b2b-a11569026252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:32.136983 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac87e4e-96c9-4ae8-9b2b-a11569026252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:32.137488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac87e4e-96c9-4ae8-9b2b-a11569026252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:32.137738 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac87e4e-96c9-4ae8-9b2b-a11569026252 admin admin] PATH_INFO: `/v3/projects/20215b678a0240978ad1e4ae2923a791` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:32.139684 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac87e4e-96c9-4ae8-9b2b-a11569026252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20215b678a0240978ad1e4ae2923a791)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:32.154825 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac87e4e-96c9-4ae8-9b2b-a11569026252 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:32.164979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 960/1914] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:32.244006 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac96498-3f61-473a-80ce-7b924b1f1662 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:32.245572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5ac96498-3f61-473a-80ce-7b924b1f1662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:32.266349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:32.277800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4ac87e4e-96c9-4ae8-9b2b-a11569026252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20215b678a0240978ad1e4ae2923a791', 'request_id': 'req-4ac87e4e-96c9-4ae8-9b2b-a11569026252'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:32.285430 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4ac87e4e-96c9-4ae8-9b2b-a11569026252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20215b678a0240978ad1e4ae2923a791', 'request_id': 'req-4ac87e4e-96c9-4ae8-9b2b-a11569026252'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:32.337974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac96498-3f61-473a-80ce-7b924b1f1662 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:32.340551 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:32.378116 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4ac87e4e-96c9-4ae8-9b2b-a11569026252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20215b678a0240978ad1e4ae2923a791', 'request_id': 'req-4ac87e4e-96c9-4ae8-9b2b-a11569026252'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:32.401440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4ac87e4e-96c9-4ae8-9b2b-a11569026252 admin admin] The token cache is being invalidate because project 20215b678a0240978ad1e4ae2923a791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:32.401758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4ac87e4e-96c9-4ae8-9b2b-a11569026252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:32.402412 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4ac87e4e-96c9-4ae8-9b2b-a11569026252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:32.405355 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 955/1915] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:31 2022] DELETE /identity/v3/projects/20215b678a0240978ad1e4ae2923a791 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:35:32.406973 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1535f2-b52a-42cb-b656-72badbe26b9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:32.407934 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1535f2-b52a-42cb-b656-72badbe26b9e service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:32.408404 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1535f2-b52a-42cb-b656-72badbe26b9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:32.409519 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1535f2-b52a-42cb-b656-72badbe26b9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:32.410069 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac87e4e-96c9-4ae8-9b2b-a11569026252 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:32.411402 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4ac87e4e-96c9-4ae8-9b2b-a11569026252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:32.411879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4c1535f2-b52a-42cb-b656-72badbe26b9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:32.478525 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac87e4e-96c9-4ae8-9b2b-a11569026252 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:32.482780 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1535f2-b52a-42cb-b656-72badbe26b9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:32.483547 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a145805-076c-4429-9ef7-0359fcb14fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:32.484163 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1535f2-b52a-42cb-b656-72badbe26b9e service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:32.484264 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a145805-076c-4429-9ef7-0359fcb14fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:32.484487 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a145805-076c-4429-9ef7-0359fcb14fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:32.484855 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a145805-076c-4429-9ef7-0359fcb14fc8 admin admin] PATH_INFO: `/v3/users/461cbbd3715d4d488066ed41ca107841` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:32.486027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a145805-076c-4429-9ef7-0359fcb14fc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=461cbbd3715d4d488066ed41ca107841)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:32.488603 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a145805-076c-4429-9ef7-0359fcb14fc8 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:32.494867 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 961/1916] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:35:32.518095 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1535f2-b52a-42cb-b656-72badbe26b9e service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:32.519622 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4c1535f2-b52a-42cb-b656-72badbe26b9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:32.533958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1535f2-b52a-42cb-b656-72badbe26b9e service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:32.539268 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f53ed9-00f2-4a25-86e9-0dcc53a3b768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:32.539901 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f53ed9-00f2-4a25-86e9-0dcc53a3b768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:32.540180 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f53ed9-00f2-4a25-86e9-0dcc53a3b768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:32.540455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f53ed9-00f2-4a25-86e9-0dcc53a3b768 admin admin] PATH_INFO: `/v3/users/4734aaa009d0499ea3fb754e240c0b12` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:32.541779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f53ed9-00f2-4a25-86e9-0dcc53a3b768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4734aaa009d0499ea3fb754e240c0b12)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:32.543701 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f53ed9-00f2-4a25-86e9-0dcc53a3b768 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:32.839723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5a145805-076c-4429-9ef7-0359fcb14fc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '461cbbd3715d4d488066ed41ca107841'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:32.916865 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-35f53ed9-00f2-4a25-86e9-0dcc53a3b768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4734aaa009d0499ea3fb754e240c0b12'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:32.918007 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-35f53ed9-00f2-4a25-86e9-0dcc53a3b768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4734aaa009d0499ea3fb754e240c0b12'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:32.923473 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5a145805-076c-4429-9ef7-0359fcb14fc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '461cbbd3715d4d488066ed41ca107841'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:32.954044 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5a145805-076c-4429-9ef7-0359fcb14fc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '461cbbd3715d4d488066ed41ca107841'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:32.954872 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5a145805-076c-4429-9ef7-0359fcb14fc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '461cbbd3715d4d488066ed41ca107841'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:32.965493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5a145805-076c-4429-9ef7-0359fcb14fc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '461cbbd3715d4d488066ed41ca107841'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:32.973848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 956/1917] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:32 2022] DELETE /identity/v3/users/461cbbd3715d4d488066ed41ca107841 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:33.061412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-35f53ed9-00f2-4a25-86e9-0dcc53a3b768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4734aaa009d0499ea3fb754e240c0b12'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:33.088451 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-35f53ed9-00f2-4a25-86e9-0dcc53a3b768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4734aaa009d0499ea3fb754e240c0b12'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:33.093785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-35f53ed9-00f2-4a25-86e9-0dcc53a3b768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4734aaa009d0499ea3fb754e240c0b12'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:33.118808 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 962/1918] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:32 2022] DELETE /identity/v3/users/4734aaa009d0499ea3fb754e240c0b12 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:35:33.130195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d80bb-0d48-4314-b2f8-9fbe0c66ab2f None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:33.130502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d80bb-0d48-4314-b2f8-9fbe0c66ab2f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:33.130775 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d80bb-0d48-4314-b2f8-9fbe0c66ab2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:33.171530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-6c5d80bb-0d48-4314-b2f8-9fbe0c66ab2f None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:33.177113 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6c5d80bb-0d48-4314-b2f8-9fbe0c66ab2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:33.312949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 957/1919] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:33.335975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f53ed9-00f2-4a25-86e9-0dcc53a3b768 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:33.337676 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-35f53ed9-00f2-4a25-86e9-0dcc53a3b768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:33.427365 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f53ed9-00f2-4a25-86e9-0dcc53a3b768 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:33.441917 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad97529-d855-487d-ac56-ce826d89ac00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:33.443038 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad97529-d855-487d-ac56-ce826d89ac00 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:33.443325 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad97529-d855-487d-ac56-ce826d89ac00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:33.443601 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad97529-d855-487d-ac56-ce826d89ac00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:33.457954 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad97529-d855-487d-ac56-ce826d89ac00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:33.459676 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad97529-d855-487d-ac56-ce826d89ac00 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:33.472113 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 963/1920] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:33.943970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d80bb-0d48-4314-b2f8-9fbe0c66ab2f None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:33.945685 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6c5d80bb-0d48-4314-b2f8-9fbe0c66ab2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:33.966309 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d80bb-0d48-4314-b2f8-9fbe0c66ab2f None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:33.973559 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2feb179-8c10-450a-a24f-d1558543294c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:33.975178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feb179-8c10-450a-a24f-d1558543294c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:33.975480 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feb179-8c10-450a-a24f-d1558543294c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:33.975738 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feb179-8c10-450a-a24f-d1558543294c admin admin] PATH_INFO: `/v3/projects/b576a7cfc213499eb724cc9979709ae8` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:33.976931 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2feb179-8c10-450a-a24f-d1558543294c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b576a7cfc213499eb724cc9979709ae8)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:33.979571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2feb179-8c10-450a-a24f-d1558543294c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:34.025266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad97529-d855-487d-ac56-ce826d89ac00 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:34.026769 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fad97529-d855-487d-ac56-ce826d89ac00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:34.041433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad97529-d855-487d-ac56-ce826d89ac00 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:34.046664 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe4fd5-5fc1-48cc-8537-aeb3b8afdc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:34.047295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe4fd5-5fc1-48cc-8537-aeb3b8afdc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:34.047586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe4fd5-5fc1-48cc-8537-aeb3b8afdc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:34.047865 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe4fd5-5fc1-48cc-8537-aeb3b8afdc74 admin admin] PATH_INFO: `/v3/projects/dd61366c17c94030be0a2ba9c085789f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:34.048994 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe4fd5-5fc1-48cc-8537-aeb3b8afdc74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd61366c17c94030be0a2ba9c085789f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:34.051567 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe4fd5-5fc1-48cc-8537-aeb3b8afdc74 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:34.123728 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d2feb179-8c10-450a-a24f-d1558543294c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b576a7cfc213499eb724cc9979709ae8', 'request_id': 'req-d2feb179-8c10-450a-a24f-d1558543294c'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:34.146028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d2feb179-8c10-450a-a24f-d1558543294c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b576a7cfc213499eb724cc9979709ae8', 'request_id': 'req-d2feb179-8c10-450a-a24f-d1558543294c'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:34.212592 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d3fe4fd5-5fc1-48cc-8537-aeb3b8afdc74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd61366c17c94030be0a2ba9c085789f', 'request_id': 'req-d3fe4fd5-5fc1-48cc-8537-aeb3b8afdc74'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:34.221183 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d3fe4fd5-5fc1-48cc-8537-aeb3b8afdc74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd61366c17c94030be0a2ba9c085789f', 'request_id': 'req-d3fe4fd5-5fc1-48cc-8537-aeb3b8afdc74'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:34.235297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d2feb179-8c10-450a-a24f-d1558543294c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b576a7cfc213499eb724cc9979709ae8', 'request_id': 'req-d2feb179-8c10-450a-a24f-d1558543294c'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:34.258496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d2feb179-8c10-450a-a24f-d1558543294c admin admin] The token cache is being invalidate because project b576a7cfc213499eb724cc9979709ae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:34.258883 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d2feb179-8c10-450a-a24f-d1558543294c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:34.259976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d2feb179-8c10-450a-a24f-d1558543294c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:34.262193 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 958/1921] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:33 2022] DELETE /identity/v3/projects/b576a7cfc213499eb724cc9979709ae8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:34.267268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb986357-4e85-449b-bb68-318b6d2ea4ff None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:34.270982 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb986357-4e85-449b-bb68-318b6d2ea4ff None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:34.270982 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb986357-4e85-449b-bb68-318b6d2ea4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:34.284929 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:34.301603 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-bb986357-4e85-449b-bb68-318b6d2ea4ff None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:34.303436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-bb986357-4e85-449b-bb68-318b6d2ea4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:34.313316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d3fe4fd5-5fc1-48cc-8537-aeb3b8afdc74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd61366c17c94030be0a2ba9c085789f', 'request_id': 'req-d3fe4fd5-5fc1-48cc-8537-aeb3b8afdc74'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:34.382486 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d3fe4fd5-5fc1-48cc-8537-aeb3b8afdc74 admin admin] The token cache is being invalidate because project dd61366c17c94030be0a2ba9c085789f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:34.384451 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d3fe4fd5-5fc1-48cc-8537-aeb3b8afdc74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:34.385408 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d3fe4fd5-5fc1-48cc-8537-aeb3b8afdc74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:34.389634 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 964/1922] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:34 2022] DELETE /identity/v3/projects/dd61366c17c94030be0a2ba9c085789f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:35:34.394855 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe4fd5-5fc1-48cc-8537-aeb3b8afdc74 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:34.400442 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d3fe4fd5-5fc1-48cc-8537-aeb3b8afdc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:34.428037 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 959/1923] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:34.442692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa0c84-f673-49c4-a2ce-50a7d40ed222 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:34.442692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa0c84-f673-49c4-a2ce-50a7d40ed222 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:34.442692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa0c84-f673-49c4-a2ce-50a7d40ed222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:34.515510 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe4fd5-5fc1-48cc-8537-aeb3b8afdc74 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:34.518208 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-06fa0c84-f673-49c4-a2ce-50a7d40ed222 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:34.519655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-06fa0c84-f673-49c4-a2ce-50a7d40ed222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:34.533498 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a11e7e-c096-4f67-8fa3-c784c7498fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:34.533498 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a11e7e-c096-4f67-8fa3-c784c7498fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:34.533498 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a11e7e-c096-4f67-8fa3-c784c7498fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:34.533498 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a11e7e-c096-4f67-8fa3-c784c7498fff admin admin] PATH_INFO: `/v3/users/9c640e788c114bcab0bbe4ddaa6474db` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:34.534473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a11e7e-c096-4f67-8fa3-c784c7498fff admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c640e788c114bcab0bbe4ddaa6474db)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:34.538050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a11e7e-c096-4f67-8fa3-c784c7498fff admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:34.544997 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 960/1924] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:34.561553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa0c84-f673-49c4-a2ce-50a7d40ed222 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:34.584164 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa0c84-f673-49c4-a2ce-50a7d40ed222 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:34.590340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f3890-cc87-4ba0-a302-c686460edfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:34.591472 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f3890-cc87-4ba0-a302-c686460edfc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:34.592194 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f3890-cc87-4ba0-a302-c686460edfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:34.592574 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f3890-cc87-4ba0-a302-c686460edfc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:34.593461 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f3890-cc87-4ba0-a302-c686460edfc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:35:34.593915 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f3890-cc87-4ba0-a302-c686460edfc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:34.597528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f3890-cc87-4ba0-a302-c686460edfc4 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:34.619050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 961/1925] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:35:34.629920 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f3890-cc87-4ba0-a302-c686460edfc4 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:34.641771 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f3890-cc87-4ba0-a302-c686460edfc4 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:34.647627 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121c59f-ff39-402a-8b65-1872b23610ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:34.648246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121c59f-ff39-402a-8b65-1872b23610ca admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:34.648530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121c59f-ff39-402a-8b65-1872b23610ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:34.648823 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121c59f-ff39-402a-8b65-1872b23610ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:34.649555 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121c59f-ff39-402a-8b65-1872b23610ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:34.652392 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121c59f-ff39-402a-8b65-1872b23610ca admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:34.755924 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-16a11e7e-c096-4f67-8fa3-c784c7498fff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c640e788c114bcab0bbe4ddaa6474db'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:34.756744 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-16a11e7e-c096-4f67-8fa3-c784c7498fff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c640e788c114bcab0bbe4ddaa6474db'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:34.772800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 962/1926] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:34 2022] POST /identity/v3/projects => generated 359 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:34.781118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121c59f-ff39-402a-8b65-1872b23610ca admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:34.799660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1121c59f-ff39-402a-8b65-1872b23610ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:34.890963 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121c59f-ff39-402a-8b65-1872b23610ca admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:34.897804 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-16a11e7e-c096-4f67-8fa3-c784c7498fff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c640e788c114bcab0bbe4ddaa6474db'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:34.898983 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f00a4-338d-4c85-9a97-030edba93e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:34.900233 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f00a4-338d-4c85-9a97-030edba93e48 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:34.901182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f00a4-338d-4c85-9a97-030edba93e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:34.901182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f00a4-338d-4c85-9a97-030edba93e48 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:34.901584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f00a4-338d-4c85-9a97-030edba93e48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:34.904654 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f00a4-338d-4c85-9a97-030edba93e48 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:34.920304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-16a11e7e-c096-4f67-8fa3-c784c7498fff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c640e788c114bcab0bbe4ddaa6474db'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:34.921261 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-16a11e7e-c096-4f67-8fa3-c784c7498fff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c640e788c114bcab0bbe4ddaa6474db'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:34.940654 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 965/1927] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:34 2022] DELETE /identity/v3/users/9c640e788c114bcab0bbe4ddaa6474db => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:35:35.066982 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 963/1928] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:34 2022] POST /identity/v3/users => generated 280 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:35:35.068205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a11e7e-c096-4f67-8fa3-c784c7498fff admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:35.152887 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a11e7e-c096-4f67-8fa3-c784c7498fff admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:35.160208 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af23a52-2f3f-432d-809c-088f80646076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:35.161082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af23a52-2f3f-432d-809c-088f80646076 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:35.162033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af23a52-2f3f-432d-809c-088f80646076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:35.162317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af23a52-2f3f-432d-809c-088f80646076 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:35.162977 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af23a52-2f3f-432d-809c-088f80646076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:35.164692 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af23a52-2f3f-432d-809c-088f80646076 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:35.177130 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 966/1929] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:35.181145 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f00a4-338d-4c85-9a97-030edba93e48 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:35.194208 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f00a4-338d-4c85-9a97-030edba93e48 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:35.207930 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce77ae-3e98-4d4f-960c-bd151f83f96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:35.208503 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce77ae-3e98-4d4f-960c-bd151f83f96e admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:35.208777 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce77ae-3e98-4d4f-960c-bd151f83f96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:35.209119 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce77ae-3e98-4d4f-960c-bd151f83f96e admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:35.209748 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce77ae-3e98-4d4f-960c-bd151f83f96e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:35.211554 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce77ae-3e98-4d4f-960c-bd151f83f96e admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:35.213550 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:35.225860 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 964/1930] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:35.237952 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af23a52-2f3f-432d-809c-088f80646076 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:35.250478 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af23a52-2f3f-432d-809c-088f80646076 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:35.261342 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22127b-44a7-462d-8146-a3031f3ed337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:35.262405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22127b-44a7-462d-8146-a3031f3ed337 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:35.262530 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22127b-44a7-462d-8146-a3031f3ed337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:35.262825 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22127b-44a7-462d-8146-a3031f3ed337 admin admin] PATH_INFO: `/v3/projects/f146174016744f7bbb620de462649551/users/f79b1b01021448d78aba55eac2159d3b/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:35.306640 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22127b-44a7-462d-8146-a3031f3ed337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f146174016744f7bbb620de462649551, user_id=f79b1b01021448d78aba55eac2159d3b, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:35.310373 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22127b-44a7-462d-8146-a3031f3ed337 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:35.427548 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 967/1931] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:35 2022] PUT /identity/v3/projects/f146174016744f7bbb620de462649551/users/f79b1b01021448d78aba55eac2159d3b/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:35.443438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd9909-89f4-4fd4-8567-f1b6e47a25c3 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:35.444873 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd9909-89f4-4fd4-8567-f1b6e47a25c3 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:35.445285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd9909-89f4-4fd4-8567-f1b6e47a25c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:35.503967 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-4ffd9909-89f4-4fd4-8567-f1b6e47a25c3 None None] MFA Rules not processed for user `f79b1b01021448d78aba55eac2159d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:35.503967 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4ffd9909-89f4-4fd4-8567-f1b6e47a25c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:35.509742 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22127b-44a7-462d-8146-a3031f3ed337 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:35.511517 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7a22127b-44a7-462d-8146-a3031f3ed337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:35.652815 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 965/1932] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:35:35.653185 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22127b-44a7-462d-8146-a3031f3ed337 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:35.662060 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d00a8-db2a-4df4-a7d6-464de1f1c954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:35.662720 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d00a8-db2a-4df4-a7d6-464de1f1c954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:35.662996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d00a8-db2a-4df4-a7d6-464de1f1c954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:35.663265 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d00a8-db2a-4df4-a7d6-464de1f1c954 admin admin] PATH_INFO: `/v3/projects/d65805401c204f4792b4ea13edf942b1` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:35.665122 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d00a8-db2a-4df4-a7d6-464de1f1c954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d65805401c204f4792b4ea13edf942b1)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:35.667413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d00a8-db2a-4df4-a7d6-464de1f1c954 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:35.853745 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6b3d00a8-db2a-4df4-a7d6-464de1f1c954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd65805401c204f4792b4ea13edf942b1', 'request_id': 'req-6b3d00a8-db2a-4df4-a7d6-464de1f1c954'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:35.858633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6b3d00a8-db2a-4df4-a7d6-464de1f1c954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd65805401c204f4792b4ea13edf942b1', 'request_id': 'req-6b3d00a8-db2a-4df4-a7d6-464de1f1c954'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:35.987575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6b3d00a8-db2a-4df4-a7d6-464de1f1c954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd65805401c204f4792b4ea13edf942b1', 'request_id': 'req-6b3d00a8-db2a-4df4-a7d6-464de1f1c954'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:36.014354 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6b3d00a8-db2a-4df4-a7d6-464de1f1c954 admin admin] The token cache is being invalidate because project d65805401c204f4792b4ea13edf942b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:36.014668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6b3d00a8-db2a-4df4-a7d6-464de1f1c954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:36.015494 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6b3d00a8-db2a-4df4-a7d6-464de1f1c954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:36.027625 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 968/1933] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:35 2022] DELETE /identity/v3/projects/d65805401c204f4792b4ea13edf942b1 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:36.034403 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3bc58-4ab3-415e-8591-1360291abfeb None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:36.034691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3bc58-4ab3-415e-8591-1360291abfeb None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:36.034970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3bc58-4ab3-415e-8591-1360291abfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:36.060458 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c7c3bc58-4ab3-415e-8591-1360291abfeb None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:36.061901 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c7c3bc58-4ab3-415e-8591-1360291abfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:36.140835 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 966/1934] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:36.150605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30730c5-69a3-4665-a160-48dfb10d291f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:36.151371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30730c5-69a3-4665-a160-48dfb10d291f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:36.151371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30730c5-69a3-4665-a160-48dfb10d291f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:36.169708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3bc58-4ab3-415e-8591-1360291abfeb None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:36.171162 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c7c3bc58-4ab3-415e-8591-1360291abfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:36.173557 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a30730c5-69a3-4665-a160-48dfb10d291f None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:36.176197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a30730c5-69a3-4665-a160-48dfb10d291f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:36.186682 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 969/1935] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:36.191724 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30730c5-69a3-4665-a160-48dfb10d291f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:36.213118 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30730c5-69a3-4665-a160-48dfb10d291f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:36.218162 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc273fc6-0d29-498a-b3c5-7352a2143012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:36.218784 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc273fc6-0d29-498a-b3c5-7352a2143012 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:36.219122 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc273fc6-0d29-498a-b3c5-7352a2143012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:36.219774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc273fc6-0d29-498a-b3c5-7352a2143012 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:36.220126 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc273fc6-0d29-498a-b3c5-7352a2143012 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:35:36.220439 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc273fc6-0d29-498a-b3c5-7352a2143012 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:36.223053 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc273fc6-0d29-498a-b3c5-7352a2143012 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:36.239641 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3bc58-4ab3-415e-8591-1360291abfeb None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:36.240140 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 970/1936] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:35:36.244914 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc273fc6-0d29-498a-b3c5-7352a2143012 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:36.247424 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:36.249756 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b6c38-1a7b-4880-9079-62db318da1c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:36.250603 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b6c38-1a7b-4880-9079-62db318da1c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:36.250942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b6c38-1a7b-4880-9079-62db318da1c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:36.251219 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b6c38-1a7b-4880-9079-62db318da1c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:36.257511 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-057b6c38-1a7b-4880-9079-62db318da1c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:36.257646 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc273fc6-0d29-498a-b3c5-7352a2143012 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:36.261948 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b5bb1-8421-4b0a-bc07-e41350eea3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:36.262562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b5bb1-8421-4b0a-bc07-e41350eea3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:36.262848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b5bb1-8421-4b0a-bc07-e41350eea3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:36.263122 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b5bb1-8421-4b0a-bc07-e41350eea3f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:36.263926 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b5bb1-8421-4b0a-bc07-e41350eea3f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:36.265732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b5bb1-8421-4b0a-bc07-e41350eea3f2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:36.333681 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b6c38-1a7b-4880-9079-62db318da1c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:36.334065 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b6c38-1a7b-4880-9079-62db318da1c7 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:36.348560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 967/1937] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:35:36.367849 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b6c38-1a7b-4880-9079-62db318da1c7 service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:36.372426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-057b6c38-1a7b-4880-9079-62db318da1c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:36.403993 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b6c38-1a7b-4880-9079-62db318da1c7 service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:36.409576 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 971/1938] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:36 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:36.416167 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c67da-01de-4abb-a6c8-64983e46329f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:36.416167 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c67da-01de-4abb-a6c8-64983e46329f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:36.416348 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c67da-01de-4abb-a6c8-64983e46329f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:36.416761 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c67da-01de-4abb-a6c8-64983e46329f admin admin] PATH_INFO: `/v3/users/f79b1b01021448d78aba55eac2159d3b` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:36.420941 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c67da-01de-4abb-a6c8-64983e46329f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f79b1b01021448d78aba55eac2159d3b)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:36.421122 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b5bb1-8421-4b0a-bc07-e41350eea3f2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:36.423129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c67da-01de-4abb-a6c8-64983e46329f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:36.510143 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b5bb1-8421-4b0a-bc07-e41350eea3f2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:36.516984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb056b7-08a8-4cc5-b04d-d2b764f0785f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:36.520841 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb056b7-08a8-4cc5-b04d-d2b764f0785f admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:36.521973 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb056b7-08a8-4cc5-b04d-d2b764f0785f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:36.522264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb056b7-08a8-4cc5-b04d-d2b764f0785f admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:36.522930 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb056b7-08a8-4cc5-b04d-d2b764f0785f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:36.525280 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb056b7-08a8-4cc5-b04d-d2b764f0785f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:36.745550 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 972/1939] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:36 2022] POST /identity/v3/users => generated 287 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:35:36.745550 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb056b7-08a8-4cc5-b04d-d2b764f0785f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:36.745927 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bdb056b7-08a8-4cc5-b04d-d2b764f0785f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:36.762985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb056b7-08a8-4cc5-b04d-d2b764f0785f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:36.769111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097b77f-26c6-4a55-a8af-be57f6339bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:36.769370 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097b77f-26c6-4a55-a8af-be57f6339bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:36.769643 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097b77f-26c6-4a55-a8af-be57f6339bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:36.769967 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097b77f-26c6-4a55-a8af-be57f6339bce admin admin] PATH_INFO: `/v3/users/7642fb95b84f44dab4bca9ead1127b90` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:36.771146 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097b77f-26c6-4a55-a8af-be57f6339bce admin admin] RBAC: Authorizing `identity:delete_user(user_id=7642fb95b84f44dab4bca9ead1127b90)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:36.773198 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097b77f-26c6-4a55-a8af-be57f6339bce admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:36.849175 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b40c67da-01de-4abb-a6c8-64983e46329f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f79b1b01021448d78aba55eac2159d3b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:36.959785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b40c67da-01de-4abb-a6c8-64983e46329f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f79b1b01021448d78aba55eac2159d3b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:36.973614 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b40c67da-01de-4abb-a6c8-64983e46329f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f79b1b01021448d78aba55eac2159d3b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:36.974328 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b40c67da-01de-4abb-a6c8-64983e46329f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f79b1b01021448d78aba55eac2159d3b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:36.982081 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b40c67da-01de-4abb-a6c8-64983e46329f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f79b1b01021448d78aba55eac2159d3b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:36.988869 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 968/1940] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:36 2022] DELETE /identity/v3/users/f79b1b01021448d78aba55eac2159d3b => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:36.989928 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c67da-01de-4abb-a6c8-64983e46329f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:36.991145 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b40c67da-01de-4abb-a6c8-64983e46329f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:37.059855 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c67da-01de-4abb-a6c8-64983e46329f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:37.065309 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adb6cc-fa2c-47be-a0af-3ab68e655ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:37.066026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adb6cc-fa2c-47be-a0af-3ab68e655ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:37.066314 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adb6cc-fa2c-47be-a0af-3ab68e655ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:37.066797 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adb6cc-fa2c-47be-a0af-3ab68e655ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:37.067493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46adb6cc-fa2c-47be-a0af-3ab68e655ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:37.069251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46adb6cc-fa2c-47be-a0af-3ab68e655ce6 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:37.076009 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b097b77f-26c6-4a55-a8af-be57f6339bce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7642fb95b84f44dab4bca9ead1127b90'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:37.076720 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b097b77f-26c6-4a55-a8af-be57f6339bce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7642fb95b84f44dab4bca9ead1127b90'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:37.080005 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 969/1941] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:37.081970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f03d1-149e-4508-85b6-28783013e7d9 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:37.082391 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f03d1-149e-4508-85b6-28783013e7d9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:37.082662 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f03d1-149e-4508-85b6-28783013e7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:37.106217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-2f6f03d1-149e-4508-85b6-28783013e7d9 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:37.106561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2f6f03d1-149e-4508-85b6-28783013e7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:37.114205 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 970/1942] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:37.115079 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f03d1-149e-4508-85b6-28783013e7d9 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:37.116266 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2f6f03d1-149e-4508-85b6-28783013e7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:37.129528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f03d1-149e-4508-85b6-28783013e7d9 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:37.135832 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fbc9a-b7a9-4478-a6ff-7e11de89f968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:37.136434 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fbc9a-b7a9-4478-a6ff-7e11de89f968 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:37.136710 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fbc9a-b7a9-4478-a6ff-7e11de89f968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:37.137008 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fbc9a-b7a9-4478-a6ff-7e11de89f968 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:37.137665 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9fbc9a-b7a9-4478-a6ff-7e11de89f968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:37.139243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9fbc9a-b7a9-4478-a6ff-7e11de89f968 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:37.154214 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 971/1943] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:37.154214 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fbc9a-b7a9-4478-a6ff-7e11de89f968 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:37.154214 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ae9fbc9a-b7a9-4478-a6ff-7e11de89f968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:37.154994 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b097b77f-26c6-4a55-a8af-be57f6339bce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7642fb95b84f44dab4bca9ead1127b90'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:37.167578 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b097b77f-26c6-4a55-a8af-be57f6339bce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7642fb95b84f44dab4bca9ead1127b90'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:37.168273 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b097b77f-26c6-4a55-a8af-be57f6339bce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7642fb95b84f44dab4bca9ead1127b90'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:37.184530 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 973/1944] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:36 2022] DELETE /identity/v3/users/7642fb95b84f44dab4bca9ead1127b90 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:37.185422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097b77f-26c6-4a55-a8af-be57f6339bce admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:37.186772 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b097b77f-26c6-4a55-a8af-be57f6339bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:37.218310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fbc9a-b7a9-4478-a6ff-7e11de89f968 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:37.252853 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:37.259408 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097b77f-26c6-4a55-a8af-be57f6339bce admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:37.264362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5a1b0-46fa-4924-9e9a-18a2998bebbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:37.264998 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5a1b0-46fa-4924-9e9a-18a2998bebbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:37.265323 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5a1b0-46fa-4924-9e9a-18a2998bebbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:37.265597 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5a1b0-46fa-4924-9e9a-18a2998bebbf admin admin] PATH_INFO: `/v3/users/5bad217b9d214a3abfa90c10de9aec4f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:37.266733 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5a1b0-46fa-4924-9e9a-18a2998bebbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bad217b9d214a3abfa90c10de9aec4f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:37.269279 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5a1b0-46fa-4924-9e9a-18a2998bebbf admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:37.273308 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76127eac-561c-4f09-a420-85f2f68bed4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:37.274016 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76127eac-561c-4f09-a420-85f2f68bed4e service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:37.274254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76127eac-561c-4f09-a420-85f2f68bed4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:37.274525 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76127eac-561c-4f09-a420-85f2f68bed4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:37.284049 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76127eac-561c-4f09-a420-85f2f68bed4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:37.285715 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76127eac-561c-4f09-a420-85f2f68bed4e service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:37.295566 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 972/1945] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:37.296345 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76127eac-561c-4f09-a420-85f2f68bed4e service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:37.305792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76127eac-561c-4f09-a420-85f2f68bed4e service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:37.313828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff3c34-ea56-4fd7-a1f0-604c0082efff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:37.313828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff3c34-ea56-4fd7-a1f0-604c0082efff admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:37.313828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff3c34-ea56-4fd7-a1f0-604c0082efff admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:37.313828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff3c34-ea56-4fd7-a1f0-604c0082efff admin admin] PATH_INFO: `/v3/projects/d7cd0446e5b04910b0886f4ede510e70/users/8acb5686883a43fc8984e2f6e23c56d3/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:37.327294 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff3c34-ea56-4fd7-a1f0-604c0082efff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7cd0446e5b04910b0886f4ede510e70, user_id=8acb5686883a43fc8984e2f6e23c56d3, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:37.330144 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff3c34-ea56-4fd7-a1f0-604c0082efff admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:37.427105 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 973/1946] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:37 2022] PUT /identity/v3/projects/d7cd0446e5b04910b0886f4ede510e70/users/8acb5686883a43fc8984e2f6e23c56d3/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:37.428349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23712bef-5c21-44f9-a94f-d498ae8887e2 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:37.428632 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23712bef-5c21-44f9-a94f-d498ae8887e2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:37.428900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23712bef-5c21-44f9-a94f-d498ae8887e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:37.447638 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-23712bef-5c21-44f9-a94f-d498ae8887e2 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:37.448826 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-23712bef-5c21-44f9-a94f-d498ae8887e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:37.491384 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b9f5a1b0-46fa-4924-9e9a-18a2998bebbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bad217b9d214a3abfa90c10de9aec4f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:37.492478 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b9f5a1b0-46fa-4924-9e9a-18a2998bebbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bad217b9d214a3abfa90c10de9aec4f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:37.510555 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 974/1947] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:37.512083 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb1224-b6bb-4987-969c-bdb0ff420f90 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:37.514114 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb1224-b6bb-4987-969c-bdb0ff420f90 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:37.514114 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb1224-b6bb-4987-969c-bdb0ff420f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:37.537481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-aadb1224-b6bb-4987-969c-bdb0ff420f90 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:37.538702 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-aadb1224-b6bb-4987-969c-bdb0ff420f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:37.546338 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 975/1948] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:37.547165 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb1224-b6bb-4987-969c-bdb0ff420f90 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:37.551668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-aadb1224-b6bb-4987-969c-bdb0ff420f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:37.577996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b9f5a1b0-46fa-4924-9e9a-18a2998bebbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bad217b9d214a3abfa90c10de9aec4f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:37.600365 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b9f5a1b0-46fa-4924-9e9a-18a2998bebbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bad217b9d214a3abfa90c10de9aec4f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:37.600365 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b9f5a1b0-46fa-4924-9e9a-18a2998bebbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bad217b9d214a3abfa90c10de9aec4f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:37.616337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 974/1949] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:37 2022] DELETE /identity/v3/users/5bad217b9d214a3abfa90c10de9aec4f => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:37.617622 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5a1b0-46fa-4924-9e9a-18a2998bebbf admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:37.618356 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb1224-b6bb-4987-969c-bdb0ff420f90 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:37.619280 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b9f5a1b0-46fa-4924-9e9a-18a2998bebbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:37.696660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4418c-c102-446b-90c8-a581244e7f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:37.697302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4418c-c102-446b-90c8-a581244e7f89 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:37.697699 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4418c-c102-446b-90c8-a581244e7f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:37.697985 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4418c-c102-446b-90c8-a581244e7f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:37.712175 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5a1b0-46fa-4924-9e9a-18a2998bebbf admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:37.715799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a048c-827f-4340-a285-89e9ea7d8e12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:37.719125 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a048c-827f-4340-a285-89e9ea7d8e12 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:37.719388 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a048c-827f-4340-a285-89e9ea7d8e12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:37.719660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a048c-827f-4340-a285-89e9ea7d8e12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:37.765037 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4418c-c102-446b-90c8-a581244e7f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:37.766713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4418c-c102-446b-90c8-a581244e7f89 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:37.786047 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 976/1950] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:37.788384 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1b760-c931-48e6-8e9e-ea4eeb589474 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:37.788711 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1b760-c931-48e6-8e9e-ea4eeb589474 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:37.789050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1b760-c931-48e6-8e9e-ea4eeb589474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:37.790258 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a048c-827f-4340-a285-89e9ea7d8e12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:37.791922 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a048c-827f-4340-a285-89e9ea7d8e12 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:37.806289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 975/1951] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:37.820699 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a048c-827f-4340-a285-89e9ea7d8e12 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:37.822773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-343a048c-827f-4340-a285-89e9ea7d8e12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:37.832799 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-72a1b760-c931-48e6-8e9e-ea4eeb589474 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:37.834276 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-72a1b760-c931-48e6-8e9e-ea4eeb589474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:37.847230 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a048c-827f-4340-a285-89e9ea7d8e12 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:37.853287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda52cd3-e730-4907-8185-f20ebd81cb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:37.854615 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 977/1952] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:37.855515 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda52cd3-e730-4907-8185-f20ebd81cb5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:37.855803 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda52cd3-e730-4907-8185-f20ebd81cb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:37.856106 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda52cd3-e730-4907-8185-f20ebd81cb5e admin admin] PATH_INFO: `/v3/projects/f146174016744f7bbb620de462649551` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:37.857475 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda52cd3-e730-4907-8185-f20ebd81cb5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f146174016744f7bbb620de462649551)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:37.865174 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda52cd3-e730-4907-8185-f20ebd81cb5e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:37.865616 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1b760-c931-48e6-8e9e-ea4eeb589474 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:37.878099 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1b760-c931-48e6-8e9e-ea4eeb589474 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:37.882110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f95fab-3908-40c7-89fa-c6cbf1d91418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:37.882963 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f95fab-3908-40c7-89fa-c6cbf1d91418 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:37.883350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f95fab-3908-40c7-89fa-c6cbf1d91418 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:37.883730 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f95fab-3908-40c7-89fa-c6cbf1d91418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:37.890920 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:37.897342 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f95fab-3908-40c7-89fa-c6cbf1d91418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:37.898959 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f95fab-3908-40c7-89fa-c6cbf1d91418 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:37.911559 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 978/1953] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:37.992875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cda52cd3-e730-4907-8185-f20ebd81cb5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f146174016744f7bbb620de462649551', 'request_id': 'req-cda52cd3-e730-4907-8185-f20ebd81cb5e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:38.008206 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cda52cd3-e730-4907-8185-f20ebd81cb5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f146174016744f7bbb620de462649551', 'request_id': 'req-cda52cd3-e730-4907-8185-f20ebd81cb5e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:38.146455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cda52cd3-e730-4907-8185-f20ebd81cb5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f146174016744f7bbb620de462649551', 'request_id': 'req-cda52cd3-e730-4907-8185-f20ebd81cb5e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:38.159459 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cda52cd3-e730-4907-8185-f20ebd81cb5e admin admin] The token cache is being invalidate because project f146174016744f7bbb620de462649551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:38.160471 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cda52cd3-e730-4907-8185-f20ebd81cb5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:38.164844 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cda52cd3-e730-4907-8185-f20ebd81cb5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:38.179532 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 976/1954] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:37 2022] DELETE /identity/v3/projects/f146174016744f7bbb620de462649551 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:38.190828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beef664-e24b-4f0b-918c-981fc750bbdf None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:38.191465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beef664-e24b-4f0b-918c-981fc750bbdf None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:38.191465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beef664-e24b-4f0b-918c-981fc750bbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:38.224232 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-3beef664-e24b-4f0b-918c-981fc750bbdf None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:38.225475 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3beef664-e24b-4f0b-918c-981fc750bbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:38.290120 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 979/1955] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:38.298004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc67e6-b797-4ad2-8a79-31563a095b84 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:38.298293 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc67e6-b797-4ad2-8a79-31563a095b84 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:38.298568 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc67e6-b797-4ad2-8a79-31563a095b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:38.330043 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beef664-e24b-4f0b-918c-981fc750bbdf None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:38.330043 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3beef664-e24b-4f0b-918c-981fc750bbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:38.330193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8efc67e6-b797-4ad2-8a79-31563a095b84 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:38.332341 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8efc67e6-b797-4ad2-8a79-31563a095b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:38.342644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 977/1956] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:38.347191 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc67e6-b797-4ad2-8a79-31563a095b84 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:38.351383 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beef664-e24b-4f0b-918c-981fc750bbdf None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:38.359628 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d74f2e-bf1c-44c5-91df-e09fff53bacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:38.360583 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d74f2e-bf1c-44c5-91df-e09fff53bacd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:38.361106 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d74f2e-bf1c-44c5-91df-e09fff53bacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:38.362838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc67e6-b797-4ad2-8a79-31563a095b84 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:38.364066 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d74f2e-bf1c-44c5-91df-e09fff53bacd admin admin] PATH_INFO: `/v3/projects/0fd61cd096164b8785f75279916bf3a7` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:38.372970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970d867-326b-43f4-b91f-f15edf5b1247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:38.372970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970d867-326b-43f4-b91f-f15edf5b1247 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:38.372970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970d867-326b-43f4-b91f-f15edf5b1247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:38.372970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970d867-326b-43f4-b91f-f15edf5b1247 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:38.373706 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d74f2e-bf1c-44c5-91df-e09fff53bacd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd61cd096164b8785f75279916bf3a7)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:38.373799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970d867-326b-43f4-b91f-f15edf5b1247 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:35:38.373799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970d867-326b-43f4-b91f-f15edf5b1247 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:38.373925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d74f2e-bf1c-44c5-91df-e09fff53bacd admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:38.373992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970d867-326b-43f4-b91f-f15edf5b1247 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:38.391949 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 978/1957] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:35:38.403563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970d867-326b-43f4-b91f-f15edf5b1247 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:38.426509 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970d867-326b-43f4-b91f-f15edf5b1247 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:38.440654 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b133c-edfe-4891-914b-9661b45d75aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:38.441355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b133c-edfe-4891-914b-9661b45d75aa admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:38.441634 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b133c-edfe-4891-914b-9661b45d75aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:38.442167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b133c-edfe-4891-914b-9661b45d75aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:38.442648 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b133c-edfe-4891-914b-9661b45d75aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:38.444634 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b133c-edfe-4891-914b-9661b45d75aa admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:38.538543 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b9d74f2e-bf1c-44c5-91df-e09fff53bacd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd61cd096164b8785f75279916bf3a7', 'request_id': 'req-b9d74f2e-bf1c-44c5-91df-e09fff53bacd'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:38.544040 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b9d74f2e-bf1c-44c5-91df-e09fff53bacd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd61cd096164b8785f75279916bf3a7', 'request_id': 'req-b9d74f2e-bf1c-44c5-91df-e09fff53bacd'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:38.572681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 979/1958] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:38 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:38.573904 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b133c-edfe-4891-914b-9661b45d75aa admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:38.661726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b133c-edfe-4891-914b-9661b45d75aa admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:38.664518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b9d74f2e-bf1c-44c5-91df-e09fff53bacd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd61cd096164b8785f75279916bf3a7', 'request_id': 'req-b9d74f2e-bf1c-44c5-91df-e09fff53bacd'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:38.668071 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85b537-e3b4-4b66-a600-d656395cb805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:38.668682 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85b537-e3b4-4b66-a600-d656395cb805 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:38.668962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85b537-e3b4-4b66-a600-d656395cb805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:38.669266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85b537-e3b4-4b66-a600-d656395cb805 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:38.669907 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85b537-e3b4-4b66-a600-d656395cb805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:38.671826 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85b537-e3b4-4b66-a600-d656395cb805 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:38.679599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b9d74f2e-bf1c-44c5-91df-e09fff53bacd admin admin] The token cache is being invalidate because project 0fd61cd096164b8785f75279916bf3a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:38.680016 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b9d74f2e-bf1c-44c5-91df-e09fff53bacd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:38.681160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b9d74f2e-bf1c-44c5-91df-e09fff53bacd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:38.683044 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 980/1959] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:38 2022] DELETE /identity/v3/projects/0fd61cd096164b8785f75279916bf3a7 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:35:38.684146 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d74f2e-bf1c-44c5-91df-e09fff53bacd admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:38.686476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b9d74f2e-bf1c-44c5-91df-e09fff53bacd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:38.785568 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d74f2e-bf1c-44c5-91df-e09fff53bacd admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:38.790260 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb72d0a-ff38-42dc-b440-7393947e60dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:38.790886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb72d0a-ff38-42dc-b440-7393947e60dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:38.791164 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb72d0a-ff38-42dc-b440-7393947e60dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:38.791434 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb72d0a-ff38-42dc-b440-7393947e60dc admin admin] PATH_INFO: `/v3/projects/241a011b4362459baefb59900fb3226d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:38.792536 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb72d0a-ff38-42dc-b440-7393947e60dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=241a011b4362459baefb59900fb3226d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:38.794493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb72d0a-ff38-42dc-b440-7393947e60dc admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:38.881857 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 980/1960] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:38 2022] POST /identity/v3/users => generated 292 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:38.882789 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85b537-e3b4-4b66-a600-d656395cb805 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:38.884607 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7f85b537-e3b4-4b66-a600-d656395cb805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:38.896032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4eb72d0a-ff38-42dc-b440-7393947e60dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '241a011b4362459baefb59900fb3226d', 'request_id': 'req-4eb72d0a-ff38-42dc-b440-7393947e60dc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:38.897964 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85b537-e3b4-4b66-a600-d656395cb805 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:38.902012 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4eb72d0a-ff38-42dc-b440-7393947e60dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '241a011b4362459baefb59900fb3226d', 'request_id': 'req-4eb72d0a-ff38-42dc-b440-7393947e60dc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:38.970706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471fd83-59d3-4fc9-b5f7-c5ac88921f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:38.972031 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471fd83-59d3-4fc9-b5f7-c5ac88921f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:38.972317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471fd83-59d3-4fc9-b5f7-c5ac88921f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:38.976499 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471fd83-59d3-4fc9-b5f7-c5ac88921f7b admin admin] PATH_INFO: `/v3/users/b4111c795b15495e8936711c0a5ce0cb` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:38.976499 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471fd83-59d3-4fc9-b5f7-c5ac88921f7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4111c795b15495e8936711c0a5ce0cb)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:38.978527 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471fd83-59d3-4fc9-b5f7-c5ac88921f7b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:38.994836 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4eb72d0a-ff38-42dc-b440-7393947e60dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '241a011b4362459baefb59900fb3226d', 'request_id': 'req-4eb72d0a-ff38-42dc-b440-7393947e60dc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:39.023548 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4eb72d0a-ff38-42dc-b440-7393947e60dc admin admin] The token cache is being invalidate because project 241a011b4362459baefb59900fb3226d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:39.023839 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4eb72d0a-ff38-42dc-b440-7393947e60dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:39.024512 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4eb72d0a-ff38-42dc-b440-7393947e60dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:39.026123 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 981/1961] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:38 2022] DELETE /identity/v3/projects/241a011b4362459baefb59900fb3226d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:39.026925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb72d0a-ff38-42dc-b440-7393947e60dc admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:39.028494 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4eb72d0a-ff38-42dc-b440-7393947e60dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:39.041858 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb72d0a-ff38-42dc-b440-7393947e60dc admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:39.046435 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a456e9-9d4f-45f2-9577-eaf0c03a7c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:39.047060 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a456e9-9d4f-45f2-9577-eaf0c03a7c87 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:39.047335 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a456e9-9d4f-45f2-9577-eaf0c03a7c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:39.047634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a456e9-9d4f-45f2-9577-eaf0c03a7c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:39.048276 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a456e9-9d4f-45f2-9577-eaf0c03a7c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:39.050561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a456e9-9d4f-45f2-9577-eaf0c03a7c87 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:39.065941 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 982/1962] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:39.065941 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a456e9-9d4f-45f2-9577-eaf0c03a7c87 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:39.065941 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-85a456e9-9d4f-45f2-9577-eaf0c03a7c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:39.078094 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a456e9-9d4f-45f2-9577-eaf0c03a7c87 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:39.083146 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93eb1e-22e5-45b7-8184-2dd341bda2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:39.083830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93eb1e-22e5-45b7-8184-2dd341bda2f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:39.084303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93eb1e-22e5-45b7-8184-2dd341bda2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:39.084642 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93eb1e-22e5-45b7-8184-2dd341bda2f9 admin admin] PATH_INFO: `/v3/users/7f3b0c83d41045c0b18a6e8458e5cb8f` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:39.085926 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93eb1e-22e5-45b7-8184-2dd341bda2f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f3b0c83d41045c0b18a6e8458e5cb8f)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:39.088001 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93eb1e-22e5-45b7-8184-2dd341bda2f9 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:39.203989 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8471fd83-59d3-4fc9-b5f7-c5ac88921f7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4111c795b15495e8936711c0a5ce0cb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:39.204627 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8471fd83-59d3-4fc9-b5f7-c5ac88921f7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4111c795b15495e8936711c0a5ce0cb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:39.268769 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8471fd83-59d3-4fc9-b5f7-c5ac88921f7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4111c795b15495e8936711c0a5ce0cb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:39.282126 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8471fd83-59d3-4fc9-b5f7-c5ac88921f7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4111c795b15495e8936711c0a5ce0cb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:39.284101 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8471fd83-59d3-4fc9-b5f7-c5ac88921f7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4111c795b15495e8936711c0a5ce0cb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:39.288005 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-bb93eb1e-22e5-45b7-8184-2dd341bda2f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f3b0c83d41045c0b18a6e8458e5cb8f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:39.309843 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 981/1963] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:38 2022] DELETE /identity/v3/users/b4111c795b15495e8936711c0a5ce0cb => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:39.312903 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471fd83-59d3-4fc9-b5f7-c5ac88921f7b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:39.312903 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8471fd83-59d3-4fc9-b5f7-c5ac88921f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:39.372194 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-bb93eb1e-22e5-45b7-8184-2dd341bda2f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f3b0c83d41045c0b18a6e8458e5cb8f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:39.384230 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471fd83-59d3-4fc9-b5f7-c5ac88921f7b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:39.389401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3d1ef-076d-4a0b-bf66-96a35a718ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:39.389961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3d1ef-076d-4a0b-bf66-96a35a718ceb admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:39.390162 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-bb93eb1e-22e5-45b7-8184-2dd341bda2f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f3b0c83d41045c0b18a6e8458e5cb8f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:39.390353 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3d1ef-076d-4a0b-bf66-96a35a718ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:39.390580 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3d1ef-076d-4a0b-bf66-96a35a718ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:39.390838 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-bb93eb1e-22e5-45b7-8184-2dd341bda2f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f3b0c83d41045c0b18a6e8458e5cb8f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:39.391431 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3d1ef-076d-4a0b-bf66-96a35a718ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:39.393474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3d1ef-076d-4a0b-bf66-96a35a718ceb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:39.398465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-bb93eb1e-22e5-45b7-8184-2dd341bda2f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f3b0c83d41045c0b18a6e8458e5cb8f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:39.404539 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 982/1964] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:39.405697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 983/1965] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:39 2022] DELETE /identity/v3/users/7f3b0c83d41045c0b18a6e8458e5cb8f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:39.409157 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3d1ef-076d-4a0b-bf66-96a35a718ceb admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:39.411868 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9ac3d1ef-076d-4a0b-bf66-96a35a718ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:39.438249 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3d1ef-076d-4a0b-bf66-96a35a718ceb admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:39.528931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac65c97-07b7-4e41-93da-894e27acae57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:39.529724 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac65c97-07b7-4e41-93da-894e27acae57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:39.530146 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac65c97-07b7-4e41-93da-894e27acae57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:39.530516 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac65c97-07b7-4e41-93da-894e27acae57 admin admin] PATH_INFO: `/v3/projects/282407d481ac475a973951917ef33851/users/283b6df7aaf741b284d97004c9026cb2/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:39.548513 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac65c97-07b7-4e41-93da-894e27acae57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=282407d481ac475a973951917ef33851, user_id=283b6df7aaf741b284d97004c9026cb2, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:39.552122 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac65c97-07b7-4e41-93da-894e27acae57 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:39.602621 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb150504-0e30-4ae4-8617-ba4ef8c5f122 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:39.603257 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb150504-0e30-4ae4-8617-ba4ef8c5f122 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:39.603765 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb150504-0e30-4ae4-8617-ba4ef8c5f122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:39.617714 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:39.663125 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-cb150504-0e30-4ae4-8617-ba4ef8c5f122 None None] MFA Rules not processed for user `8acb5686883a43fc8984e2f6e23c56d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:39.664758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-cb150504-0e30-4ae4-8617-ba4ef8c5f122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:39.690113 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 983/1966] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:39 2022] PUT /identity/v3/projects/282407d481ac475a973951917ef33851/users/283b6df7aaf741b284d97004c9026cb2/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:35:39.698356 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edbf1d-4832-440b-b12e-b78abeba4221 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:39.699250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edbf1d-4832-440b-b12e-b78abeba4221 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:39.699925 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edbf1d-4832-440b-b12e-b78abeba4221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:39.738808 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a9edbf1d-4832-440b-b12e-b78abeba4221 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:39.740268 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a9edbf1d-4832-440b-b12e-b78abeba4221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:39.773527 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 984/1967] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:35:39.774467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb150504-0e30-4ae4-8617-ba4ef8c5f122 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:39.775889 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-cb150504-0e30-4ae4-8617-ba4ef8c5f122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:39.795228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb150504-0e30-4ae4-8617-ba4ef8c5f122 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:39.813931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 984/1968] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:35:39.823826 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edbf1d-4832-440b-b12e-b78abeba4221 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:39.825880 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a9edbf1d-4832-440b-b12e-b78abeba4221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:39.860851 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b38bb-f999-4f0e-8f95-53b8ead5a64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:39.862002 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b38bb-f999-4f0e-8f95-53b8ead5a64e admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:39.862282 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b38bb-f999-4f0e-8f95-53b8ead5a64e admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:39.862563 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b38bb-f999-4f0e-8f95-53b8ead5a64e admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:39.863187 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b38bb-f999-4f0e-8f95-53b8ead5a64e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:39.865417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b38bb-f999-4f0e-8f95-53b8ead5a64e admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:39.901782 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edbf1d-4832-440b-b12e-b78abeba4221 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:39.905612 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae09148-def0-4176-a2ef-90a3ce0c9928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:39.906259 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae09148-def0-4176-a2ef-90a3ce0c9928 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:39.906539 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae09148-def0-4176-a2ef-90a3ce0c9928 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:39.906813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae09148-def0-4176-a2ef-90a3ce0c9928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:39.916909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae09148-def0-4176-a2ef-90a3ce0c9928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:39.918362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae09148-def0-4176-a2ef-90a3ce0c9928 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:39.928104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 985/1969] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:39.974024 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 985/1970] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:39 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:39.977200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae09148-def0-4176-a2ef-90a3ce0c9928 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:39.977200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fae09148-def0-4176-a2ef-90a3ce0c9928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:39.977495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b38bb-f999-4f0e-8f95-53b8ead5a64e admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:39.988671 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae09148-def0-4176-a2ef-90a3ce0c9928 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:40.061215 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b38bb-f999-4f0e-8f95-53b8ead5a64e admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:40.066953 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e7daf-d2bd-4559-8bea-864b70ec75ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:40.067720 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e7daf-d2bd-4559-8bea-864b70ec75ca admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:40.068001 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e7daf-d2bd-4559-8bea-864b70ec75ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:40.068272 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e7daf-d2bd-4559-8bea-864b70ec75ca admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:40.068910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e7daf-d2bd-4559-8bea-864b70ec75ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:40.070987 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e7daf-d2bd-4559-8bea-864b70ec75ca admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:40.099401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b36a27-db4e-4610-922d-54452966e7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:40.100149 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b36a27-db4e-4610-922d-54452966e7a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:40.100770 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b36a27-db4e-4610-922d-54452966e7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:40.100770 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b36a27-db4e-4610-922d-54452966e7a2 admin admin] PATH_INFO: `/v3/projects/fbd18cbb72aa4422b9252cf068efa9dd` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:40.101973 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b36a27-db4e-4610-922d-54452966e7a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbd18cbb72aa4422b9252cf068efa9dd)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:40.103971 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b36a27-db4e-4610-922d-54452966e7a2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:40.107913 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:40.157895 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 986/1971] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:39 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:40.159717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e7daf-d2bd-4559-8bea-864b70ec75ca admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:40.161974 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4c2e7daf-d2bd-4559-8bea-864b70ec75ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:40.174911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e7daf-d2bd-4559-8bea-864b70ec75ca admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:40.183418 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab69da9-ac54-4c23-b1a2-f468aeee6dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:40.184316 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab69da9-ac54-4c23-b1a2-f468aeee6dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:40.184600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab69da9-ac54-4c23-b1a2-f468aeee6dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:40.184877 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab69da9-ac54-4c23-b1a2-f468aeee6dc0 admin admin] PATH_INFO: `/v3/projects/46b0f36353cf449eb7e5571c7f570027` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:40.186035 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab69da9-ac54-4c23-b1a2-f468aeee6dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46b0f36353cf449eb7e5571c7f570027)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:40.187992 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab69da9-ac54-4c23-b1a2-f468aeee6dc0 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:40.249173 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a0b36a27-db4e-4610-922d-54452966e7a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbd18cbb72aa4422b9252cf068efa9dd', 'request_id': 'req-a0b36a27-db4e-4610-922d-54452966e7a2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:40.256748 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a0b36a27-db4e-4610-922d-54452966e7a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbd18cbb72aa4422b9252cf068efa9dd', 'request_id': 'req-a0b36a27-db4e-4610-922d-54452966e7a2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:40.365003 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-7ab69da9-ac54-4c23-b1a2-f468aeee6dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46b0f36353cf449eb7e5571c7f570027', 'request_id': 'req-7ab69da9-ac54-4c23-b1a2-f468aeee6dc0'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:40.370392 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-7ab69da9-ac54-4c23-b1a2-f468aeee6dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46b0f36353cf449eb7e5571c7f570027', 'request_id': 'req-7ab69da9-ac54-4c23-b1a2-f468aeee6dc0'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:40.380282 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a0b36a27-db4e-4610-922d-54452966e7a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbd18cbb72aa4422b9252cf068efa9dd', 'request_id': 'req-a0b36a27-db4e-4610-922d-54452966e7a2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:40.391962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a0b36a27-db4e-4610-922d-54452966e7a2 admin admin] The token cache is being invalidate because project fbd18cbb72aa4422b9252cf068efa9dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:40.392247 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a0b36a27-db4e-4610-922d-54452966e7a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:40.393882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a0b36a27-db4e-4610-922d-54452966e7a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:40.395369 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 986/1972] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:39 2022] DELETE /identity/v3/projects/fbd18cbb72aa4422b9252cf068efa9dd => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:40.396816 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b36a27-db4e-4610-922d-54452966e7a2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:40.398235 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a0b36a27-db4e-4610-922d-54452966e7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:40.469244 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b36a27-db4e-4610-922d-54452966e7a2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:40.480308 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-7ab69da9-ac54-4c23-b1a2-f468aeee6dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46b0f36353cf449eb7e5571c7f570027', 'request_id': 'req-7ab69da9-ac54-4c23-b1a2-f468aeee6dc0'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:40.498178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-7ab69da9-ac54-4c23-b1a2-f468aeee6dc0 admin admin] The token cache is being invalidate because project 46b0f36353cf449eb7e5571c7f570027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:40.498487 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-7ab69da9-ac54-4c23-b1a2-f468aeee6dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:40.499514 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-7ab69da9-ac54-4c23-b1a2-f468aeee6dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:40.505972 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 987/1973] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:40 2022] DELETE /identity/v3/projects/46b0f36353cf449eb7e5571c7f570027 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:40.507625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a88f05-bdbd-4f8d-9c3c-4fbea7a5f616 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:40.508155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a88f05-bdbd-4f8d-9c3c-4fbea7a5f616 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:40.508673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a88f05-bdbd-4f8d-9c3c-4fbea7a5f616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:40.538726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-14a88f05-bdbd-4f8d-9c3c-4fbea7a5f616 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:40.539973 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-14a88f05-bdbd-4f8d-9c3c-4fbea7a5f616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:40.548350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc1d24-6a02-492c-86af-7cf1f701df5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:40.549818 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc1d24-6a02-492c-86af-7cf1f701df5a admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:40.550104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc1d24-6a02-492c-86af-7cf1f701df5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:40.558164 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc1d24-6a02-492c-86af-7cf1f701df5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:40.558164 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc1d24-6a02-492c-86af-7cf1f701df5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:40.558164 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc1d24-6a02-492c-86af-7cf1f701df5a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:40.568524 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 987/1974] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:40.569805 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4180d-4d28-4b65-8589-a7524c6469f7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:40.570094 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4180d-4d28-4b65-8589-a7524c6469f7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:40.570372 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4180d-4d28-4b65-8589-a7524c6469f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:40.676989 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-bbb4180d-4d28-4b65-8589-a7524c6469f7 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:40.679439 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bbb4180d-4d28-4b65-8589-a7524c6469f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:40.692541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 988/1975] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:40.693722 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4180d-4d28-4b65-8589-a7524c6469f7 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:40.699461 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 988/1976] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:40.701768 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fdb64-3bfe-4e72-aacf-824d4e29e4ac None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:40.701768 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fdb64-3bfe-4e72-aacf-824d4e29e4ac None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:40.701768 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fdb64-3bfe-4e72-aacf-824d4e29e4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:40.702294 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bbb4180d-4d28-4b65-8589-a7524c6469f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:40.736435 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4180d-4d28-4b65-8589-a7524c6469f7 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:40.741270 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83866a-4d8d-4124-a03b-d49688db78a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:40.742109 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83866a-4d8d-4124-a03b-d49688db78a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:40.742399 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83866a-4d8d-4124-a03b-d49688db78a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:40.742678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83866a-4d8d-4124-a03b-d49688db78a8 admin admin] PATH_INFO: `/v3/projects/67da7c3ef1ba4aa49bed791a6da11519/users/06d2f6687c7f41b0b1d5faee851d4ee6/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:40.755208 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-4b6fdb64-3bfe-4e72-aacf-824d4e29e4ac None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:40.757800 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4b6fdb64-3bfe-4e72-aacf-824d4e29e4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:40.768985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83866a-4d8d-4124-a03b-d49688db78a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67da7c3ef1ba4aa49bed791a6da11519, user_id=06d2f6687c7f41b0b1d5faee851d4ee6, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:40.771941 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83866a-4d8d-4124-a03b-d49688db78a8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:40.774994 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 989/1977] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:40.776271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39630118-f79b-4d6d-bba3-a802ca0d81a0 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:40.776651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39630118-f79b-4d6d-bba3-a802ca0d81a0 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:40.776983 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39630118-f79b-4d6d-bba3-a802ca0d81a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:40.796624 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-39630118-f79b-4d6d-bba3-a802ca0d81a0 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:40.797951 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-39630118-f79b-4d6d-bba3-a802ca0d81a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:40.809294 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 990/1978] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:40.810404 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39630118-f79b-4d6d-bba3-a802ca0d81a0 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:40.821829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39630118-f79b-4d6d-bba3-a802ca0d81a0 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:40.826623 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657e1e4-a8bb-4b8e-8ba1-5feeabbdc289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:40.827329 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657e1e4-a8bb-4b8e-8ba1-5feeabbdc289 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:40.827663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657e1e4-a8bb-4b8e-8ba1-5feeabbdc289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:40.827995 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657e1e4-a8bb-4b8e-8ba1-5feeabbdc289 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:40.828697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657e1e4-a8bb-4b8e-8ba1-5feeabbdc289 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:35:40.829130 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657e1e4-a8bb-4b8e-8ba1-5feeabbdc289 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:40.831666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657e1e4-a8bb-4b8e-8ba1-5feeabbdc289 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:40.844260 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 991/1979] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:35:40.845165 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657e1e4-a8bb-4b8e-8ba1-5feeabbdc289 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:40.854971 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657e1e4-a8bb-4b8e-8ba1-5feeabbdc289 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:40.859423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7737bb5-dfa3-4a8a-ac31-4c7617ed01e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:40.859999 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7737bb5-dfa3-4a8a-ac31-4c7617ed01e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:40.860273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7737bb5-dfa3-4a8a-ac31-4c7617ed01e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:40.860542 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7737bb5-dfa3-4a8a-ac31-4c7617ed01e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:40.861225 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7737bb5-dfa3-4a8a-ac31-4c7617ed01e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:35:40.861551 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7737bb5-dfa3-4a8a-ac31-4c7617ed01e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:40.863177 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7737bb5-dfa3-4a8a-ac31-4c7617ed01e2 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:40.874458 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 989/1980] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:40 2022] PUT /identity/v3/projects/67da7c3ef1ba4aa49bed791a6da11519/users/06d2f6687c7f41b0b1d5faee851d4ee6/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:40.878051 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 992/1981] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:35:40.878051 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7737bb5-dfa3-4a8a-ac31-4c7617ed01e2 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:40.879268 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83866a-4d8d-4124-a03b-d49688db78a8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:40.889306 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7737bb5-dfa3-4a8a-ac31-4c7617ed01e2 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:40.961764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6db228-9341-48a7-bad0-08d7d7183250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:40.962451 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6db228-9341-48a7-bad0-08d7d7183250 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:40.962977 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6db228-9341-48a7-bad0-08d7d7183250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:40.963353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6db228-9341-48a7-bad0-08d7d7183250 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:40.964203 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6db228-9341-48a7-bad0-08d7d7183250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:40.964501 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83866a-4d8d-4124-a03b-d49688db78a8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:40.966348 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6db228-9341-48a7-bad0-08d7d7183250 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:40.970309 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f31d5a-8a31-4875-85cb-ea0c66bf7227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:40.970971 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f31d5a-8a31-4875-85cb-ea0c66bf7227 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:40.971257 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f31d5a-8a31-4875-85cb-ea0c66bf7227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:40.971869 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f31d5a-8a31-4875-85cb-ea0c66bf7227 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:40.972827 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f31d5a-8a31-4875-85cb-ea0c66bf7227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:40.974508 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f31d5a-8a31-4875-85cb-ea0c66bf7227 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:40.989659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 990/1982] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:40.989659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f31d5a-8a31-4875-85cb-ea0c66bf7227 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:40.997578 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f31d5a-8a31-4875-85cb-ea0c66bf7227 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:41.003458 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780882f9-13b8-4cd9-a134-8a99157068d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:41.004073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780882f9-13b8-4cd9-a134-8a99157068d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:41.004355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780882f9-13b8-4cd9-a134-8a99157068d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:41.004627 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780882f9-13b8-4cd9-a134-8a99157068d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:41.006045 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780882f9-13b8-4cd9-a134-8a99157068d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:41.008129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780882f9-13b8-4cd9-a134-8a99157068d8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:41.061926 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 993/1983] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:40 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:41.061926 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6db228-9341-48a7-bad0-08d7d7183250 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:41.112380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 991/1984] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:40 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:41.113069 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780882f9-13b8-4cd9-a134-8a99157068d8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:41.150949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6db228-9341-48a7-bad0-08d7d7183250 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:41.218226 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780882f9-13b8-4cd9-a134-8a99157068d8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:41.223475 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a7627-6eb1-4046-9412-316701018bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:41.224150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a7627-6eb1-4046-9412-316701018bdc admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:41.224441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a7627-6eb1-4046-9412-316701018bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:41.224720 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a7627-6eb1-4046-9412-316701018bdc admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:41.225685 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a7627-6eb1-4046-9412-316701018bdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:41.227590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a7627-6eb1-4046-9412-316701018bdc admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:41.228199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04cd12-8557-4cbb-a9b8-e658f536b4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:41.228875 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04cd12-8557-4cbb-a9b8-e658f536b4a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:41.229185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04cd12-8557-4cbb-a9b8-e658f536b4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:41.229454 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04cd12-8557-4cbb-a9b8-e658f536b4a3 admin admin] PATH_INFO: `/v3/projects/67da7c3ef1ba4aa49bed791a6da11519/users/06d2f6687c7f41b0b1d5faee851d4ee6/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:41.231583 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04cd12-8557-4cbb-a9b8-e658f536b4a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67da7c3ef1ba4aa49bed791a6da11519, user_id=06d2f6687c7f41b0b1d5faee851d4ee6, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:41.234341 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04cd12-8557-4cbb-a9b8-e658f536b4a3 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:41.245513 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 994/1985] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:41 2022] PUT /identity/v3/projects/67da7c3ef1ba4aa49bed791a6da11519/users/06d2f6687c7f41b0b1d5faee851d4ee6/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:41.246219 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04cd12-8557-4cbb-a9b8-e658f536b4a3 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:41.324057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04cd12-8557-4cbb-a9b8-e658f536b4a3 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:41.329758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd6b28-b537-4bfb-9fa1-ad20262c1d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:41.330394 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd6b28-b537-4bfb-9fa1-ad20262c1d6d admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:41.330692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd6b28-b537-4bfb-9fa1-ad20262c1d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:41.333193 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd6b28-b537-4bfb-9fa1-ad20262c1d6d admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:41.333193 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd6b28-b537-4bfb-9fa1-ad20262c1d6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:41.333516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd6b28-b537-4bfb-9fa1-ad20262c1d6d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:41.360381 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 992/1986] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:41 2022] POST /identity/v3/users => generated 292 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:41.365535 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a7627-6eb1-4046-9412-316701018bdc admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:41.376464 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a7627-6eb1-4046-9412-316701018bdc admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:41.382216 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826f567-b4a8-4f0d-a7bd-338c9ef500d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:41.382843 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826f567-b4a8-4f0d-a7bd-338c9ef500d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:41.387710 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826f567-b4a8-4f0d-a7bd-338c9ef500d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:41.387710 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826f567-b4a8-4f0d-a7bd-338c9ef500d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:41.387710 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826f567-b4a8-4f0d-a7bd-338c9ef500d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:41.387710 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826f567-b4a8-4f0d-a7bd-338c9ef500d9 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:41.397185 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 993/1987] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:41.400754 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826f567-b4a8-4f0d-a7bd-338c9ef500d9 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:41.416867 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826f567-b4a8-4f0d-a7bd-338c9ef500d9 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:41.421937 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5a2ff-fa59-4889-ab86-8568641ee838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:41.422565 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5a2ff-fa59-4889-ab86-8568641ee838 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:41.422847 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5a2ff-fa59-4889-ab86-8568641ee838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:41.423214 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5a2ff-fa59-4889-ab86-8568641ee838 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:41.424419 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5a2ff-fa59-4889-ab86-8568641ee838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:41.426131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5a2ff-fa59-4889-ab86-8568641ee838 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:41.443647 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 995/1988] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:41 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:41.447777 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd6b28-b537-4bfb-9fa1-ad20262c1d6d admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:41.452450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 994/1989] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:41.453702 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5a2ff-fa59-4889-ab86-8568641ee838 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:41.460379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd6b28-b537-4bfb-9fa1-ad20262c1d6d admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:41.464224 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5a2ff-fa59-4889-ab86-8568641ee838 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:41.466130 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e809d-374c-4f2d-8052-190102dfb408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:41.466977 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e809d-374c-4f2d-8052-190102dfb408 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:41.467255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e809d-374c-4f2d-8052-190102dfb408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:41.467527 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e809d-374c-4f2d-8052-190102dfb408 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:41.468620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e809d-374c-4f2d-8052-190102dfb408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:41.470002 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e809d-374c-4f2d-8052-190102dfb408 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:41.472552 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428d9a9-002f-4cee-97ba-37968c6c386d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:41.473377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428d9a9-002f-4cee-97ba-37968c6c386d admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:41.473713 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428d9a9-002f-4cee-97ba-37968c6c386d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:41.479534 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428d9a9-002f-4cee-97ba-37968c6c386d admin admin] PATH_INFO: `/v3/projects/c5c41152b086404e85d64f5fe0739da5/users/9d5cb4000c3c4161b7c719c2c24f30c7/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:41.482315 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 996/1990] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:35:41.487495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e809d-374c-4f2d-8052-190102dfb408 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:41.493403 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a428d9a9-002f-4cee-97ba-37968c6c386d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c41152b086404e85d64f5fe0739da5, user_id=9d5cb4000c3c4161b7c719c2c24f30c7, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:41.496242 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a428d9a9-002f-4cee-97ba-37968c6c386d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:41.498062 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e809d-374c-4f2d-8052-190102dfb408 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:41.503479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2eb1d-e049-4826-b148-6db76637edab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:41.504085 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2eb1d-e049-4826-b148-6db76637edab admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:41.504403 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2eb1d-e049-4826-b148-6db76637edab admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:41.504679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2eb1d-e049-4826-b148-6db76637edab admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:41.506456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2eb1d-e049-4826-b148-6db76637edab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:41.507148 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2eb1d-e049-4826-b148-6db76637edab admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:41.525336 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 997/1991] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:35:41.527439 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aadd53-5077-460d-8c30-d7abcd4f579d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:41.527780 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aadd53-5077-460d-8c30-d7abcd4f579d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:41.528063 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aadd53-5077-460d-8c30-d7abcd4f579d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:41.561153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-76aadd53-5077-460d-8c30-d7abcd4f579d None None] MFA Rules not processed for user `283b6df7aaf741b284d97004c9026cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:41.562400 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-76aadd53-5077-460d-8c30-d7abcd4f579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:41.627864 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 995/1992] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:41 2022] PUT /identity/v3/projects/c5c41152b086404e85d64f5fe0739da5/users/9d5cb4000c3c4161b7c719c2c24f30c7/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:35:41.637152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428d9a9-002f-4cee-97ba-37968c6c386d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:41.637253 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 998/1993] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:41.638223 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7684f8-3529-4796-9f32-c85f21d2f7b7 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:41.638510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7684f8-3529-4796-9f32-c85f21d2f7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:41.640096 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7684f8-3529-4796-9f32-c85f21d2f7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:41.682839 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-cf7684f8-3529-4796-9f32-c85f21d2f7b7 None None] MFA Rules not processed for user `9d5cb4000c3c4161b7c719c2c24f30c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:41.685110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-cf7684f8-3529-4796-9f32-c85f21d2f7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:41.725923 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:41.730229 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428d9a9-002f-4cee-97ba-37968c6c386d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:41.739529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917869ef-c0ce-4890-bfdc-beed16ae952c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:41.740435 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917869ef-c0ce-4890-bfdc-beed16ae952c admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:41.740782 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917869ef-c0ce-4890-bfdc-beed16ae952c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:41.741153 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917869ef-c0ce-4890-bfdc-beed16ae952c admin admin] PATH_INFO: `/v3/projects/ecdfc8d136774a18b23720771e39b65c/users/4bbb5623f31b417184c5ea2a41cf9d60/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:41.761871 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917869ef-c0ce-4890-bfdc-beed16ae952c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecdfc8d136774a18b23720771e39b65c, user_id=4bbb5623f31b417184c5ea2a41cf9d60, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:41.764644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917869ef-c0ce-4890-bfdc-beed16ae952c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:41.784571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 999/1994] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:41.788877 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7684f8-3529-4796-9f32-c85f21d2f7b7 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:41.790283 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-cf7684f8-3529-4796-9f32-c85f21d2f7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:41.851642 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:41.853218 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7684f8-3529-4796-9f32-c85f21d2f7b7 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:41.857078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28babd97-6d0b-4a2a-88a6-31aa91f838e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:41.857711 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28babd97-6d0b-4a2a-88a6-31aa91f838e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:41.857988 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28babd97-6d0b-4a2a-88a6-31aa91f838e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:41.858252 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28babd97-6d0b-4a2a-88a6-31aa91f838e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:41.903418 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 996/1995] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:41 2022] PUT /identity/v3/projects/ecdfc8d136774a18b23720771e39b65c/users/4bbb5623f31b417184c5ea2a41cf9d60/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:41.904237 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917869ef-c0ce-4890-bfdc-beed16ae952c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:41.937908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28babd97-6d0b-4a2a-88a6-31aa91f838e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:41.939590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28babd97-6d0b-4a2a-88a6-31aa91f838e1 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:41.973473 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1000/1996] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:41.974960 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bd504-8883-468f-8fd0-d183941ba8b8 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:41.975250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bd504-8883-468f-8fd0-d183941ba8b8 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:41.975523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bd504-8883-468f-8fd0-d183941ba8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:42.005287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917869ef-c0ce-4890-bfdc-beed16ae952c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:42.012512 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eec59f-40d3-427c-b8cf-0176c55290f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:42.013289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eec59f-40d3-427c-b8cf-0176c55290f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:42.013631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eec59f-40d3-427c-b8cf-0176c55290f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:42.013971 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eec59f-40d3-427c-b8cf-0176c55290f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:42.014682 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eec59f-40d3-427c-b8cf-0176c55290f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:42.016865 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eec59f-40d3-427c-b8cf-0176c55290f6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:42.055044 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-002bd504-8883-468f-8fd0-d183941ba8b8 None None] MFA Rules not processed for user `4bbb5623f31b417184c5ea2a41cf9d60`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:42.056576 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-002bd504-8883-468f-8fd0-d183941ba8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:42.156269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 997/1997] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:41 2022] POST /identity/v3/projects => generated 383 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:42.162250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eec59f-40d3-427c-b8cf-0176c55290f6 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:42.179551 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1001/1998] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:42.190584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bd504-8883-468f-8fd0-d183941ba8b8 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:42.206183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bd504-8883-468f-8fd0-d183941ba8b8 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:42.251547 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eec59f-40d3-427c-b8cf-0176c55290f6 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:42.257881 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d9506-a156-4b5c-97b1-021cb6709319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:42.258548 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d9506-a156-4b5c-97b1-021cb6709319 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:42.258843 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d9506-a156-4b5c-97b1-021cb6709319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:42.259183 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d9506-a156-4b5c-97b1-021cb6709319 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:42.259886 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d9506-a156-4b5c-97b1-021cb6709319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:42.261961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d9506-a156-4b5c-97b1-021cb6709319 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:42.288558 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8878b0-e4fe-4d7c-95f7-bbb6cec7be39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:42.293224 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8878b0-e4fe-4d7c-95f7-bbb6cec7be39 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:42.293224 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8878b0-e4fe-4d7c-95f7-bbb6cec7be39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:42.293224 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8878b0-e4fe-4d7c-95f7-bbb6cec7be39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:42.293224 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8878b0-e4fe-4d7c-95f7-bbb6cec7be39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:42.293224 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8878b0-e4fe-4d7c-95f7-bbb6cec7be39 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:42.365803 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 998/1999] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:42 2022] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:42.367523 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d9506-a156-4b5c-97b1-021cb6709319 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:42.378994 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d9506-a156-4b5c-97b1-021cb6709319 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:42.386365 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce884266-a8b0-460f-a248-8644d50a3889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:42.387193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce884266-a8b0-460f-a248-8644d50a3889 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:42.387455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce884266-a8b0-460f-a248-8644d50a3889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:42.387777 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce884266-a8b0-460f-a248-8644d50a3889 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:42.388567 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce884266-a8b0-460f-a248-8644d50a3889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:42.390465 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce884266-a8b0-460f-a248-8644d50a3889 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:42.399042 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1002/2000] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:42 2022] POST /identity/v3/projects => generated 373 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:42.402914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8878b0-e4fe-4d7c-95f7-bbb6cec7be39 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:42.405412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 999/2001] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:42.407811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce884266-a8b0-460f-a248-8644d50a3889 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:42.418566 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce884266-a8b0-460f-a248-8644d50a3889 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:42.472578 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8878b0-e4fe-4d7c-95f7-bbb6cec7be39 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:42.477214 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dec624-62c2-425a-848c-4dac593c92ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:42.477996 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dec624-62c2-425a-848c-4dac593c92ff admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:42.478116 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dec624-62c2-425a-848c-4dac593c92ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:42.478704 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dec624-62c2-425a-848c-4dac593c92ff admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:42.479068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dec624-62c2-425a-848c-4dac593c92ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:42.480980 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dec624-62c2-425a-848c-4dac593c92ff admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:42.484659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f576124-e1f4-4bb3-a2a6-a8a54dcc355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:42.485403 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f576124-e1f4-4bb3-a2a6-a8a54dcc355f admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:42.485679 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f576124-e1f4-4bb3-a2a6-a8a54dcc355f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:42.486002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f576124-e1f4-4bb3-a2a6-a8a54dcc355f admin admin] PATH_INFO: `/v3/projects/5bd3f4b8378a429790164ad3f18f7721/users/b279b860ba61446093014ae175f881d9/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:42.503474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f576124-e1f4-4bb3-a2a6-a8a54dcc355f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd3f4b8378a429790164ad3f18f7721, user_id=b279b860ba61446093014ae175f881d9, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:42.506286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f576124-e1f4-4bb3-a2a6-a8a54dcc355f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:42.575136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1003/2002] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:42 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:42.576807 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dec624-62c2-425a-848c-4dac593c92ff admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:42.592601 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dec624-62c2-425a-848c-4dac593c92ff admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:42.598621 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdf109-0bae-403d-83e4-877d6aa0bf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:42.599229 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdf109-0bae-403d-83e4-877d6aa0bf46 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:42.599662 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdf109-0bae-403d-83e4-877d6aa0bf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:42.599967 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdf109-0bae-403d-83e4-877d6aa0bf46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:42.600746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdf109-0bae-403d-83e4-877d6aa0bf46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:42.602400 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdf109-0bae-403d-83e4-877d6aa0bf46 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:42.619199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1004/2003] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:42.620147 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdf109-0bae-403d-83e4-877d6aa0bf46 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:42.631167 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdf109-0bae-403d-83e4-877d6aa0bf46 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:42.636328 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c868a-9ad3-4fac-b583-c9a7d2cfb061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:42.637047 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c868a-9ad3-4fac-b583-c9a7d2cfb061 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:42.637405 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c868a-9ad3-4fac-b583-c9a7d2cfb061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:42.637677 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c868a-9ad3-4fac-b583-c9a7d2cfb061 admin admin] PATH_INFO: `/v3/projects/3cb054b66aa940ffa0a8555c4bded9cb/users/5e6c280aea9c4fc3a4118c93d79ba921/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:42.641954 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1000/2004] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:42 2022] PUT /identity/v3/projects/5bd3f4b8378a429790164ad3f18f7721/users/b279b860ba61446093014ae175f881d9/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:42.645136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f576124-e1f4-4bb3-a2a6-a8a54dcc355f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:42.663418 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c868a-9ad3-4fac-b583-c9a7d2cfb061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb054b66aa940ffa0a8555c4bded9cb, user_id=5e6c280aea9c4fc3a4118c93d79ba921, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:42.667153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c868a-9ad3-4fac-b583-c9a7d2cfb061 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:42.716566 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f576124-e1f4-4bb3-a2a6-a8a54dcc355f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:42.721414 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82c90e-86fb-4e4d-b3c0-d046fdd583c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:42.722015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82c90e-86fb-4e4d-b3c0-d046fdd583c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:42.722294 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82c90e-86fb-4e4d-b3c0-d046fdd583c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:42.722561 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82c90e-86fb-4e4d-b3c0-d046fdd583c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:42.723195 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82c90e-86fb-4e4d-b3c0-d046fdd583c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:42.724790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82c90e-86fb-4e4d-b3c0-d046fdd583c0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:42.734437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1001/2005] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:35:42.739058 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82c90e-86fb-4e4d-b3c0-d046fdd583c0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:42.748245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82c90e-86fb-4e4d-b3c0-d046fdd583c0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:42.752980 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1005/2006] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:42 2022] PUT /identity/v3/projects/3cb054b66aa940ffa0a8555c4bded9cb/users/5e6c280aea9c4fc3a4118c93d79ba921/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:42.758983 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c868a-9ad3-4fac-b583-c9a7d2cfb061 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:42.806854 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b15de4-6875-4c5b-af00-fddae5e93871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:42.807597 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b15de4-6875-4c5b-af00-fddae5e93871 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:42.807801 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b15de4-6875-4c5b-af00-fddae5e93871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:42.808079 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b15de4-6875-4c5b-af00-fddae5e93871 admin admin] PATH_INFO: `/v3/projects/5bd3f4b8378a429790164ad3f18f7721/users/b279b860ba61446093014ae175f881d9/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:42.810499 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b15de4-6875-4c5b-af00-fddae5e93871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd3f4b8378a429790164ad3f18f7721, user_id=b279b860ba61446093014ae175f881d9, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:42.813719 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b15de4-6875-4c5b-af00-fddae5e93871 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:42.826016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1002/2007] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:42 2022] PUT /identity/v3/projects/5bd3f4b8378a429790164ad3f18f7721/users/b279b860ba61446093014ae175f881d9/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:35:42.826401 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c868a-9ad3-4fac-b583-c9a7d2cfb061 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:42.837564 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8707a-428f-4162-871a-f07cdac6666d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:42.837722 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8707a-428f-4162-871a-f07cdac6666d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:42.837982 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8707a-428f-4162-871a-f07cdac6666d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:42.879165 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f4c8707a-428f-4162-871a-f07cdac6666d None None] MFA Rules not processed for user `b279b860ba61446093014ae175f881d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:42.880526 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f4c8707a-428f-4162-871a-f07cdac6666d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:42.906411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409c2dd-9c2c-4c56-a3cf-b7a749650aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:42.908755 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409c2dd-9c2c-4c56-a3cf-b7a749650aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:42.909625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409c2dd-9c2c-4c56-a3cf-b7a749650aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:42.909625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409c2dd-9c2c-4c56-a3cf-b7a749650aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:42.911006 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409c2dd-9c2c-4c56-a3cf-b7a749650aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:42.912764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409c2dd-9c2c-4c56-a3cf-b7a749650aa2 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:42.925537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1006/2008] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:35:42.929891 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409c2dd-9c2c-4c56-a3cf-b7a749650aa2 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:42.975667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409c2dd-9c2c-4c56-a3cf-b7a749650aa2 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:42.987184 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bcbe6-ea43-4d81-92e5-3692ae6ba9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:42.987462 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bcbe6-ea43-4d81-92e5-3692ae6ba9c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:42.997349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bcbe6-ea43-4d81-92e5-3692ae6ba9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:42.997349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bcbe6-ea43-4d81-92e5-3692ae6ba9c7 admin admin] PATH_INFO: `/v3/projects/3cb054b66aa940ffa0a8555c4bded9cb/users/5e6c280aea9c4fc3a4118c93d79ba921/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:42.997349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bcbe6-ea43-4d81-92e5-3692ae6ba9c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb054b66aa940ffa0a8555c4bded9cb, user_id=5e6c280aea9c4fc3a4118c93d79ba921, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:43.000177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1003/2009] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:43.001181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bcbe6-ea43-4d81-92e5-3692ae6ba9c7 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:43.003438 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb459a1-0cfd-4099-90ca-875eed4fd540 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:43.004354 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb459a1-0cfd-4099-90ca-875eed4fd540 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:43.004802 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb459a1-0cfd-4099-90ca-875eed4fd540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:43.047006 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1007/2010] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:42 2022] PUT /identity/v3/projects/3cb054b66aa940ffa0a8555c4bded9cb/users/5e6c280aea9c4fc3a4118c93d79ba921/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:43.049234 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bcbe6-ea43-4d81-92e5-3692ae6ba9c7 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:43.080358 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-dfb459a1-0cfd-4099-90ca-875eed4fd540 None None] MFA Rules not processed for user `06d2f6687c7f41b0b1d5faee851d4ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:43.081592 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-dfb459a1-0cfd-4099-90ca-875eed4fd540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:43.146053 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bcbe6-ea43-4d81-92e5-3692ae6ba9c7 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:43.151698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3bbcd-b0c2-4e74-801e-c169eddb3aa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:43.152514 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3bbcd-b0c2-4e74-801e-c169eddb3aa3 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:43.152916 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3bbcd-b0c2-4e74-801e-c169eddb3aa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:43.153447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3bbcd-b0c2-4e74-801e-c169eddb3aa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:43.159275 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:43.209094 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1004/2011] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:43.209094 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a381f7-5237-472d-8a20-f77fee8f23bc None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:43.209094 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a381f7-5237-472d-8a20-f77fee8f23bc None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:43.209094 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a381f7-5237-472d-8a20-f77fee8f23bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:43.241815 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3bbcd-b0c2-4e74-801e-c169eddb3aa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:43.243027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3bbcd-b0c2-4e74-801e-c169eddb3aa3 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:43.248865 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e5a381f7-5237-472d-8a20-f77fee8f23bc None None] MFA Rules not processed for user `5e6c280aea9c4fc3a4118c93d79ba921`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:43.250157 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e5a381f7-5237-472d-8a20-f77fee8f23bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:43.257262 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1008/2012] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:43.259911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19082e0f-2400-4222-ab38-b48012b16529 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:43.260323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19082e0f-2400-4222-ab38-b48012b16529 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:43.260850 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19082e0f-2400-4222-ab38-b48012b16529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:43.285797 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-19082e0f-2400-4222-ab38-b48012b16529 None None] MFA Rules not processed for user `8acb5686883a43fc8984e2f6e23c56d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:43.288379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-19082e0f-2400-4222-ab38-b48012b16529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:43.365733 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1009/2013] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:43.406636 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19082e0f-2400-4222-ab38-b48012b16529 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:43.407324 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1005/2014] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:43.408588 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-19082e0f-2400-4222-ab38-b48012b16529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:43.420775 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a381f7-5237-472d-8a20-f77fee8f23bc None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:43.431747 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a381f7-5237-472d-8a20-f77fee8f23bc None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:43.438253 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30091e95-4ef4-41ff-8798-46d74d43d525 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:43.439251 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30091e95-4ef4-41ff-8798-46d74d43d525 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:43.449446 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30091e95-4ef4-41ff-8798-46d74d43d525 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:43.449446 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30091e95-4ef4-41ff-8798-46d74d43d525 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:43.455915 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30091e95-4ef4-41ff-8798-46d74d43d525 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:43.458762 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30091e95-4ef4-41ff-8798-46d74d43d525 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:43.472582 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1006/2015] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:35:43.473442 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30091e95-4ef4-41ff-8798-46d74d43d525 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:43.474748 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-30091e95-4ef4-41ff-8798-46d74d43d525 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:43.486997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30091e95-4ef4-41ff-8798-46d74d43d525 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:43.491772 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38dd5d1-f1f0-42cc-8e49-346f16b7a86c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:43.492435 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dd5d1-f1f0-42cc-8e49-346f16b7a86c service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:43.492722 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dd5d1-f1f0-42cc-8e49-346f16b7a86c service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:43.492989 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dd5d1-f1f0-42cc-8e49-346f16b7a86c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:43.508207 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19082e0f-2400-4222-ab38-b48012b16529 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:43.514265 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82c9ef-6943-4527-a4c7-dc1b8d9abfed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:43.514872 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82c9ef-6943-4527-a4c7-dc1b8d9abfed service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:43.515154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82c9ef-6943-4527-a4c7-dc1b8d9abfed service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:43.515429 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82c9ef-6943-4527-a4c7-dc1b8d9abfed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:43.518080 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6e82c9ef-6943-4527-a4c7-dc1b8d9abfed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:43.529142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82c9ef-6943-4527-a4c7-dc1b8d9abfed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:43.530742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e82c9ef-6943-4527-a4c7-dc1b8d9abfed service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:43.541194 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1010/2016] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:35:43.560775 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38dd5d1-f1f0-42cc-8e49-346f16b7a86c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:43.562407 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38dd5d1-f1f0-42cc-8e49-346f16b7a86c service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:43.573616 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1007/2017] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:43.986822 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:44.145395 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82c9ef-6943-4527-a4c7-dc1b8d9abfed service nova] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:44.252167 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82c9ef-6943-4527-a4c7-dc1b8d9abfed service nova] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:44.263672 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e75e20-366d-4b8a-a4b1-01890c45a72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:44.264565 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e75e20-366d-4b8a-a4b1-01890c45a72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:44.265338 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e75e20-366d-4b8a-a4b1-01890c45a72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:44.265794 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e75e20-366d-4b8a-a4b1-01890c45a72b admin admin] PATH_INFO: `/v3/users/9d5cb4000c3c4161b7c719c2c24f30c7` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:44.267074 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e75e20-366d-4b8a-a4b1-01890c45a72b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d5cb4000c3c4161b7c719c2c24f30c7)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:44.269823 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e75e20-366d-4b8a-a4b1-01890c45a72b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:44.474965 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d3e75e20-366d-4b8a-a4b1-01890c45a72b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d5cb4000c3c4161b7c719c2c24f30c7'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:44.570940 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38dd5d1-f1f0-42cc-8e49-346f16b7a86c service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:44.582303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38dd5d1-f1f0-42cc-8e49-346f16b7a86c service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:44.587145 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1d132-43ca-4228-b73a-6b728279321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:44.587803 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1d132-43ca-4228-b73a-6b728279321b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:44.588080 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1d132-43ca-4228-b73a-6b728279321b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:44.588374 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1d132-43ca-4228-b73a-6b728279321b admin admin] PATH_INFO: `/v3/users/4bbb5623f31b417184c5ea2a41cf9d60` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:44.589623 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1d132-43ca-4228-b73a-6b728279321b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bbb5623f31b417184c5ea2a41cf9d60)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:44.591552 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1d132-43ca-4228-b73a-6b728279321b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:44.605427 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d3e75e20-366d-4b8a-a4b1-01890c45a72b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d5cb4000c3c4161b7c719c2c24f30c7'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:44.619830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d3e75e20-366d-4b8a-a4b1-01890c45a72b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d5cb4000c3c4161b7c719c2c24f30c7'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:44.620538 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d3e75e20-366d-4b8a-a4b1-01890c45a72b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d5cb4000c3c4161b7c719c2c24f30c7'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:44.627686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d3e75e20-366d-4b8a-a4b1-01890c45a72b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d5cb4000c3c4161b7c719c2c24f30c7'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:44.633989 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1011/2018] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:44 2022] DELETE /identity/v3/users/9d5cb4000c3c4161b7c719c2c24f30c7 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:44.638443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3064ef-816f-4546-8a23-58dcefd247d3 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:44.638786 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3064ef-816f-4546-8a23-58dcefd247d3 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:44.639062 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3064ef-816f-4546-8a23-58dcefd247d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:44.657627 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-fb3064ef-816f-4546-8a23-58dcefd247d3 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:44.659422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fb3064ef-816f-4546-8a23-58dcefd247d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:44.717914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1012/2019] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:35:44.728394 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3064ef-816f-4546-8a23-58dcefd247d3 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:44.729810 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fb3064ef-816f-4546-8a23-58dcefd247d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:44.821684 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3064ef-816f-4546-8a23-58dcefd247d3 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:44.825719 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e39e3b-7cf8-45c8-98d3-2bad941a1e58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:44.826332 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e39e3b-7cf8-45c8-98d3-2bad941a1e58 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:44.826683 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e39e3b-7cf8-45c8-98d3-2bad941a1e58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:44.826879 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e39e3b-7cf8-45c8-98d3-2bad941a1e58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:44.836311 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e39e3b-7cf8-45c8-98d3-2bad941a1e58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:44.837797 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e39e3b-7cf8-45c8-98d3-2bad941a1e58 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:44.848375 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1013/2020] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:35:45.044425 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fbc1d132-43ca-4228-b73a-6b728279321b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bbb5623f31b417184c5ea2a41cf9d60'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:45.045135 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fbc1d132-43ca-4228-b73a-6b728279321b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bbb5623f31b417184c5ea2a41cf9d60'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:45.148456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6c87b-cc52-4388-bf50-810b6b669ee4 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:45.148775 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6c87b-cc52-4388-bf50-810b6b669ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:45.149049 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6c87b-cc52-4388-bf50-810b6b669ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:45.164620 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fbc1d132-43ca-4228-b73a-6b728279321b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bbb5623f31b417184c5ea2a41cf9d60'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:45.184935 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b0a6c87b-cc52-4388-bf50-810b6b669ee4 None None] MFA Rules not processed for user `283b6df7aaf741b284d97004c9026cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:45.186340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b0a6c87b-cc52-4388-bf50-810b6b669ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:45.197709 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fbc1d132-43ca-4228-b73a-6b728279321b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bbb5623f31b417184c5ea2a41cf9d60'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:45.198465 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fbc1d132-43ca-4228-b73a-6b728279321b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bbb5623f31b417184c5ea2a41cf9d60'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:45.212324 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1008/2021] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:44 2022] DELETE /identity/v3/users/4bbb5623f31b417184c5ea2a41cf9d60 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:35:45.216708 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9167658-d692-471d-9204-cfc54ffd32c7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:45.223762 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9167658-d692-471d-9204-cfc54ffd32c7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:45.223762 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9167658-d692-471d-9204-cfc54ffd32c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:45.244968 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d9167658-d692-471d-9204-cfc54ffd32c7 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:45.246361 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d9167658-d692-471d-9204-cfc54ffd32c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:45.251023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1014/2022] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:45.293903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6c87b-cc52-4388-bf50-810b6b669ee4 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:45.296226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b0a6c87b-cc52-4388-bf50-810b6b669ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:45.335238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6c87b-cc52-4388-bf50-810b6b669ee4 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:45.347113 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1009/2023] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:35:45.402719 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:45.405657 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9167658-d692-471d-9204-cfc54ffd32c7 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:45.406673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d9167658-d692-471d-9204-cfc54ffd32c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:45.420264 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387bdc7-531d-40eb-b5fb-1c881078e584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:45.421925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387bdc7-531d-40eb-b5fb-1c881078e584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:45.422295 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387bdc7-531d-40eb-b5fb-1c881078e584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:45.423329 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387bdc7-531d-40eb-b5fb-1c881078e584 admin admin] PATH_INFO: `/v3/projects/c5c41152b086404e85d64f5fe0739da5` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:45.425742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387bdc7-531d-40eb-b5fb-1c881078e584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5c41152b086404e85d64f5fe0739da5)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:45.427963 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387bdc7-531d-40eb-b5fb-1c881078e584 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:45.477208 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9167658-d692-471d-9204-cfc54ffd32c7 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:45.481260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4e2af-8c0c-40ae-ba1d-ba8c98b7ba77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:45.481976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4e2af-8c0c-40ae-ba1d-ba8c98b7ba77 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:45.482354 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4e2af-8c0c-40ae-ba1d-ba8c98b7ba77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:45.482726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4e2af-8c0c-40ae-ba1d-ba8c98b7ba77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:45.492684 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4e2af-8c0c-40ae-ba1d-ba8c98b7ba77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:45.494307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4e2af-8c0c-40ae-ba1d-ba8c98b7ba77 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:45.504691 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1010/2024] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:45.599837 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0387bdc7-531d-40eb-b5fb-1c881078e584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5c41152b086404e85d64f5fe0739da5', 'request_id': 'req-0387bdc7-531d-40eb-b5fb-1c881078e584'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:45.605923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0387bdc7-531d-40eb-b5fb-1c881078e584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5c41152b086404e85d64f5fe0739da5', 'request_id': 'req-0387bdc7-531d-40eb-b5fb-1c881078e584'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:45.738051 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0387bdc7-531d-40eb-b5fb-1c881078e584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5c41152b086404e85d64f5fe0739da5', 'request_id': 'req-0387bdc7-531d-40eb-b5fb-1c881078e584'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:45.758624 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0387bdc7-531d-40eb-b5fb-1c881078e584 admin admin] The token cache is being invalidate because project c5c41152b086404e85d64f5fe0739da5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:45.759012 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0387bdc7-531d-40eb-b5fb-1c881078e584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:45.759814 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0387bdc7-531d-40eb-b5fb-1c881078e584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:45.761655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1015/2025] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:45 2022] DELETE /identity/v3/projects/c5c41152b086404e85d64f5fe0739da5 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:35:45.766486 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4e2af-8c0c-40ae-ba1d-ba8c98b7ba77 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:45.790847 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4e2af-8c0c-40ae-ba1d-ba8c98b7ba77 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:45.858716 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c0952-e4e0-40c4-b4bc-bb5b7aabbaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:45.861631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c0952-e4e0-40c4-b4bc-bb5b7aabbaf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:45.861631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c0952-e4e0-40c4-b4bc-bb5b7aabbaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:45.861631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c0952-e4e0-40c4-b4bc-bb5b7aabbaf6 admin admin] PATH_INFO: `/v3/users/b279b860ba61446093014ae175f881d9` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:45.862569 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c0952-e4e0-40c4-b4bc-bb5b7aabbaf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b279b860ba61446093014ae175f881d9)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:45.865409 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c0952-e4e0-40c4-b4bc-bb5b7aabbaf6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:46.067163 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387bdc7-531d-40eb-b5fb-1c881078e584 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:46.068611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0387bdc7-531d-40eb-b5fb-1c881078e584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:46.087956 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387bdc7-531d-40eb-b5fb-1c881078e584 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:46.099009 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7c422-e04b-4c29-8d7f-35f492826dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:46.099781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7c422-e04b-4c29-8d7f-35f492826dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:46.100205 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7c422-e04b-4c29-8d7f-35f492826dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:46.100577 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7c422-e04b-4c29-8d7f-35f492826dc2 admin admin] PATH_INFO: `/v3/projects/ecdfc8d136774a18b23720771e39b65c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:46.102446 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7c422-e04b-4c29-8d7f-35f492826dc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecdfc8d136774a18b23720771e39b65c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:46.106797 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7c422-e04b-4c29-8d7f-35f492826dc2 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:46.120938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d17c0952-e4e0-40c4-b4bc-bb5b7aabbaf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b279b860ba61446093014ae175f881d9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:46.120938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d17c0952-e4e0-40c4-b4bc-bb5b7aabbaf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b279b860ba61446093014ae175f881d9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:46.234041 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d17c0952-e4e0-40c4-b4bc-bb5b7aabbaf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b279b860ba61446093014ae175f881d9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:46.247093 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:46.251293 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d17c0952-e4e0-40c4-b4bc-bb5b7aabbaf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b279b860ba61446093014ae175f881d9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:46.256775 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d17c0952-e4e0-40c4-b4bc-bb5b7aabbaf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b279b860ba61446093014ae175f881d9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:46.271826 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1011/2026] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:45 2022] DELETE /identity/v3/users/b279b860ba61446093014ae175f881d9 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:46.274871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-31f7c422-e04b-4c29-8d7f-35f492826dc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecdfc8d136774a18b23720771e39b65c', 'request_id': 'req-31f7c422-e04b-4c29-8d7f-35f492826dc2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:46.281476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-31f7c422-e04b-4c29-8d7f-35f492826dc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecdfc8d136774a18b23720771e39b65c', 'request_id': 'req-31f7c422-e04b-4c29-8d7f-35f492826dc2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:46.388331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-31f7c422-e04b-4c29-8d7f-35f492826dc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecdfc8d136774a18b23720771e39b65c', 'request_id': 'req-31f7c422-e04b-4c29-8d7f-35f492826dc2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:46.404748 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-31f7c422-e04b-4c29-8d7f-35f492826dc2 admin admin] The token cache is being invalidate because project ecdfc8d136774a18b23720771e39b65c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:46.405199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-31f7c422-e04b-4c29-8d7f-35f492826dc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:46.405872 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-31f7c422-e04b-4c29-8d7f-35f492826dc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:46.407517 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1016/2027] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:46 2022] DELETE /identity/v3/projects/ecdfc8d136774a18b23720771e39b65c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:46.412711 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c0952-e4e0-40c4-b4bc-bb5b7aabbaf6 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:46.414175 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d17c0952-e4e0-40c4-b4bc-bb5b7aabbaf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:46.494883 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c0952-e4e0-40c4-b4bc-bb5b7aabbaf6 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:46.500650 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b8a2f-26b6-44b6-b68d-86ad872c3c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:46.501497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b8a2f-26b6-44b6-b68d-86ad872c3c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:46.501921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b8a2f-26b6-44b6-b68d-86ad872c3c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:46.502357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b8a2f-26b6-44b6-b68d-86ad872c3c22 admin admin] PATH_INFO: `/v3/users/5e6c280aea9c4fc3a4118c93d79ba921` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:46.503685 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b8a2f-26b6-44b6-b68d-86ad872c3c22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e6c280aea9c4fc3a4118c93d79ba921)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:46.505857 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b8a2f-26b6-44b6-b68d-86ad872c3c22 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:46.772860 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a00b8a2f-26b6-44b6-b68d-86ad872c3c22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e6c280aea9c4fc3a4118c93d79ba921'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:46.774372 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a00b8a2f-26b6-44b6-b68d-86ad872c3c22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e6c280aea9c4fc3a4118c93d79ba921'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:46.793538 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7c422-e04b-4c29-8d7f-35f492826dc2 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:46.795461 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-31f7c422-e04b-4c29-8d7f-35f492826dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:46.862658 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a00b8a2f-26b6-44b6-b68d-86ad872c3c22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e6c280aea9c4fc3a4118c93d79ba921'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:46.884838 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7c422-e04b-4c29-8d7f-35f492826dc2 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:46.887174 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a00b8a2f-26b6-44b6-b68d-86ad872c3c22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e6c280aea9c4fc3a4118c93d79ba921'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:46.888240 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a00b8a2f-26b6-44b6-b68d-86ad872c3c22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e6c280aea9c4fc3a4118c93d79ba921'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:46.900352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256184d-19a6-4aa5-8fd9-91be41d60cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:46.916179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256184d-19a6-4aa5-8fd9-91be41d60cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:46.916179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256184d-19a6-4aa5-8fd9-91be41d60cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:46.916179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256184d-19a6-4aa5-8fd9-91be41d60cdf admin admin] PATH_INFO: `/v3/projects/5bd3f4b8378a429790164ad3f18f7721` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:46.916179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256184d-19a6-4aa5-8fd9-91be41d60cdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bd3f4b8378a429790164ad3f18f7721)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:46.916179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256184d-19a6-4aa5-8fd9-91be41d60cdf admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:46.916758 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1012/2028] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:46 2022] DELETE /identity/v3/users/5e6c280aea9c4fc3a4118c93d79ba921 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:47.077984 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5256184d-19a6-4aa5-8fd9-91be41d60cdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bd3f4b8378a429790164ad3f18f7721', 'request_id': 'req-5256184d-19a6-4aa5-8fd9-91be41d60cdf'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:47.084512 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5256184d-19a6-4aa5-8fd9-91be41d60cdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bd3f4b8378a429790164ad3f18f7721', 'request_id': 'req-5256184d-19a6-4aa5-8fd9-91be41d60cdf'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:47.181842 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5256184d-19a6-4aa5-8fd9-91be41d60cdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bd3f4b8378a429790164ad3f18f7721', 'request_id': 'req-5256184d-19a6-4aa5-8fd9-91be41d60cdf'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:47.227721 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5256184d-19a6-4aa5-8fd9-91be41d60cdf admin admin] The token cache is being invalidate because project 5bd3f4b8378a429790164ad3f18f7721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:47.233874 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5256184d-19a6-4aa5-8fd9-91be41d60cdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:47.233874 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5256184d-19a6-4aa5-8fd9-91be41d60cdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:47.233874 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1017/2029] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:46 2022] DELETE /identity/v3/projects/5bd3f4b8378a429790164ad3f18f7721 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:47.236624 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e1544-c6e9-4507-952f-9ae42e7afb77 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:47.236783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e1544-c6e9-4507-952f-9ae42e7afb77 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:47.237032 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e1544-c6e9-4507-952f-9ae42e7afb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:47.262356 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6f1e1544-c6e9-4507-952f-9ae42e7afb77 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:47.263894 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6f1e1544-c6e9-4507-952f-9ae42e7afb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:47.331923 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1013/2030] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:47.341889 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0ca7a-83fd-4bbe-ab00-234747a84d72 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:47.343473 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0ca7a-83fd-4bbe-ab00-234747a84d72 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:47.343710 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0ca7a-83fd-4bbe-ab00-234747a84d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:47.372527 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-ffb0ca7a-83fd-4bbe-ab00-234747a84d72 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:47.374018 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ffb0ca7a-83fd-4bbe-ab00-234747a84d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:47.384403 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1018/2031] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:35:47.389706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e1544-c6e9-4507-952f-9ae42e7afb77 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:47.402266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e1544-c6e9-4507-952f-9ae42e7afb77 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:47.409505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389769ad-7d26-4ef6-aa02-a8bf6b43aca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:47.417286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389769ad-7d26-4ef6-aa02-a8bf6b43aca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:47.417286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389769ad-7d26-4ef6-aa02-a8bf6b43aca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:47.417286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389769ad-7d26-4ef6-aa02-a8bf6b43aca0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:47.417286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389769ad-7d26-4ef6-aa02-a8bf6b43aca0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:35:47.417286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389769ad-7d26-4ef6-aa02-a8bf6b43aca0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:47.417286 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389769ad-7d26-4ef6-aa02-a8bf6b43aca0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:47.432227 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1014/2032] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:35:47.436896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0ca7a-83fd-4bbe-ab00-234747a84d72 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:47.460595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0ca7a-83fd-4bbe-ab00-234747a84d72 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:47.467977 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e292c89-36cc-4304-9b5a-ae64fbb6638a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:47.468959 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e292c89-36cc-4304-9b5a-ae64fbb6638a admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:47.469298 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e292c89-36cc-4304-9b5a-ae64fbb6638a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:47.474921 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e292c89-36cc-4304-9b5a-ae64fbb6638a admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:47.474921 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e292c89-36cc-4304-9b5a-ae64fbb6638a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:47.476251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e292c89-36cc-4304-9b5a-ae64fbb6638a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:47.607828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1019/2033] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:47 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:47.611623 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389769ad-7d26-4ef6-aa02-a8bf6b43aca0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:47.622003 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389769ad-7d26-4ef6-aa02-a8bf6b43aca0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:47.679503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba376c-fa2b-4fcf-aeec-4d8987961573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:47.680064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba376c-fa2b-4fcf-aeec-4d8987961573 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:47.680340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba376c-fa2b-4fcf-aeec-4d8987961573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:47.680599 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba376c-fa2b-4fcf-aeec-4d8987961573 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:47.681285 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba376c-fa2b-4fcf-aeec-4d8987961573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:47.684691 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba376c-fa2b-4fcf-aeec-4d8987961573 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:47.719013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e292c89-36cc-4304-9b5a-ae64fbb6638a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:47.721190 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3e292c89-36cc-4304-9b5a-ae64fbb6638a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:47.734153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e292c89-36cc-4304-9b5a-ae64fbb6638a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:47.739356 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1c446-78a6-4d97-b0ee-04bd27338ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:47.739989 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1c446-78a6-4d97-b0ee-04bd27338ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:47.740449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1c446-78a6-4d97-b0ee-04bd27338ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:47.740728 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1c446-78a6-4d97-b0ee-04bd27338ff1 admin admin] PATH_INFO: `/v3/projects/3cb054b66aa940ffa0a8555c4bded9cb` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:47.741915 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1c446-78a6-4d97-b0ee-04bd27338ff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb054b66aa940ffa0a8555c4bded9cb)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:47.744767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1c446-78a6-4d97-b0ee-04bd27338ff1 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:47.825292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1015/2034] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:47 2022] POST /identity/v3/users => generated 287 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:47.826519 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba376c-fa2b-4fcf-aeec-4d8987961573 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:47.839316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba376c-fa2b-4fcf-aeec-4d8987961573 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:47.846409 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321aded-7e47-451d-8cf3-22366dd0e3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:47.847183 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321aded-7e47-451d-8cf3-22366dd0e3ea admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:47.847476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321aded-7e47-451d-8cf3-22366dd0e3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:47.848700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321aded-7e47-451d-8cf3-22366dd0e3ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:47.849498 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321aded-7e47-451d-8cf3-22366dd0e3ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:47.851227 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321aded-7e47-451d-8cf3-22366dd0e3ea admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:47.864367 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1016/2035] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:35:47.873045 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c8a1c446-78a6-4d97-b0ee-04bd27338ff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb054b66aa940ffa0a8555c4bded9cb', 'request_id': 'req-c8a1c446-78a6-4d97-b0ee-04bd27338ff1'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:47.882600 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321aded-7e47-451d-8cf3-22366dd0e3ea admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:47.882760 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c8a1c446-78a6-4d97-b0ee-04bd27338ff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb054b66aa940ffa0a8555c4bded9cb', 'request_id': 'req-c8a1c446-78a6-4d97-b0ee-04bd27338ff1'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:47.894693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321aded-7e47-451d-8cf3-22366dd0e3ea admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:47.955878 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686b283-3335-4a92-b0f4-d340aaf4674b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:47.956762 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686b283-3335-4a92-b0f4-d340aaf4674b admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:47.958782 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686b283-3335-4a92-b0f4-d340aaf4674b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:47.958782 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686b283-3335-4a92-b0f4-d340aaf4674b admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:47.958782 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686b283-3335-4a92-b0f4-d340aaf4674b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:47.960597 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686b283-3335-4a92-b0f4-d340aaf4674b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:47.978472 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c8a1c446-78a6-4d97-b0ee-04bd27338ff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb054b66aa940ffa0a8555c4bded9cb', 'request_id': 'req-c8a1c446-78a6-4d97-b0ee-04bd27338ff1'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:47.983968 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1017/2036] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:35:47.985017 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686b283-3335-4a92-b0f4-d340aaf4674b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:47.999769 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686b283-3335-4a92-b0f4-d340aaf4674b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:48.005888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c8a1c446-78a6-4d97-b0ee-04bd27338ff1 admin admin] The token cache is being invalidate because project 3cb054b66aa940ffa0a8555c4bded9cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:48.006355 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c8a1c446-78a6-4d97-b0ee-04bd27338ff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:48.006615 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe616f-b6d7-479e-9f7b-4a75d01c13e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:48.007313 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c8a1c446-78a6-4d97-b0ee-04bd27338ff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:48.007678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe616f-b6d7-479e-9f7b-4a75d01c13e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:48.008064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe616f-b6d7-479e-9f7b-4a75d01c13e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:48.008447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe616f-b6d7-479e-9f7b-4a75d01c13e0 admin admin] PATH_INFO: `/v3/projects/6f7051bf4f1a40b2849b23d8108d965c/users/bb0e08e750aa417cafe80790972d011c/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:48.009937 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1020/2037] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:47 2022] DELETE /identity/v3/projects/3cb054b66aa940ffa0a8555c4bded9cb => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:35:48.015447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:48.018049 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613488c5-a2c2-4e91-9f72-116f797e0a38 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:48.020972 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613488c5-a2c2-4e91-9f72-116f797e0a38 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:48.022692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613488c5-a2c2-4e91-9f72-116f797e0a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:48.029544 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe616f-b6d7-479e-9f7b-4a75d01c13e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f7051bf4f1a40b2849b23d8108d965c, user_id=bb0e08e750aa417cafe80790972d011c, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:48.036055 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe616f-b6d7-479e-9f7b-4a75d01c13e0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:48.051615 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-613488c5-a2c2-4e91-9f72-116f797e0a38 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:48.052840 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-613488c5-a2c2-4e91-9f72-116f797e0a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:48.061505 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1021/2038] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:48.069671 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb9e36-7676-4ed8-9c59-e1b5f47b010e None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:48.069949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb9e36-7676-4ed8-9c59-e1b5f47b010e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:48.070217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb9e36-7676-4ed8-9c59-e1b5f47b010e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:48.091082 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-3abb9e36-7676-4ed8-9c59-e1b5f47b010e None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:48.092278 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3abb9e36-7676-4ed8-9c59-e1b5f47b010e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:48.103417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1022/2039] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:35:48.105107 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1018/2040] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:47 2022] PUT /identity/v3/projects/6f7051bf4f1a40b2849b23d8108d965c/users/bb0e08e750aa417cafe80790972d011c/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:48.110046 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb9e36-7676-4ed8-9c59-e1b5f47b010e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:48.117076 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198be557-6118-4a9d-bc7c-f499f89b7396 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:48.117620 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198be557-6118-4a9d-bc7c-f499f89b7396 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:48.118066 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198be557-6118-4a9d-bc7c-f499f89b7396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:48.120556 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb9e36-7676-4ed8-9c59-e1b5f47b010e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:48.155094 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-198be557-6118-4a9d-bc7c-f499f89b7396 None None] MFA Rules not processed for user `bb0e08e750aa417cafe80790972d011c`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:48.156352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-198be557-6118-4a9d-bc7c-f499f89b7396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:48.191787 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a531d-30e7-4e32-be73-38f42ed9429f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:48.192320 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a531d-30e7-4e32-be73-38f42ed9429f admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:48.192603 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a531d-30e7-4e32-be73-38f42ed9429f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:48.192875 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a531d-30e7-4e32-be73-38f42ed9429f admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:48.193618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a531d-30e7-4e32-be73-38f42ed9429f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:35:48.193925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a531d-30e7-4e32-be73-38f42ed9429f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:48.195548 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a531d-30e7-4e32-be73-38f42ed9429f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:48.217902 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1023/2041] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:35:48.219144 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a531d-30e7-4e32-be73-38f42ed9429f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:48.230411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1019/2042] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:35:48.233461 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a531d-30e7-4e32-be73-38f42ed9429f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:48.238384 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f055d3-21f9-435b-90aa-aa927999bbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:48.239003 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f055d3-21f9-435b-90aa-aa927999bbb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:48.239279 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f055d3-21f9-435b-90aa-aa927999bbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:48.239545 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f055d3-21f9-435b-90aa-aa927999bbb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:48.240181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f055d3-21f9-435b-90aa-aa927999bbb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:48.242414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f055d3-21f9-435b-90aa-aa927999bbb0 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:48.247759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198be557-6118-4a9d-bc7c-f499f89b7396 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:48.247759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-198be557-6118-4a9d-bc7c-f499f89b7396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:48.319340 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198be557-6118-4a9d-bc7c-f499f89b7396 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:48.327853 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b27a8-62e8-4ad7-8e2c-ad511d8aba7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:48.334723 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b27a8-62e8-4ad7-8e2c-ad511d8aba7b service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:48.335965 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1024/2043] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:48 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:35:48.337220 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b27a8-62e8-4ad7-8e2c-ad511d8aba7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:48.337607 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b27a8-62e8-4ad7-8e2c-ad511d8aba7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:48.340103 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f055d3-21f9-435b-90aa-aa927999bbb0 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:48.349038 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b27a8-62e8-4ad7-8e2c-ad511d8aba7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:48.350617 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b27a8-62e8-4ad7-8e2c-ad511d8aba7b service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:48.362814 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1020/2044] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:35:48.393311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b27a8-62e8-4ad7-8e2c-ad511d8aba7b service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:48.395057 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ad5b27a8-62e8-4ad7-8e2c-ad511d8aba7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:48.437171 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b27a8-62e8-4ad7-8e2c-ad511d8aba7b service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:48.442016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d61dd3-de6e-434e-9260-710f88bb1bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:48.442584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d61dd3-de6e-434e-9260-710f88bb1bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:48.442857 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d61dd3-de6e-434e-9260-710f88bb1bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:48.443047 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f055d3-21f9-435b-90aa-aa927999bbb0 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:48.443153 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d61dd3-de6e-434e-9260-710f88bb1bbb admin admin] PATH_INFO: `/v3/users/bb0e08e750aa417cafe80790972d011c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:48.444269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d61dd3-de6e-434e-9260-710f88bb1bbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb0e08e750aa417cafe80790972d011c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:48.447134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d61dd3-de6e-434e-9260-710f88bb1bbb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:48.448211 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1dd36f-8b29-4781-8cd4-41af148b5470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:48.448881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dd36f-8b29-4781-8cd4-41af148b5470 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:48.449879 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dd36f-8b29-4781-8cd4-41af148b5470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:48.450144 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dd36f-8b29-4781-8cd4-41af148b5470 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:48.450943 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1dd36f-8b29-4781-8cd4-41af148b5470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:48.455010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1dd36f-8b29-4781-8cd4-41af148b5470 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:48.580716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1025/2045] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:48 2022] POST /identity/v3/users => generated 291 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:35:48.582867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1dd36f-8b29-4781-8cd4-41af148b5470 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:48.597809 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1dd36f-8b29-4781-8cd4-41af148b5470 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:48.604835 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd032d28-de63-46e7-85f6-2366aca10453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:48.605819 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd032d28-de63-46e7-85f6-2366aca10453 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:48.607910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd032d28-de63-46e7-85f6-2366aca10453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:48.608336 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd032d28-de63-46e7-85f6-2366aca10453 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:48.611775 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd032d28-de63-46e7-85f6-2366aca10453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:48.614602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd032d28-de63-46e7-85f6-2366aca10453 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:48.629868 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1026/2046] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:48.633861 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd032d28-de63-46e7-85f6-2366aca10453 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:48.647581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd032d28-de63-46e7-85f6-2366aca10453 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:48.664123 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da5c9c-4a6e-4bd3-bb92-94f14deac10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:48.665644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da5c9c-4a6e-4bd3-bb92-94f14deac10b admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:48.666113 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da5c9c-4a6e-4bd3-bb92-94f14deac10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:48.666550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da5c9c-4a6e-4bd3-bb92-94f14deac10b admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:48.667374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da5c9c-4a6e-4bd3-bb92-94f14deac10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:48.669578 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da5c9c-4a6e-4bd3-bb92-94f14deac10b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:48.680065 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:48.691741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1027/2047] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:48.693325 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da5c9c-4a6e-4bd3-bb92-94f14deac10b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:48.706145 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-21d61dd3-de6e-434e-9260-710f88bb1bbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb0e08e750aa417cafe80790972d011c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:48.712453 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-21d61dd3-de6e-434e-9260-710f88bb1bbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb0e08e750aa417cafe80790972d011c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:48.716905 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da5c9c-4a6e-4bd3-bb92-94f14deac10b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:48.724008 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf3811-f3f3-4099-9395-2639eb23b93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:48.724687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf3811-f3f3-4099-9395-2639eb23b93a admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:48.724967 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf3811-f3f3-4099-9395-2639eb23b93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:48.725290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf3811-f3f3-4099-9395-2639eb23b93a admin admin] PATH_INFO: `/v3/projects/ab5b67bc243b49aaa2ee5c9ef6b5176a/users/8309384c6473433db2481716f2cc895f/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:48.746173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf3811-f3f3-4099-9395-2639eb23b93a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab5b67bc243b49aaa2ee5c9ef6b5176a, user_id=8309384c6473433db2481716f2cc895f, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:48.749553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf3811-f3f3-4099-9395-2639eb23b93a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:48.810872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-21d61dd3-de6e-434e-9260-710f88bb1bbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb0e08e750aa417cafe80790972d011c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:48.825921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-21d61dd3-de6e-434e-9260-710f88bb1bbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb0e08e750aa417cafe80790972d011c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:48.827065 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-21d61dd3-de6e-434e-9260-710f88bb1bbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb0e08e750aa417cafe80790972d011c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:48.841036 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1021/2048] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:48 2022] DELETE /identity/v3/users/bb0e08e750aa417cafe80790972d011c => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:35:48.845916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8078f6c-2615-48d3-8916-ce3446e74ecd None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:48.846491 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8078f6c-2615-48d3-8916-ce3446e74ecd None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:48.849864 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8078f6c-2615-48d3-8916-ce3446e74ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:48.850412 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1028/2049] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:48 2022] PUT /identity/v3/projects/ab5b67bc243b49aaa2ee5c9ef6b5176a/users/8309384c6473433db2481716f2cc895f/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:48.863069 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ddc81-f03b-416a-ac90-749d348d9483 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:48.863573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ddc81-f03b-416a-ac90-749d348d9483 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:48.864658 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ddc81-f03b-416a-ac90-749d348d9483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:48.874176 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c8078f6c-2615-48d3-8916-ce3446e74ecd None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:48.875410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c8078f6c-2615-48d3-8916-ce3446e74ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:48.921166 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d52ddc81-f03b-416a-ac90-749d348d9483 None None] MFA Rules not processed for user `8309384c6473433db2481716f2cc895f`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:48.924366 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d52ddc81-f03b-416a-ac90-749d348d9483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:48.967475 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1022/2050] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:35:49.028721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8078f6c-2615-48d3-8916-ce3446e74ecd None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:49.031411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c8078f6c-2615-48d3-8916-ce3446e74ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:49.042371 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1029/2051] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:35:49.046908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ddc81-f03b-416a-ac90-749d348d9483 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:49.048568 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d52ddc81-f03b-416a-ac90-749d348d9483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:49.070900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ddc81-f03b-416a-ac90-749d348d9483 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:49.077541 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2302092-beb0-4f23-b83c-37a453bf85a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:49.078394 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2302092-beb0-4f23-b83c-37a453bf85a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:49.078676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2302092-beb0-4f23-b83c-37a453bf85a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:49.078948 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2302092-beb0-4f23-b83c-37a453bf85a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:49.080334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2302092-beb0-4f23-b83c-37a453bf85a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:49.082528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2302092-beb0-4f23-b83c-37a453bf85a8 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:49.129598 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8078f6c-2615-48d3-8916-ce3446e74ecd None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:49.135653 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabe380-e7fa-4aa3-9334-42f2c71f3fd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:49.135653 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabe380-e7fa-4aa3-9334-42f2c71f3fd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:49.135653 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabe380-e7fa-4aa3-9334-42f2c71f3fd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:49.135653 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabe380-e7fa-4aa3-9334-42f2c71f3fd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:49.145283 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabe380-e7fa-4aa3-9334-42f2c71f3fd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:49.146879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabe380-e7fa-4aa3-9334-42f2c71f3fd5 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:49.156739 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1023/2052] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:35:49.219569 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1030/2053] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:49 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:49.223334 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabe380-e7fa-4aa3-9334-42f2c71f3fd5 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:49.233492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabe380-e7fa-4aa3-9334-42f2c71f3fd5 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:49.293140 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d141b3-d7bf-499f-8f66-2896d3190643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:49.293761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d141b3-d7bf-499f-8f66-2896d3190643 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:49.294042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d141b3-d7bf-499f-8f66-2896d3190643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:49.294317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d141b3-d7bf-499f-8f66-2896d3190643 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:49.294984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d141b3-d7bf-499f-8f66-2896d3190643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:49.296898 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d141b3-d7bf-499f-8f66-2896d3190643 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:49.406576 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1024/2054] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:49 2022] POST /identity/v3/users => generated 296 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:49.408412 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2302092-beb0-4f23-b83c-37a453bf85a8 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:49.419477 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2302092-beb0-4f23-b83c-37a453bf85a8 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:49.424898 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a025f01-605e-4414-b90a-7e853352f908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:49.425551 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a025f01-605e-4414-b90a-7e853352f908 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:49.425831 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a025f01-605e-4414-b90a-7e853352f908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:49.426109 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a025f01-605e-4414-b90a-7e853352f908 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:49.426770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a025f01-605e-4414-b90a-7e853352f908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:49.428402 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a025f01-605e-4414-b90a-7e853352f908 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:49.440834 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1031/2055] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:49.445192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d141b3-d7bf-499f-8f66-2896d3190643 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:49.465090 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d141b3-d7bf-499f-8f66-2896d3190643 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:49.486692 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c7a80-b6fc-48f7-862b-27fcdc780e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:49.487916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c7a80-b6fc-48f7-862b-27fcdc780e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:49.489576 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c7a80-b6fc-48f7-862b-27fcdc780e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:49.489872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c7a80-b6fc-48f7-862b-27fcdc780e70 admin admin] PATH_INFO: `/v3/projects/5066e17af58848bb9a058c8e7e47a5f3/users/68b38ff6262147e69eedcfcc4b235d46/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:49.512323 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c7a80-b6fc-48f7-862b-27fcdc780e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5066e17af58848bb9a058c8e7e47a5f3, user_id=68b38ff6262147e69eedcfcc4b235d46, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:49.515322 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c7a80-b6fc-48f7-862b-27fcdc780e70 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:49.636084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1025/2056] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:49 2022] PUT /identity/v3/projects/5066e17af58848bb9a058c8e7e47a5f3/users/68b38ff6262147e69eedcfcc4b235d46/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:49.639893 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a025f01-605e-4414-b90a-7e853352f908 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:49.650564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a025f01-605e-4414-b90a-7e853352f908 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:49.714195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367fb87-5d61-4415-bbcd-2b95fda36cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:49.714947 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367fb87-5d61-4415-bbcd-2b95fda36cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:49.715411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367fb87-5d61-4415-bbcd-2b95fda36cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:49.715637 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367fb87-5d61-4415-bbcd-2b95fda36cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:49.716437 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367fb87-5d61-4415-bbcd-2b95fda36cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:49.718167 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367fb87-5d61-4415-bbcd-2b95fda36cc9 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:49.733696 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1032/2057] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:49.737739 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c7a80-b6fc-48f7-862b-27fcdc780e70 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:49.748380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c7a80-b6fc-48f7-862b-27fcdc780e70 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:49.753643 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928b72d-40b4-4342-a90f-63cbf188e285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:49.754332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928b72d-40b4-4342-a90f-63cbf188e285 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:49.754917 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928b72d-40b4-4342-a90f-63cbf188e285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:49.755199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928b72d-40b4-4342-a90f-63cbf188e285 admin admin] PATH_INFO: `/v3/projects/5066e17af58848bb9a058c8e7e47a5f3/users/68b38ff6262147e69eedcfcc4b235d46/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:49.757315 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928b72d-40b4-4342-a90f-63cbf188e285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5066e17af58848bb9a058c8e7e47a5f3, user_id=68b38ff6262147e69eedcfcc4b235d46, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:49.760060 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928b72d-40b4-4342-a90f-63cbf188e285 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:49.771428 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1026/2058] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:49 2022] PUT /identity/v3/projects/5066e17af58848bb9a058c8e7e47a5f3/users/68b38ff6262147e69eedcfcc4b235d46/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:35:49.781912 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d483f6-59bf-49ee-961e-53b2f5de1a02 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:49.782201 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d483f6-59bf-49ee-961e-53b2f5de1a02 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:49.782511 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d483f6-59bf-49ee-961e-53b2f5de1a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:49.811153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-59d483f6-59bf-49ee-961e-53b2f5de1a02 None None] MFA Rules not processed for user `68b38ff6262147e69eedcfcc4b235d46`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:49.812419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-59d483f6-59bf-49ee-961e-53b2f5de1a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:49.877276 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928b72d-40b4-4342-a90f-63cbf188e285 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:49.879889 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f928b72d-40b4-4342-a90f-63cbf188e285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:49.887408 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1033/2059] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:49.905713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d483f6-59bf-49ee-961e-53b2f5de1a02 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:49.905713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-59d483f6-59bf-49ee-961e-53b2f5de1a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:49.963363 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928b72d-40b4-4342-a90f-63cbf188e285 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:49.971136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db83c2d-f0ad-4191-8a6a-1570a3ddb381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:49.971989 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db83c2d-f0ad-4191-8a6a-1570a3ddb381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:49.972384 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db83c2d-f0ad-4191-8a6a-1570a3ddb381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:49.972753 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db83c2d-f0ad-4191-8a6a-1570a3ddb381 admin admin] PATH_INFO: `/v3/projects/6f7051bf4f1a40b2849b23d8108d965c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:49.975584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db83c2d-f0ad-4191-8a6a-1570a3ddb381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f7051bf4f1a40b2849b23d8108d965c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:49.978028 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db83c2d-f0ad-4191-8a6a-1570a3ddb381 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:50.037851 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d483f6-59bf-49ee-961e-53b2f5de1a02 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:50.043606 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0b798-7853-4588-ac2d-a2bed6a15d07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:50.044309 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0b798-7853-4588-ac2d-a2bed6a15d07 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:50.044693 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0b798-7853-4588-ac2d-a2bed6a15d07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:50.044979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0b798-7853-4588-ac2d-a2bed6a15d07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:50.064742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0b798-7853-4588-ac2d-a2bed6a15d07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:50.066530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0b798-7853-4588-ac2d-a2bed6a15d07 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:50.083491 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1034/2060] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:35:50.199026 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9db83c2d-f0ad-4191-8a6a-1570a3ddb381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f7051bf4f1a40b2849b23d8108d965c', 'request_id': 'req-9db83c2d-f0ad-4191-8a6a-1570a3ddb381'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:50.222088 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9db83c2d-f0ad-4191-8a6a-1570a3ddb381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f7051bf4f1a40b2849b23d8108d965c', 'request_id': 'req-9db83c2d-f0ad-4191-8a6a-1570a3ddb381'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:50.371230 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9db83c2d-f0ad-4191-8a6a-1570a3ddb381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f7051bf4f1a40b2849b23d8108d965c', 'request_id': 'req-9db83c2d-f0ad-4191-8a6a-1570a3ddb381'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:50.384278 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9db83c2d-f0ad-4191-8a6a-1570a3ddb381 admin admin] The token cache is being invalidate because project 6f7051bf4f1a40b2849b23d8108d965c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:50.384905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9db83c2d-f0ad-4191-8a6a-1570a3ddb381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:50.385756 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9db83c2d-f0ad-4191-8a6a-1570a3ddb381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:50.387829 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1027/2061] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:49 2022] DELETE /identity/v3/projects/6f7051bf4f1a40b2849b23d8108d965c => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:35:50.393406 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c44ac-a561-4368-978c-a4c693830a5c None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:50.393697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c44ac-a561-4368-978c-a4c693830a5c None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:50.393975 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c44ac-a561-4368-978c-a4c693830a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:50.415212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b12c44ac-a561-4368-978c-a4c693830a5c None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:50.416446 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b12c44ac-a561-4368-978c-a4c693830a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:50.502878 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1035/2062] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:50.504123 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401c519-0bf8-4720-a77e-c8301ba53d44 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:50.504405 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401c519-0bf8-4720-a77e-c8301ba53d44 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:50.504676 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401c519-0bf8-4720-a77e-c8301ba53d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:50.525882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a401c519-0bf8-4720-a77e-c8301ba53d44 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:50.529360 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a401c519-0bf8-4720-a77e-c8301ba53d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:50.535864 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1028/2063] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:50.540152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c44ac-a561-4368-978c-a4c693830a5c None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:50.551484 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c44ac-a561-4368-978c-a4c693830a5c None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:50.558064 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88285c4c-08b9-46da-b7cf-fcd3665000a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:50.558064 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88285c4c-08b9-46da-b7cf-fcd3665000a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:50.558064 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88285c4c-08b9-46da-b7cf-fcd3665000a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:50.558064 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88285c4c-08b9-46da-b7cf-fcd3665000a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:50.558564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88285c4c-08b9-46da-b7cf-fcd3665000a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:35:50.559078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88285c4c-08b9-46da-b7cf-fcd3665000a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:50.560724 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88285c4c-08b9-46da-b7cf-fcd3665000a4 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:50.573994 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1036/2064] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:35:50.578408 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401c519-0bf8-4720-a77e-c8301ba53d44 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:50.590027 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401c519-0bf8-4720-a77e-c8301ba53d44 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:50.595048 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc8674-c846-4dcc-ab8d-331ab1e62834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:50.596665 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc8674-c846-4dcc-ab8d-331ab1e62834 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:50.597063 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc8674-c846-4dcc-ab8d-331ab1e62834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:50.597460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc8674-c846-4dcc-ab8d-331ab1e62834 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:50.598371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc8674-c846-4dcc-ab8d-331ab1e62834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:50.601145 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc8674-c846-4dcc-ab8d-331ab1e62834 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:50.772771 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1029/2065] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:50 2022] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:50.774105 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88285c4c-08b9-46da-b7cf-fcd3665000a4 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:50.800412 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88285c4c-08b9-46da-b7cf-fcd3665000a4 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:50.888694 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3615d-3e6b-4fcc-9b7c-e034d3e3f45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:50.888694 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3615d-3e6b-4fcc-9b7c-e034d3e3f45a admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:50.888694 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3615d-3e6b-4fcc-9b7c-e034d3e3f45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:50.888694 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3615d-3e6b-4fcc-9b7c-e034d3e3f45a admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:50.891880 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3615d-3e6b-4fcc-9b7c-e034d3e3f45a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:50.893086 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3615d-3e6b-4fcc-9b7c-e034d3e3f45a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:50.930786 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:51.020991 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1037/2066] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:50 2022] POST /identity/v3/users => generated 287 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:51.026896 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc8674-c846-4dcc-ab8d-331ab1e62834 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:51.038959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc8674-c846-4dcc-ab8d-331ab1e62834 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:51.055543 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faac22d-6ff3-4a65-8c1f-fc6ee9ffec7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:51.056167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faac22d-6ff3-4a65-8c1f-fc6ee9ffec7e admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:51.056443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faac22d-6ff3-4a65-8c1f-fc6ee9ffec7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:51.056761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faac22d-6ff3-4a65-8c1f-fc6ee9ffec7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:51.057510 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faac22d-6ff3-4a65-8c1f-fc6ee9ffec7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:51.059435 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faac22d-6ff3-4a65-8c1f-fc6ee9ffec7e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:51.073116 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1030/2067] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:51.077208 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3615d-3e6b-4fcc-9b7c-e034d3e3f45a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:51.089707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3615d-3e6b-4fcc-9b7c-e034d3e3f45a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:51.094344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422154f2-0763-48bf-b701-0a5213d15954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:51.094950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422154f2-0763-48bf-b701-0a5213d15954 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:51.095795 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422154f2-0763-48bf-b701-0a5213d15954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:51.096069 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422154f2-0763-48bf-b701-0a5213d15954 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:51.096714 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422154f2-0763-48bf-b701-0a5213d15954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:51.098413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422154f2-0763-48bf-b701-0a5213d15954 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:51.112604 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1038/2068] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:51.113791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faac22d-6ff3-4a65-8c1f-fc6ee9ffec7e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:51.126361 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faac22d-6ff3-4a65-8c1f-fc6ee9ffec7e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:51.137694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb049cc-5ef2-4050-b550-3203670a9a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:51.137694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb049cc-5ef2-4050-b550-3203670a9a04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:51.137694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb049cc-5ef2-4050-b550-3203670a9a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:51.137694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb049cc-5ef2-4050-b550-3203670a9a04 admin admin] PATH_INFO: `/v3/projects/e6bfd9cec0f6412fb2972968c349c463/users/38c0666fea2948c29d94e297222e2df1/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:51.158993 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb049cc-5ef2-4050-b550-3203670a9a04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6bfd9cec0f6412fb2972968c349c463, user_id=38c0666fea2948c29d94e297222e2df1, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:51.161978 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb049cc-5ef2-4050-b550-3203670a9a04 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:51.268664 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1031/2069] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:51 2022] PUT /identity/v3/projects/e6bfd9cec0f6412fb2972968c349c463/users/38c0666fea2948c29d94e297222e2df1/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:35:51.274057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66c086-d47d-4542-a028-f47e2ff4e328 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:51.274560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66c086-d47d-4542-a028-f47e2ff4e328 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:51.274989 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66c086-d47d-4542-a028-f47e2ff4e328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:51.298114 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-3b66c086-d47d-4542-a028-f47e2ff4e328 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:51.298114 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3b66c086-d47d-4542-a028-f47e2ff4e328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:51.360914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1039/2070] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:51.373953 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb049cc-5ef2-4050-b550-3203670a9a04 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:51.376966 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-adb049cc-5ef2-4050-b550-3203670a9a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:51.469341 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66c086-d47d-4542-a028-f47e2ff4e328 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:51.472138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3b66c086-d47d-4542-a028-f47e2ff4e328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:51.479989 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb049cc-5ef2-4050-b550-3203670a9a04 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:51.485966 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a38e3-b501-41d1-9fbc-58438a846844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:51.486949 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a38e3-b501-41d1-9fbc-58438a846844 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:51.487371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a38e3-b501-41d1-9fbc-58438a846844 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:51.487917 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a38e3-b501-41d1-9fbc-58438a846844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:51.501171 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a38e3-b501-41d1-9fbc-58438a846844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:51.503415 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a38e3-b501-41d1-9fbc-58438a846844 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:51.516421 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1032/2071] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:51.564422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66c086-d47d-4542-a028-f47e2ff4e328 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:51.566543 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f1c58-69fc-4541-8bf9-f5da0a6a2d07 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68b38ff6262147e69eedcfcc4b235d46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5066e17af58848bb9a058c8e7e47a5f3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:51.567226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f1c58-69fc-4541-8bf9-f5da0a6a2d07 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:51.567576 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f1c58-69fc-4541-8bf9-f5da0a6a2d07 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:51.567936 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f1c58-69fc-4541-8bf9-f5da0a6a2d07 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:51.568689 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f1c58-69fc-4541-8bf9-f5da0a6a2d07 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:35:51.569124 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f1c58-69fc-4541-8bf9-f5da0a6a2d07 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:51.570878 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f1c58-69fc-4541-8bf9-f5da0a6a2d07 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:51.587383 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1040/2072] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:35:51.588892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a38e3-b501-41d1-9fbc-58438a846844 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:51.599764 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a38e3-b501-41d1-9fbc-58438a846844 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:51.604584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd0b96-8da8-435c-89e7-42f1dc96dac3 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68b38ff6262147e69eedcfcc4b235d46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5066e17af58848bb9a058c8e7e47a5f3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:51.605293 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd0b96-8da8-435c-89e7-42f1dc96dac3 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:51.605635 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd0b96-8da8-435c-89e7-42f1dc96dac3 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:51.606087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd0b96-8da8-435c-89e7-42f1dc96dac3 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:51.606710 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd0b96-8da8-435c-89e7-42f1dc96dac3 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:51.608632 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd0b96-8da8-435c-89e7-42f1dc96dac3 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:51.962379 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1033/2073] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:51 2022] POST /identity/v3/projects => generated 354 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:51.963372 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f1c58-69fc-4541-8bf9-f5da0a6a2d07 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:51.979180 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f1c58-69fc-4541-8bf9-f5da0a6a2d07 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:52.050628 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e39de-a9ba-4c74-b26d-9166b495390e tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68b38ff6262147e69eedcfcc4b235d46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5066e17af58848bb9a058c8e7e47a5f3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:52.051342 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e39de-a9ba-4c74-b26d-9166b495390e tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:52.051698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e39de-a9ba-4c74-b26d-9166b495390e tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:52.052049 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e39de-a9ba-4c74-b26d-9166b495390e tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:52.052781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e39de-a9ba-4c74-b26d-9166b495390e tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:35:52.053202 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e39de-a9ba-4c74-b26d-9166b495390e tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:52.054831 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e39de-a9ba-4c74-b26d-9166b495390e tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:52.069533 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1041/2074] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:35:52.122342 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd0b96-8da8-435c-89e7-42f1dc96dac3 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:52.149707 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd0b96-8da8-435c-89e7-42f1dc96dac3 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:52.162944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9010649-fcc3-4040-a5fb-e0fa0d6ba524 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68b38ff6262147e69eedcfcc4b235d46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5066e17af58848bb9a058c8e7e47a5f3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:52.164392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9010649-fcc3-4040-a5fb-e0fa0d6ba524 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:52.164851 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9010649-fcc3-4040-a5fb-e0fa0d6ba524 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:52.165615 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9010649-fcc3-4040-a5fb-e0fa0d6ba524 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] PATH_INFO: `/v3/projects/cc6b5a9d96dd46689e137c9d7b92d7b7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:52.167147 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9010649-fcc3-4040-a5fb-e0fa0d6ba524 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cc6b5a9d96dd46689e137c9d7b92d7b7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:52.169401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9010649-fcc3-4040-a5fb-e0fa0d6ba524 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:52.292248 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b9010649-fcc3-4040-a5fb-e0fa0d6ba524 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc6b5a9d96dd46689e137c9d7b92d7b7', 'request_id': 'req-b9010649-fcc3-4040-a5fb-e0fa0d6ba524'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:52.298806 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b9010649-fcc3-4040-a5fb-e0fa0d6ba524 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc6b5a9d96dd46689e137c9d7b92d7b7', 'request_id': 'req-b9010649-fcc3-4040-a5fb-e0fa0d6ba524'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:52.363832 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e39de-a9ba-4c74-b26d-9166b495390e tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:52.378076 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b9010649-fcc3-4040-a5fb-e0fa0d6ba524 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc6b5a9d96dd46689e137c9d7b92d7b7', 'request_id': 'req-b9010649-fcc3-4040-a5fb-e0fa0d6ba524'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:52.382183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-224e39de-a9ba-4c74-b26d-9166b495390e tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:52.391440 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b9010649-fcc3-4040-a5fb-e0fa0d6ba524 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] The token cache is being invalidate because project cc6b5a9d96dd46689e137c9d7b92d7b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:52.391738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b9010649-fcc3-4040-a5fb-e0fa0d6ba524 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:52.393178 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b9010649-fcc3-4040-a5fb-e0fa0d6ba524 tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:52.395584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1034/2075] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:52 2022] DELETE /identity/v3/projects/cc6b5a9d96dd46689e137c9d7b92d7b7 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:52.459146 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e39de-a9ba-4c74-b26d-9166b495390e tempest-VolumeQuotaClassesTest-300489349 tempest-VolumeQuotaClassesTest-300489349-project-admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:52.550650 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a62da2-7b72-4e12-b508-e485df3aab27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:52.551352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a62da2-7b72-4e12-b508-e485df3aab27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:52.551705 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a62da2-7b72-4e12-b508-e485df3aab27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:52.551886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a62da2-7b72-4e12-b508-e485df3aab27 admin admin] PATH_INFO: `/v3/users/0894f53eeba7496e97ecd8607f94645d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:52.553029 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a62da2-7b72-4e12-b508-e485df3aab27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0894f53eeba7496e97ecd8607f94645d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:52.555181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a62da2-7b72-4e12-b508-e485df3aab27 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:52.735643 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:52.885142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f2a62da2-7b72-4e12-b508-e485df3aab27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0894f53eeba7496e97ecd8607f94645d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:53.031603 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f2a62da2-7b72-4e12-b508-e485df3aab27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0894f53eeba7496e97ecd8607f94645d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:53.067695 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f2a62da2-7b72-4e12-b508-e485df3aab27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0894f53eeba7496e97ecd8607f94645d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:53.068482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f2a62da2-7b72-4e12-b508-e485df3aab27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0894f53eeba7496e97ecd8607f94645d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:53.082732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f2a62da2-7b72-4e12-b508-e485df3aab27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0894f53eeba7496e97ecd8607f94645d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:53.088899 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1042/2076] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:52 2022] DELETE /identity/v3/users/0894f53eeba7496e97ecd8607f94645d => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:53.093599 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed609ba9-c5b1-4b4a-baac-56516f75a79e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:53.094095 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed609ba9-c5b1-4b4a-baac-56516f75a79e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:53.094388 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed609ba9-c5b1-4b4a-baac-56516f75a79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:53.128708 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ed609ba9-c5b1-4b4a-baac-56516f75a79e None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:53.131466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ed609ba9-c5b1-4b4a-baac-56516f75a79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:53.245610 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1035/2077] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:35:53.256784 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a62da2-7b72-4e12-b508-e485df3aab27 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:53.263461 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f2a62da2-7b72-4e12-b508-e485df3aab27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:53.278478 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a62da2-7b72-4e12-b508-e485df3aab27 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:53.284789 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2dcc89-8878-498c-acb8-01c30cbba94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:53.285555 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2dcc89-8878-498c-acb8-01c30cbba94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:53.285905 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2dcc89-8878-498c-acb8-01c30cbba94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:53.286254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2dcc89-8878-498c-acb8-01c30cbba94b admin admin] PATH_INFO: `/v3/users/8309384c6473433db2481716f2cc895f` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:53.288111 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2dcc89-8878-498c-acb8-01c30cbba94b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8309384c6473433db2481716f2cc895f)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:53.290313 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2dcc89-8878-498c-acb8-01c30cbba94b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:53.310100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed609ba9-c5b1-4b4a-baac-56516f75a79e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:53.311409 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ed609ba9-c5b1-4b4a-baac-56516f75a79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:53.387348 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed609ba9-c5b1-4b4a-baac-56516f75a79e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:53.394909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca5607-5065-441f-aee0-00cc9e0f5d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:53.396053 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca5607-5065-441f-aee0-00cc9e0f5d53 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:53.396561 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca5607-5065-441f-aee0-00cc9e0f5d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:53.397013 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca5607-5065-441f-aee0-00cc9e0f5d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:53.408893 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca5607-5065-441f-aee0-00cc9e0f5d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:53.410981 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca5607-5065-441f-aee0-00cc9e0f5d53 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:53.435084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1036/2078] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:35:53.448456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fd2dcc89-8878-498c-acb8-01c30cbba94b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8309384c6473433db2481716f2cc895f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:53.501067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:53.548916 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fd2dcc89-8878-498c-acb8-01c30cbba94b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8309384c6473433db2481716f2cc895f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:53.566978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fd2dcc89-8878-498c-acb8-01c30cbba94b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8309384c6473433db2481716f2cc895f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:53.568045 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fd2dcc89-8878-498c-acb8-01c30cbba94b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8309384c6473433db2481716f2cc895f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:53.577304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fd2dcc89-8878-498c-acb8-01c30cbba94b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8309384c6473433db2481716f2cc895f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:53.585997 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1043/2079] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:53 2022] DELETE /identity/v3/users/8309384c6473433db2481716f2cc895f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:53.591232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa08c2-00c5-458b-a9eb-0098bd4311f3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:53.591635 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa08c2-00c5-458b-a9eb-0098bd4311f3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:53.592289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa08c2-00c5-458b-a9eb-0098bd4311f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:53.614330 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c6aa08c2-00c5-458b-a9eb-0098bd4311f3 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:53.615449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c6aa08c2-00c5-458b-a9eb-0098bd4311f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:53.691343 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1037/2080] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:53.729826 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2dcc89-8878-498c-acb8-01c30cbba94b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:53.731770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fd2dcc89-8878-498c-acb8-01c30cbba94b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:53.813395 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2dcc89-8878-498c-acb8-01c30cbba94b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:53.817577 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17180570-e240-43dd-bfa0-e901c3b3f850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:53.818469 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17180570-e240-43dd-bfa0-e901c3b3f850 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:53.818986 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17180570-e240-43dd-bfa0-e901c3b3f850 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:53.819271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17180570-e240-43dd-bfa0-e901c3b3f850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:53.834689 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17180570-e240-43dd-bfa0-e901c3b3f850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:53.837110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17180570-e240-43dd-bfa0-e901c3b3f850 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:53.850770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1044/2081] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:35:54.443295 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:54.823395 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ddc45-eefd-4c1b-9c2e-c646053cbe89 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:54.823900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ddc45-eefd-4c1b-9c2e-c646053cbe89 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:54.823986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ddc45-eefd-4c1b-9c2e-c646053cbe89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:54.890053 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17180570-e240-43dd-bfa0-e901c3b3f850 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:54.892741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-17180570-e240-43dd-bfa0-e901c3b3f850 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:54.894543 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-078ddc45-eefd-4c1b-9c2e-c646053cbe89 None None] MFA Rules not processed for user `38c0666fea2948c29d94e297222e2df1`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:54.895944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-078ddc45-eefd-4c1b-9c2e-c646053cbe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:54.909887 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17180570-e240-43dd-bfa0-e901c3b3f850 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:54.929725 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822ba27-f0bb-49a4-b246-26873e04fe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:54.930318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822ba27-f0bb-49a4-b246-26873e04fe61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:54.930637 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822ba27-f0bb-49a4-b246-26873e04fe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:54.930954 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822ba27-f0bb-49a4-b246-26873e04fe61 admin admin] PATH_INFO: `/v3/projects/f604a638cf9c48a69dd4cb74eb6150ac` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:54.932587 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822ba27-f0bb-49a4-b246-26873e04fe61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f604a638cf9c48a69dd4cb74eb6150ac)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:54.935390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822ba27-f0bb-49a4-b246-26873e04fe61 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:55.023458 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1038/2082] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:55.036880 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ddc45-eefd-4c1b-9c2e-c646053cbe89 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:55.037300 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-078ddc45-eefd-4c1b-9c2e-c646053cbe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:55.130483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0822ba27-f0bb-49a4-b246-26873e04fe61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f604a638cf9c48a69dd4cb74eb6150ac', 'request_id': 'req-0822ba27-f0bb-49a4-b246-26873e04fe61'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:55.143629 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0822ba27-f0bb-49a4-b246-26873e04fe61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f604a638cf9c48a69dd4cb74eb6150ac', 'request_id': 'req-0822ba27-f0bb-49a4-b246-26873e04fe61'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:55.155885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ddc45-eefd-4c1b-9c2e-c646053cbe89 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:55.199447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:55.235201 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0822ba27-f0bb-49a4-b246-26873e04fe61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f604a638cf9c48a69dd4cb74eb6150ac', 'request_id': 'req-0822ba27-f0bb-49a4-b246-26873e04fe61'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:55.248996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e80c0-085f-4c49-9196-dc6203ebdf86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:55.249959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e80c0-085f-4c49-9196-dc6203ebdf86 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:55.250445 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e80c0-085f-4c49-9196-dc6203ebdf86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:55.250819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e80c0-085f-4c49-9196-dc6203ebdf86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:55.254001 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0822ba27-f0bb-49a4-b246-26873e04fe61 admin admin] The token cache is being invalidate because project f604a638cf9c48a69dd4cb74eb6150ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:55.254250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0822ba27-f0bb-49a4-b246-26873e04fe61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:55.255307 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0822ba27-f0bb-49a4-b246-26873e04fe61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:55.257295 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1045/2083] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:54 2022] DELETE /identity/v3/projects/f604a638cf9c48a69dd4cb74eb6150ac => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:55.261451 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822ba27-f0bb-49a4-b246-26873e04fe61 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:55.262927 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0822ba27-f0bb-49a4-b246-26873e04fe61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:55.336413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e80c0-085f-4c49-9196-dc6203ebdf86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:55.338198 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e80c0-085f-4c49-9196-dc6203ebdf86 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:55.351636 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1039/2084] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:35:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:35:55.381761 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822ba27-f0bb-49a4-b246-26873e04fe61 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:55.386974 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ceb7c-2f95-4f1b-bbc7-98dfe250deaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:55.387628 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ceb7c-2f95-4f1b-bbc7-98dfe250deaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:55.388114 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ceb7c-2f95-4f1b-bbc7-98dfe250deaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:55.388317 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ceb7c-2f95-4f1b-bbc7-98dfe250deaf admin admin] PATH_INFO: `/v3/users/b22e0d1d27074b77b2a7b5707f155c5b` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:55.389647 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ceb7c-2f95-4f1b-bbc7-98dfe250deaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b22e0d1d27074b77b2a7b5707f155c5b)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:55.392707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ceb7c-2f95-4f1b-bbc7-98dfe250deaf admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:55.592299 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e80c0-085f-4c49-9196-dc6203ebdf86 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:55.592299 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-931e80c0-085f-4c49-9196-dc6203ebdf86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:55.607432 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e80c0-085f-4c49-9196-dc6203ebdf86 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:55.630087 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4f5ceb7c-2f95-4f1b-bbc7-98dfe250deaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b22e0d1d27074b77b2a7b5707f155c5b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:55.635542 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06918099-7734-494b-a126-7a45d8027267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:55.636193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06918099-7734-494b-a126-7a45d8027267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:55.636473 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06918099-7734-494b-a126-7a45d8027267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:55.636750 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06918099-7734-494b-a126-7a45d8027267 admin admin] PATH_INFO: `/v3/projects/ab5b67bc243b49aaa2ee5c9ef6b5176a` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:55.638696 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06918099-7734-494b-a126-7a45d8027267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab5b67bc243b49aaa2ee5c9ef6b5176a)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:55.640650 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06918099-7734-494b-a126-7a45d8027267 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:55.723167 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4f5ceb7c-2f95-4f1b-bbc7-98dfe250deaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b22e0d1d27074b77b2a7b5707f155c5b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:55.739153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4f5ceb7c-2f95-4f1b-bbc7-98dfe250deaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b22e0d1d27074b77b2a7b5707f155c5b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:55.740140 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4f5ceb7c-2f95-4f1b-bbc7-98dfe250deaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b22e0d1d27074b77b2a7b5707f155c5b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:55.749664 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4f5ceb7c-2f95-4f1b-bbc7-98dfe250deaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b22e0d1d27074b77b2a7b5707f155c5b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:55.761795 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1046/2085] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:55 2022] DELETE /identity/v3/users/b22e0d1d27074b77b2a7b5707f155c5b => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:55.791773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-06918099-7734-494b-a126-7a45d8027267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab5b67bc243b49aaa2ee5c9ef6b5176a', 'request_id': 'req-06918099-7734-494b-a126-7a45d8027267'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:55.798929 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-06918099-7734-494b-a126-7a45d8027267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab5b67bc243b49aaa2ee5c9ef6b5176a', 'request_id': 'req-06918099-7734-494b-a126-7a45d8027267'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:55.873548 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-06918099-7734-494b-a126-7a45d8027267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab5b67bc243b49aaa2ee5c9ef6b5176a', 'request_id': 'req-06918099-7734-494b-a126-7a45d8027267'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:55.888447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-06918099-7734-494b-a126-7a45d8027267 admin admin] The token cache is being invalidate because project ab5b67bc243b49aaa2ee5c9ef6b5176a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:55.888736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-06918099-7734-494b-a126-7a45d8027267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:55.889701 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-06918099-7734-494b-a126-7a45d8027267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:55.891434 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1040/2086] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:55 2022] DELETE /identity/v3/projects/ab5b67bc243b49aaa2ee5c9ef6b5176a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:35:55.895997 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ceb7c-2f95-4f1b-bbc7-98dfe250deaf admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:55.897452 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4f5ceb7c-2f95-4f1b-bbc7-98dfe250deaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:55.973115 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ceb7c-2f95-4f1b-bbc7-98dfe250deaf admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:56.026571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:56.060809 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5aa723-760b-44b7-8f06-8459217d7ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:56.061802 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5aa723-760b-44b7-8f06-8459217d7ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:56.062389 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5aa723-760b-44b7-8f06-8459217d7ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:56.062872 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5aa723-760b-44b7-8f06-8459217d7ea2 admin admin] PATH_INFO: `/v3/users/68b38ff6262147e69eedcfcc4b235d46` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:56.064968 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5aa723-760b-44b7-8f06-8459217d7ea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68b38ff6262147e69eedcfcc4b235d46)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:56.074137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5aa723-760b-44b7-8f06-8459217d7ea2 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:56.293507 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-ea5aa723-760b-44b7-8f06-8459217d7ea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68b38ff6262147e69eedcfcc4b235d46'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:56.377338 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-ea5aa723-760b-44b7-8f06-8459217d7ea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68b38ff6262147e69eedcfcc4b235d46'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:56.402088 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-ea5aa723-760b-44b7-8f06-8459217d7ea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68b38ff6262147e69eedcfcc4b235d46'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:56.403513 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-ea5aa723-760b-44b7-8f06-8459217d7ea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68b38ff6262147e69eedcfcc4b235d46'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:56.420568 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-ea5aa723-760b-44b7-8f06-8459217d7ea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68b38ff6262147e69eedcfcc4b235d46'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:56.428399 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1047/2087] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:55 2022] DELETE /identity/v3/users/68b38ff6262147e69eedcfcc4b235d46 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:56.450708 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06918099-7734-494b-a126-7a45d8027267 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:56.452191 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-06918099-7734-494b-a126-7a45d8027267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:56.477620 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06918099-7734-494b-a126-7a45d8027267 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:56.603058 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369aec11-69fc-4e59-84b5-8eda031a6b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:56.603764 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369aec11-69fc-4e59-84b5-8eda031a6b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:56.604048 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369aec11-69fc-4e59-84b5-8eda031a6b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:56.604326 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369aec11-69fc-4e59-84b5-8eda031a6b67 admin admin] PATH_INFO: `/v3/projects/5f41ba97988143a98a9dbaf6962e512c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:56.605986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369aec11-69fc-4e59-84b5-8eda031a6b67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f41ba97988143a98a9dbaf6962e512c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:56.608992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369aec11-69fc-4e59-84b5-8eda031a6b67 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:56.785825 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-369aec11-69fc-4e59-84b5-8eda031a6b67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f41ba97988143a98a9dbaf6962e512c', 'request_id': 'req-369aec11-69fc-4e59-84b5-8eda031a6b67'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:56.792678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-369aec11-69fc-4e59-84b5-8eda031a6b67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f41ba97988143a98a9dbaf6962e512c', 'request_id': 'req-369aec11-69fc-4e59-84b5-8eda031a6b67'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:57.079731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-369aec11-69fc-4e59-84b5-8eda031a6b67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f41ba97988143a98a9dbaf6962e512c', 'request_id': 'req-369aec11-69fc-4e59-84b5-8eda031a6b67'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:57.096557 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-369aec11-69fc-4e59-84b5-8eda031a6b67 admin admin] The token cache is being invalidate because project 5f41ba97988143a98a9dbaf6962e512c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:57.096859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-369aec11-69fc-4e59-84b5-8eda031a6b67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:57.097618 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-369aec11-69fc-4e59-84b5-8eda031a6b67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:57.100149 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1041/2088] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:56 2022] DELETE /identity/v3/projects/5f41ba97988143a98a9dbaf6962e512c => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:57.107126 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca7808-309b-4479-a467-3142845d3a59 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:57.107627 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca7808-309b-4479-a467-3142845d3a59 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:57.107627 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca7808-309b-4479-a467-3142845d3a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:57.139517 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-f9ca7808-309b-4479-a467-3142845d3a59 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:57.141488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f9ca7808-309b-4479-a467-3142845d3a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:57.247787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369aec11-69fc-4e59-84b5-8eda031a6b67 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:57.248365 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-369aec11-69fc-4e59-84b5-8eda031a6b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:57.295157 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369aec11-69fc-4e59-84b5-8eda031a6b67 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:57.296358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1048/2089] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:57.300223 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ca5e2-f7ec-4694-93dd-0153102549fd None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:57.300526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ca5e2-f7ec-4694-93dd-0153102549fd None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:57.300954 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ca5e2-f7ec-4694-93dd-0153102549fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:57.314326 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b7baf-9cdf-4733-bd2c-9401a16edf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:57.318667 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b7baf-9cdf-4733-bd2c-9401a16edf4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:57.318667 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b7baf-9cdf-4733-bd2c-9401a16edf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:57.318995 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b7baf-9cdf-4733-bd2c-9401a16edf4b admin admin] PATH_INFO: `/v3/projects/5066e17af58848bb9a058c8e7e47a5f3` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:57.321850 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b7baf-9cdf-4733-bd2c-9401a16edf4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5066e17af58848bb9a058c8e7e47a5f3)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:57.327269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b7baf-9cdf-4733-bd2c-9401a16edf4b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:57.362499 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-604ca5e2-f7ec-4694-93dd-0153102549fd None None] MFA Rules not processed for user `38c0666fea2948c29d94e297222e2df1`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:57.363096 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-604ca5e2-f7ec-4694-93dd-0153102549fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:57.468871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1049/2090] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:57.468871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6a296-bdc0-425d-9a7e-41daf805933f None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:57.468871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6a296-bdc0-425d-9a7e-41daf805933f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:57.468871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6a296-bdc0-425d-9a7e-41daf805933f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:57.506040 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a20b7baf-9cdf-4733-bd2c-9401a16edf4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5066e17af58848bb9a058c8e7e47a5f3', 'request_id': 'req-a20b7baf-9cdf-4733-bd2c-9401a16edf4b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:57.512954 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:57.516080 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a20b7baf-9cdf-4733-bd2c-9401a16edf4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5066e17af58848bb9a058c8e7e47a5f3', 'request_id': 'req-a20b7baf-9cdf-4733-bd2c-9401a16edf4b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:57.517793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-48f6a296-bdc0-425d-9a7e-41daf805933f None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:57.519193 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-48f6a296-bdc0-425d-9a7e-41daf805933f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:57.593430 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1050/2091] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:57.598570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6a296-bdc0-425d-9a7e-41daf805933f None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:57.608374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6a296-bdc0-425d-9a7e-41daf805933f None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:57.614544 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001f79e-3992-4bfb-ba42-8c98843ed6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:57.615090 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001f79e-3992-4bfb-ba42-8c98843ed6da admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:57.615368 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001f79e-3992-4bfb-ba42-8c98843ed6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:57.615640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001f79e-3992-4bfb-ba42-8c98843ed6da admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:57.616285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001f79e-3992-4bfb-ba42-8c98843ed6da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:35:57.616590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001f79e-3992-4bfb-ba42-8c98843ed6da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:57.618298 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001f79e-3992-4bfb-ba42-8c98843ed6da admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:57.630972 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1051/2092] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:35:57.635461 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001f79e-3992-4bfb-ba42-8c98843ed6da admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:57.645919 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001f79e-3992-4bfb-ba42-8c98843ed6da admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:57.654435 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a20b7baf-9cdf-4733-bd2c-9401a16edf4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5066e17af58848bb9a058c8e7e47a5f3', 'request_id': 'req-a20b7baf-9cdf-4733-bd2c-9401a16edf4b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:57.662926 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dea26-5863-4764-a31e-9ee02b48821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:57.663915 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dea26-5863-4764-a31e-9ee02b48821f admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:57.664335 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dea26-5863-4764-a31e-9ee02b48821f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:57.665028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dea26-5863-4764-a31e-9ee02b48821f admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:57.666146 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1dea26-5863-4764-a31e-9ee02b48821f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:57.668475 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1dea26-5863-4764-a31e-9ee02b48821f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:57.676259 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a20b7baf-9cdf-4733-bd2c-9401a16edf4b admin admin] The token cache is being invalidate because project 5066e17af58848bb9a058c8e7e47a5f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:35:57.676562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a20b7baf-9cdf-4733-bd2c-9401a16edf4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:57.677289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a20b7baf-9cdf-4733-bd2c-9401a16edf4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:57.679370 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1042/2093] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:35:57 2022] DELETE /identity/v3/projects/5066e17af58848bb9a058c8e7e47a5f3 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:57.684547 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c509e0-ddde-458e-9fd7-ca99ca960ffa None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:57.685258 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c509e0-ddde-458e-9fd7-ca99ca960ffa None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:57.685729 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c509e0-ddde-458e-9fd7-ca99ca960ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:57.712545 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a1c509e0-ddde-458e-9fd7-ca99ca960ffa None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:57.713993 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a1c509e0-ddde-458e-9fd7-ca99ca960ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:57.726119 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1043/2094] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:35:57.733949 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818730d7-b225-42a9-9956-07e3ffd3bc12 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:57.734445 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818730d7-b225-42a9-9956-07e3ffd3bc12 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:57.734894 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818730d7-b225-42a9-9956-07e3ffd3bc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:57.759898 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-818730d7-b225-42a9-9956-07e3ffd3bc12 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:57.761578 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-818730d7-b225-42a9-9956-07e3ffd3bc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:57.776790 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1052/2095] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:57 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:35:57.778253 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1044/2096] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:57.782942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dea26-5863-4764-a31e-9ee02b48821f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:57.783368 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818730d7-b225-42a9-9956-07e3ffd3bc12 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:57.785249 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7f1dea26-5863-4764-a31e-9ee02b48821f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:57.795477 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818730d7-b225-42a9-9956-07e3ffd3bc12 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:57.909287 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dea26-5863-4764-a31e-9ee02b48821f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:57.914765 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d539e-873d-47d4-a874-4d168a465fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:57.915574 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785418b-3fa5-4351-ae37-80f1257ee680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:57.916209 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d539e-873d-47d4-a874-4d168a465fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:57.916575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785418b-3fa5-4351-ae37-80f1257ee680 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:57.916702 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d539e-873d-47d4-a874-4d168a465fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:57.917163 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d539e-873d-47d4-a874-4d168a465fc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:57.917359 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785418b-3fa5-4351-ae37-80f1257ee680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:57.917769 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785418b-3fa5-4351-ae37-80f1257ee680 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:57.918152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d539e-873d-47d4-a874-4d168a465fc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:57.919042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785418b-3fa5-4351-ae37-80f1257ee680 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:35:57.919497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785418b-3fa5-4351-ae37-80f1257ee680 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:57.920547 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d539e-873d-47d4-a874-4d168a465fc4 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:57.922306 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785418b-3fa5-4351-ae37-80f1257ee680 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:57.947697 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1045/2097] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:35:57.950078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785418b-3fa5-4351-ae37-80f1257ee680 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:57.963621 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785418b-3fa5-4351-ae37-80f1257ee680 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:57.978457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8784459-eae1-474c-897a-5eaf7937bd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:57.979271 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8784459-eae1-474c-897a-5eaf7937bd6b admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:57.979925 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8784459-eae1-474c-897a-5eaf7937bd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:57.980305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8784459-eae1-474c-897a-5eaf7937bd6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:57.981089 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8784459-eae1-474c-897a-5eaf7937bd6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:57.984178 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8784459-eae1-474c-897a-5eaf7937bd6b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:58.055168 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1053/2098] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:57 2022] POST /identity/v3/users => generated 294 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:58.059332 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d539e-873d-47d4-a874-4d168a465fc4 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:58.070156 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d539e-873d-47d4-a874-4d168a465fc4 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:58.079260 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bbe23-6c94-4838-9092-b4c8690ec03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:58.080477 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bbe23-6c94-4838-9092-b4c8690ec03b admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:58.082082 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bbe23-6c94-4838-9092-b4c8690ec03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:58.082300 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bbe23-6c94-4838-9092-b4c8690ec03b admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:58.083290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1bbe23-6c94-4838-9092-b4c8690ec03b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:58.084959 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1bbe23-6c94-4838-9092-b4c8690ec03b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:58.099895 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1054/2099] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:58.104026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bbe23-6c94-4838-9092-b4c8690ec03b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:58.120317 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bbe23-6c94-4838-9092-b4c8690ec03b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:58.138493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b8113-bb42-44fd-ad95-4994f85dd1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:58.139701 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b8113-bb42-44fd-ad95-4994f85dd1ae admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:58.140538 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b8113-bb42-44fd-ad95-4994f85dd1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:58.140743 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b8113-bb42-44fd-ad95-4994f85dd1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:58.141511 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b8113-bb42-44fd-ad95-4994f85dd1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:58.142343 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1046/2100] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:57 2022] POST /identity/v3/projects => generated 383 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:58.144597 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8784459-eae1-474c-897a-5eaf7937bd6b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:58.145099 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b8113-bb42-44fd-ad95-4994f85dd1ae admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:58.177341 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1055/2101] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:35:58.181432 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b8113-bb42-44fd-ad95-4994f85dd1ae admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:58.211145 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b8113-bb42-44fd-ad95-4994f85dd1ae admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:58.246399 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8784459-eae1-474c-897a-5eaf7937bd6b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:58.259953 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded59029-75b3-443c-bcb7-c7fa8a217aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:58.261002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded59029-75b3-443c-bcb7-c7fa8a217aac admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:58.262256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded59029-75b3-443c-bcb7-c7fa8a217aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:58.262256 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded59029-75b3-443c-bcb7-c7fa8a217aac admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:58.262682 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded59029-75b3-443c-bcb7-c7fa8a217aac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:58.264697 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded59029-75b3-443c-bcb7-c7fa8a217aac admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:58.322105 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f873eb66-48d5-4468-823f-1b532c2deb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:58.323404 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873eb66-48d5-4468-823f-1b532c2deb70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:58.323688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873eb66-48d5-4468-823f-1b532c2deb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:58.323982 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f873eb66-48d5-4468-823f-1b532c2deb70 admin admin] PATH_INFO: `/v3/projects/ea09a763920a41c2b32feef2468addce/users/4e6c1cfc65d1456ab754f5c55889f251/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:58.350712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873eb66-48d5-4468-823f-1b532c2deb70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea09a763920a41c2b32feef2468addce, user_id=4e6c1cfc65d1456ab754f5c55889f251, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:58.353939 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f873eb66-48d5-4468-823f-1b532c2deb70 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:58.371481 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1047/2102] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:58 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:58.375713 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded59029-75b3-443c-bcb7-c7fa8a217aac admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:58.389481 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded59029-75b3-443c-bcb7-c7fa8a217aac admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:58.408508 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed0cac-44d3-428f-aff1-1999e7b9187d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:58.414030 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed0cac-44d3-428f-aff1-1999e7b9187d admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:58.414580 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed0cac-44d3-428f-aff1-1999e7b9187d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:58.415665 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed0cac-44d3-428f-aff1-1999e7b9187d admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:58.416580 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed0cac-44d3-428f-aff1-1999e7b9187d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:58.419636 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed0cac-44d3-428f-aff1-1999e7b9187d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:58.435621 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1056/2103] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:58 2022] PUT /identity/v3/projects/ea09a763920a41c2b32feef2468addce/users/4e6c1cfc65d1456ab754f5c55889f251/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:35:58.452284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0e9a5-9bcb-4d7e-80cc-7c66217dae84 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:58.455323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0e9a5-9bcb-4d7e-80cc-7c66217dae84 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:58.455730 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0e9a5-9bcb-4d7e-80cc-7c66217dae84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:58.492358 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1048/2104] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:35:58.502293 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed0cac-44d3-428f-aff1-1999e7b9187d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:58.572558 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-9dc0e9a5-9bcb-4d7e-80cc-7c66217dae84 None None] MFA Rules not processed for user `4e6c1cfc65d1456ab754f5c55889f251`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:58.573835 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9dc0e9a5-9bcb-4d7e-80cc-7c66217dae84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:58.585652 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed0cac-44d3-428f-aff1-1999e7b9187d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:58.752934 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1057/2105] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:58.761388 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0e9a5-9bcb-4d7e-80cc-7c66217dae84 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:58.833565 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9c468-649b-4c91-b9d3-5174c5187fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:58.834199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9c468-649b-4c91-b9d3-5174c5187fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:58.834818 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9c468-649b-4c91-b9d3-5174c5187fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:58.835104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9c468-649b-4c91-b9d3-5174c5187fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:58.835831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9c468-649b-4c91-b9d3-5174c5187fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:58.839013 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9c468-649b-4c91-b9d3-5174c5187fa0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:58.854723 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1049/2106] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:58.855614 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9c468-649b-4c91-b9d3-5174c5187fa0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:58.868784 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9c468-649b-4c91-b9d3-5174c5187fa0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:58.873470 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0e9a5-9bcb-4d7e-80cc-7c66217dae84 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:58.875640 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78caf5ee-40b1-402d-850e-9e63ebca5204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:58.877733 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caf5ee-40b1-402d-850e-9e63ebca5204 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:58.878018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caf5ee-40b1-402d-850e-9e63ebca5204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:58.878296 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caf5ee-40b1-402d-850e-9e63ebca5204 admin admin] PATH_INFO: `/v3/projects/c9fe21975c6a4f769137e46bc4802392/users/501acd495aaf4f518fb7747c27821c11/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:58.895246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7bb89-e01c-4f13-a6dc-cbb5402fd939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:58.895246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7bb89-e01c-4f13-a6dc-cbb5402fd939 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:58.895246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7bb89-e01c-4f13-a6dc-cbb5402fd939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:58.895246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7bb89-e01c-4f13-a6dc-cbb5402fd939 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:58.895884 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7bb89-e01c-4f13-a6dc-cbb5402fd939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:58.897792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7bb89-e01c-4f13-a6dc-cbb5402fd939 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:58.902200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78caf5ee-40b1-402d-850e-9e63ebca5204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9fe21975c6a4f769137e46bc4802392, user_id=501acd495aaf4f518fb7747c27821c11, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:58.907134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78caf5ee-40b1-402d-850e-9e63ebca5204 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:59.041107 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1050/2107] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:58 2022] PUT /identity/v3/projects/c9fe21975c6a4f769137e46bc4802392/users/501acd495aaf4f518fb7747c27821c11/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:59.052961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76059dae-fa1c-4d45-97ae-abc758bdac84 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:59.053763 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76059dae-fa1c-4d45-97ae-abc758bdac84 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:59.053763 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76059dae-fa1c-4d45-97ae-abc758bdac84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:59.077702 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1058/2108] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:58 2022] POST /identity/v3/projects => generated 385 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:35:59.082445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7bb89-e01c-4f13-a6dc-cbb5402fd939 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:59.108761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-76059dae-fa1c-4d45-97ae-abc758bdac84 None None] MFA Rules not processed for user `501acd495aaf4f518fb7747c27821c11`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:35:59.110095 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-76059dae-fa1c-4d45-97ae-abc758bdac84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:59.210520 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7bb89-e01c-4f13-a6dc-cbb5402fd939 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:59.220548 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28195d-2330-449e-922f-a2f801add931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:59.221456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28195d-2330-449e-922f-a2f801add931 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:59.222498 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28195d-2330-449e-922f-a2f801add931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:59.223020 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28195d-2330-449e-922f-a2f801add931 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:59.224439 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28195d-2330-449e-922f-a2f801add931 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:59.229003 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28195d-2330-449e-922f-a2f801add931 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:59.288051 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1051/2109] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:35:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:35:59.294773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76059dae-fa1c-4d45-97ae-abc758bdac84 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:59.296361 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-76059dae-fa1c-4d45-97ae-abc758bdac84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:59.322736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76059dae-fa1c-4d45-97ae-abc758bdac84 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:59.326882 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1059/2110] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:59 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:59.328076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28195d-2330-449e-922f-a2f801add931 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:59.332033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed7cde-5d23-401d-a6ba-babb1d4ab40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:59.332796 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed7cde-5d23-401d-a6ba-babb1d4ab40e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:59.333233 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed7cde-5d23-401d-a6ba-babb1d4ab40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:59.333608 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed7cde-5d23-401d-a6ba-babb1d4ab40e admin admin] PATH_INFO: `/v3/users/737c90cc21dc4da489d15d513dec5932` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:59.335745 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed7cde-5d23-401d-a6ba-babb1d4ab40e admin admin] RBAC: Authorizing `identity:delete_user(user_id=737c90cc21dc4da489d15d513dec5932)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:59.337869 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed7cde-5d23-401d-a6ba-babb1d4ab40e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:59.352156 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28195d-2330-449e-922f-a2f801add931 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:59.359027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e6a30-262d-4b6f-859f-08a2f5d8531d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:59.359653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e6a30-262d-4b6f-859f-08a2f5d8531d admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:59.359931 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e6a30-262d-4b6f-859f-08a2f5d8531d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:59.361569 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e6a30-262d-4b6f-859f-08a2f5d8531d admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:59.362388 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e6a30-262d-4b6f-859f-08a2f5d8531d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:59.368641 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e6a30-262d-4b6f-859f-08a2f5d8531d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:59.514770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1060/2111] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:35:59 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:59.515624 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e6a30-262d-4b6f-859f-08a2f5d8531d admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:59.593952 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e6a30-262d-4b6f-859f-08a2f5d8531d admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:59.602119 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8db28-cd53-441b-b91a-1dbe450d4431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:59.603196 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8db28-cd53-441b-b91a-1dbe450d4431 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:59.603679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8db28-cd53-441b-b91a-1dbe450d4431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:59.609408 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8db28-cd53-441b-b91a-1dbe450d4431 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:59.609408 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8db28-cd53-441b-b91a-1dbe450d4431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:59.609408 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8db28-cd53-441b-b91a-1dbe450d4431 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:59.630812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-78ed7cde-5d23-401d-a6ba-babb1d4ab40e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '737c90cc21dc4da489d15d513dec5932'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:59.632015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-78ed7cde-5d23-401d-a6ba-babb1d4ab40e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '737c90cc21dc4da489d15d513dec5932'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:59.634341 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1061/2112] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:59.635218 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8db28-cd53-441b-b91a-1dbe450d4431 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:59.639533 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-15c8db28-cd53-441b-b91a-1dbe450d4431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:59.651333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8db28-cd53-441b-b91a-1dbe450d4431 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:59.658324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d23992-28c2-4ba6-b358-1d67325229bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:59.658818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d23992-28c2-4ba6-b358-1d67325229bb admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:59.659334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d23992-28c2-4ba6-b358-1d67325229bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:59.659624 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d23992-28c2-4ba6-b358-1d67325229bb admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:59.660084 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d23992-28c2-4ba6-b358-1d67325229bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:59.662187 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d23992-28c2-4ba6-b358-1d67325229bb admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:59.718862 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-78ed7cde-5d23-401d-a6ba-babb1d4ab40e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '737c90cc21dc4da489d15d513dec5932'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:59.733564 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-78ed7cde-5d23-401d-a6ba-babb1d4ab40e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '737c90cc21dc4da489d15d513dec5932'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:59.734436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-78ed7cde-5d23-401d-a6ba-babb1d4ab40e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '737c90cc21dc4da489d15d513dec5932'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:35:59.747332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1052/2113] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:35:59 2022] DELETE /identity/v3/users/737c90cc21dc4da489d15d513dec5932 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:35:59.748126 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed7cde-5d23-401d-a6ba-babb1d4ab40e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:59.749503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-78ed7cde-5d23-401d-a6ba-babb1d4ab40e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:35:59.792727 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1062/2114] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:35:59 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:35:59.797646 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d23992-28c2-4ba6-b358-1d67325229bb admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:59.807998 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d23992-28c2-4ba6-b358-1d67325229bb admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:59.844200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed7cde-5d23-401d-a6ba-babb1d4ab40e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:59.851424 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c3e06-4a2a-4914-be6a-651cc55a5bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:59.852061 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c3e06-4a2a-4914-be6a-651cc55a5bfc admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:59.852388 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c3e06-4a2a-4914-be6a-651cc55a5bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:59.852662 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c3e06-4a2a-4914-be6a-651cc55a5bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:59.853420 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c3e06-4a2a-4914-be6a-651cc55a5bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:59.855759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c3e06-4a2a-4914-be6a-651cc55a5bfc admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:59.870919 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1053/2115] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:35:59.876667 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c3e06-4a2a-4914-be6a-651cc55a5bfc admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:59.889581 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c3e06-4a2a-4914-be6a-651cc55a5bfc admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:59.894614 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91907e44-5d86-4cd9-b6c7-b3afe1a90547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:59.895567 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91907e44-5d86-4cd9-b6c7-b3afe1a90547 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:59.896013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91907e44-5d86-4cd9-b6c7-b3afe1a90547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:59.896429 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91907e44-5d86-4cd9-b6c7-b3afe1a90547 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:59.897258 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91907e44-5d86-4cd9-b6c7-b3afe1a90547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:59.897966 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f49cc-d5a6-4ad3-8f4e-306a71f77f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:59.898923 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f49cc-d5a6-4ad3-8f4e-306a71f77f8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:59.899275 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f49cc-d5a6-4ad3-8f4e-306a71f77f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:59.899854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91907e44-5d86-4cd9-b6c7-b3afe1a90547 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:59.899987 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f49cc-d5a6-4ad3-8f4e-306a71f77f8a admin admin] PATH_INFO: `/v3/projects/15230a29d16b43a3a433ed744e971868/users/ab99a80fbd374a828e13489a614d0126/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:59.918944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1063/2116] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:35:59.922061 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f49cc-d5a6-4ad3-8f4e-306a71f77f8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=15230a29d16b43a3a433ed744e971868, user_id=ab99a80fbd374a828e13489a614d0126, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:59.922550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91907e44-5d86-4cd9-b6c7-b3afe1a90547 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:35:59.925509 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f49cc-d5a6-4ad3-8f4e-306a71f77f8a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:59.940642 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91907e44-5d86-4cd9-b6c7-b3afe1a90547 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:35:59.946987 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525852a-13f0-426f-89c0-9aebc5b1d789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:35:59.947643 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525852a-13f0-426f-89c0-9aebc5b1d789 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:35:59.947919 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525852a-13f0-426f-89c0-9aebc5b1d789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:35:59.948188 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525852a-13f0-426f-89c0-9aebc5b1d789 admin admin] PATH_INFO: `/v3/projects/6478df589c1042669f0903915d81c103/users/6145fe0f63ef4ef28b657050bdae67f9/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:35:59.971599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525852a-13f0-426f-89c0-9aebc5b1d789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6478df589c1042669f0903915d81c103, user_id=6145fe0f63ef4ef28b657050bdae67f9, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:35:59.974447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525852a-13f0-426f-89c0-9aebc5b1d789 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:35:59.993587 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1054/2117] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:59 2022] PUT /identity/v3/projects/15230a29d16b43a3a433ed744e971868/users/ab99a80fbd374a828e13489a614d0126/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:00.019796 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f6936-cdeb-47e2-868c-ad2d5b6d13f2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:00.020092 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f6936-cdeb-47e2-868c-ad2d5b6d13f2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:00.020366 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f6936-cdeb-47e2-868c-ad2d5b6d13f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:00.029393 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:00.053454 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-281f6936-cdeb-47e2-868c-ad2d5b6d13f2 None None] MFA Rules not processed for user `ab99a80fbd374a828e13489a614d0126`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:00.054665 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-281f6936-cdeb-47e2-868c-ad2d5b6d13f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:00.084472 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1064/2118] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:35:59 2022] PUT /identity/v3/projects/6478df589c1042669f0903915d81c103/users/6145fe0f63ef4ef28b657050bdae67f9/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:00.088445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525852a-13f0-426f-89c0-9aebc5b1d789 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:00.119260 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:00.130280 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1055/2119] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:00.130280 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f6936-cdeb-47e2-868c-ad2d5b6d13f2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:00.130280 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-281f6936-cdeb-47e2-868c-ad2d5b6d13f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:00.175069 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525852a-13f0-426f-89c0-9aebc5b1d789 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:00.180289 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569e58d-b0ea-422c-8973-ea9ffe850201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:00.181530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569e58d-b0ea-422c-8973-ea9ffe850201 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:00.181809 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569e58d-b0ea-422c-8973-ea9ffe850201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:00.182104 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569e58d-b0ea-422c-8973-ea9ffe850201 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:00.183305 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569e58d-b0ea-422c-8973-ea9ffe850201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:00.185807 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569e58d-b0ea-422c-8973-ea9ffe850201 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:00.200073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f6936-cdeb-47e2-868c-ad2d5b6d13f2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:00.205534 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9dbb68-dbec-438e-9d4d-66548775868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:00.206084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dbb68-dbec-438e-9d4d-66548775868e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:00.206361 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dbb68-dbec-438e-9d4d-66548775868e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:00.206633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dbb68-dbec-438e-9d4d-66548775868e admin admin] PATH_INFO: `/v3/projects/42b33ed10ad1436684d1b2a32c99a27b` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:00.207883 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9dbb68-dbec-438e-9d4d-66548775868e admin admin] RBAC: Authorizing `identity:delete_project(project_id=42b33ed10ad1436684d1b2a32c99a27b)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:00.210087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9dbb68-dbec-438e-9d4d-66548775868e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:00.211559 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1065/2120] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:00.214433 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569e58d-b0ea-422c-8973-ea9ffe850201 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:00.227629 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569e58d-b0ea-422c-8973-ea9ffe850201 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:00.235532 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df6cc9-eb35-4601-bab1-22df3a767863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:00.236847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df6cc9-eb35-4601-bab1-22df3a767863 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:00.237317 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df6cc9-eb35-4601-bab1-22df3a767863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:00.237593 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df6cc9-eb35-4601-bab1-22df3a767863 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:00.238234 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df6cc9-eb35-4601-bab1-22df3a767863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:00.240234 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df6cc9-eb35-4601-bab1-22df3a767863 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:00.325028 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-de9dbb68-dbec-438e-9d4d-66548775868e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b33ed10ad1436684d1b2a32c99a27b', 'request_id': 'req-de9dbb68-dbec-438e-9d4d-66548775868e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:00.331119 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-de9dbb68-dbec-438e-9d4d-66548775868e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b33ed10ad1436684d1b2a32c99a27b', 'request_id': 'req-de9dbb68-dbec-438e-9d4d-66548775868e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:00.341037 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1066/2121] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:36:00 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:00.341870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df6cc9-eb35-4601-bab1-22df3a767863 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:00.402726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df6cc9-eb35-4601-bab1-22df3a767863 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:00.407362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db50af-2fa9-4117-a5d4-7eec3d2db6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:00.408044 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db50af-2fa9-4117-a5d4-7eec3d2db6fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:00.408317 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db50af-2fa9-4117-a5d4-7eec3d2db6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:00.408592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db50af-2fa9-4117-a5d4-7eec3d2db6fe admin admin] PATH_INFO: `/v3/projects/6478df589c1042669f0903915d81c103/users/6145fe0f63ef4ef28b657050bdae67f9/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:00.410655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db50af-2fa9-4117-a5d4-7eec3d2db6fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6478df589c1042669f0903915d81c103, user_id=6145fe0f63ef4ef28b657050bdae67f9, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:00.413350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db50af-2fa9-4117-a5d4-7eec3d2db6fe admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:00.424715 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1067/2122] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:00 2022] PUT /identity/v3/projects/6478df589c1042669f0903915d81c103/users/6145fe0f63ef4ef28b657050bdae67f9/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:00.425618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db50af-2fa9-4117-a5d4-7eec3d2db6fe admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:00.425844 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-de9dbb68-dbec-438e-9d4d-66548775868e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b33ed10ad1436684d1b2a32c99a27b', 'request_id': 'req-de9dbb68-dbec-438e-9d4d-66548775868e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:00.439911 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-de9dbb68-dbec-438e-9d4d-66548775868e admin admin] The token cache is being invalidate because project 42b33ed10ad1436684d1b2a32c99a27b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:36:00.443338 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-de9dbb68-dbec-438e-9d4d-66548775868e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:00.443338 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-de9dbb68-dbec-438e-9d4d-66548775868e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:00.443338 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1056/2123] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:36:00 2022] DELETE /identity/v3/projects/42b33ed10ad1436684d1b2a32c99a27b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:00.444999 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e12924-3ca6-414d-8b46-0ee171499b6f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:00.445463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e12924-3ca6-414d-8b46-0ee171499b6f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:00.445888 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e12924-3ca6-414d-8b46-0ee171499b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:00.476913 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-00e12924-3ca6-414d-8b46-0ee171499b6f None None] MFA Rules not processed for user `6145fe0f63ef4ef28b657050bdae67f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:00.478204 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-00e12924-3ca6-414d-8b46-0ee171499b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:00.511189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db50af-2fa9-4117-a5d4-7eec3d2db6fe admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:00.516016 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdca585-7cb7-4f8a-9064-7f9bb8101db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:00.516674 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdca585-7cb7-4f8a-9064-7f9bb8101db4 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:00.517625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdca585-7cb7-4f8a-9064-7f9bb8101db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:00.517898 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdca585-7cb7-4f8a-9064-7f9bb8101db4 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:00.518533 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdca585-7cb7-4f8a-9064-7f9bb8101db4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:00.520454 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdca585-7cb7-4f8a-9064-7f9bb8101db4 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:00.571885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1057/2124] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:00.573437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70919b13-60c4-4a6a-b3d0-1d62722f62c3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:00.573585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70919b13-60c4-4a6a-b3d0-1d62722f62c3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:00.573746 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70919b13-60c4-4a6a-b3d0-1d62722f62c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:00.597183 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-70919b13-60c4-4a6a-b3d0-1d62722f62c3 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:00.598627 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-70919b13-60c4-4a6a-b3d0-1d62722f62c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:00.607087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1058/2125] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:00.607859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70919b13-60c4-4a6a-b3d0-1d62722f62c3 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:00.609304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-70919b13-60c4-4a6a-b3d0-1d62722f62c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:00.628552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1068/2126] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:36:00 2022] POST /identity/v3/users => generated 300 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:00.635798 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4fc16-f55d-45ee-8a1d-beb0ff8aa84e None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:00.635798 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4fc16-f55d-45ee-8a1d-beb0ff8aa84e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:00.635798 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4fc16-f55d-45ee-8a1d-beb0ff8aa84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:00.651461 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-f8e4fc16-f55d-45ee-8a1d-beb0ff8aa84e None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:00.652867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f8e4fc16-f55d-45ee-8a1d-beb0ff8aa84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:00.661681 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1069/2127] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:00.662399 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4fc16-f55d-45ee-8a1d-beb0ff8aa84e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:00.663650 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f8e4fc16-f55d-45ee-8a1d-beb0ff8aa84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:00.671788 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70919b13-60c4-4a6a-b3d0-1d62722f62c3 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:00.676357 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4fc16-f55d-45ee-8a1d-beb0ff8aa84e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:00.676769 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6264aa6-1030-480e-9df4-5c05eff95dec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:00.677425 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6264aa6-1030-480e-9df4-5c05eff95dec service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:00.677711 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6264aa6-1030-480e-9df4-5c05eff95dec service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:00.677985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6264aa6-1030-480e-9df4-5c05eff95dec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:00.679712 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a6264aa6-1030-480e-9df4-5c05eff95dec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:00.681743 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c901d6-93e3-41fa-88cc-89b5c7d80160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:00.682336 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c901d6-93e3-41fa-88cc-89b5c7d80160 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:00.682613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c901d6-93e3-41fa-88cc-89b5c7d80160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:00.682894 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c901d6-93e3-41fa-88cc-89b5c7d80160 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:00.683520 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c901d6-93e3-41fa-88cc-89b5c7d80160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:00.685416 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c901d6-93e3-41fa-88cc-89b5c7d80160 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:00.698066 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1070/2128] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:00.698943 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c901d6-93e3-41fa-88cc-89b5c7d80160 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:00.711089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c901d6-93e3-41fa-88cc-89b5c7d80160 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:00.716029 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb390e6-dec5-4e15-a216-03725d192d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:00.716679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb390e6-dec5-4e15-a216-03725d192d7a admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:00.716952 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb390e6-dec5-4e15-a216-03725d192d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:00.717265 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb390e6-dec5-4e15-a216-03725d192d7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:00.717956 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb390e6-dec5-4e15-a216-03725d192d7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:36:00.718259 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb390e6-dec5-4e15-a216-03725d192d7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:00.719948 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb390e6-dec5-4e15-a216-03725d192d7a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:00.734174 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1071/2129] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:36:00.735155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb390e6-dec5-4e15-a216-03725d192d7a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:00.746099 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6264aa6-1030-480e-9df4-5c05eff95dec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:00.746285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb390e6-dec5-4e15-a216-03725d192d7a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:00.747857 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6264aa6-1030-480e-9df4-5c05eff95dec service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:00.752329 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74def9-0eea-4102-b536-4b01f039e3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:00.753167 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74def9-0eea-4102-b536-4b01f039e3de admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:00.753540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74def9-0eea-4102-b536-4b01f039e3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:00.753890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74def9-0eea-4102-b536-4b01f039e3de admin admin] PATH_INFO: `/v3/projects/9caf4fa84ec14033be394c3c7207e1ec/users/6bac2f32884a460dbe6434eb22565789/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:00.759720 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1059/2130] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:00.765852 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6264aa6-1030-480e-9df4-5c05eff95dec service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:00.778859 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74def9-0eea-4102-b536-4b01f039e3de admin admin] RBAC: Authorizing `identity:create_grant(project_id=9caf4fa84ec14033be394c3c7207e1ec, user_id=6bac2f32884a460dbe6434eb22565789, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:00.781777 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74def9-0eea-4102-b536-4b01f039e3de admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:00.786896 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6264aa6-1030-480e-9df4-5c05eff95dec service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:00.792158 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3e443-1abd-4b71-81c5-710d9c71ef98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:00.792824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3e443-1abd-4b71-81c5-710d9c71ef98 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:00.794260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3e443-1abd-4b71-81c5-710d9c71ef98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:00.794260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3e443-1abd-4b71-81c5-710d9c71ef98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:00.794260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3e443-1abd-4b71-81c5-710d9c71ef98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:00.796060 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3e443-1abd-4b71-81c5-710d9c71ef98 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:00.923214 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1072/2131] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:00 2022] PUT /identity/v3/projects/9caf4fa84ec14033be394c3c7207e1ec/users/6bac2f32884a460dbe6434eb22565789/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:00.927543 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74def9-0eea-4102-b536-4b01f039e3de admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:00.947381 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1060/2132] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:36:00 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:00.951680 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3e443-1abd-4b71-81c5-710d9c71ef98 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:01.012711 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74def9-0eea-4102-b536-4b01f039e3de admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:01.056012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3e443-1abd-4b71-81c5-710d9c71ef98 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:01.056012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fbd25-98ac-4dd9-abfd-ca3f4f63ed48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:01.056012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fbd25-98ac-4dd9-abfd-ca3f4f63ed48 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:01.056012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fbd25-98ac-4dd9-abfd-ca3f4f63ed48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:01.056392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fbd25-98ac-4dd9-abfd-ca3f4f63ed48 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:01.056392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fbd25-98ac-4dd9-abfd-ca3f4f63ed48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:01.056392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fbd25-98ac-4dd9-abfd-ca3f4f63ed48 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:01.087475 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69f074-05be-492a-be43-99e02f66e5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:01.088219 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69f074-05be-492a-be43-99e02f66e5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:01.088556 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69f074-05be-492a-be43-99e02f66e5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:01.088946 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69f074-05be-492a-be43-99e02f66e5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:01.089679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69f074-05be-492a-be43-99e02f66e5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:01.091403 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f69f074-05be-492a-be43-99e02f66e5b1 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:01.102651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1073/2133] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:36:01.106741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69f074-05be-492a-be43-99e02f66e5b1 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:01.119474 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69f074-05be-492a-be43-99e02f66e5b1 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:01.125436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14fa9d-e67c-43ff-b60a-79d1a0a4af8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:01.127947 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14fa9d-e67c-43ff-b60a-79d1a0a4af8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:01.127947 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14fa9d-e67c-43ff-b60a-79d1a0a4af8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:01.127947 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14fa9d-e67c-43ff-b60a-79d1a0a4af8b admin admin] PATH_INFO: `/v3/projects/9caf4fa84ec14033be394c3c7207e1ec/users/6bac2f32884a460dbe6434eb22565789/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:01.130179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14fa9d-e67c-43ff-b60a-79d1a0a4af8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9caf4fa84ec14033be394c3c7207e1ec, user_id=6bac2f32884a460dbe6434eb22565789, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:01.132851 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14fa9d-e67c-43ff-b60a-79d1a0a4af8b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:01.143686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1074/2134] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:01 2022] PUT /identity/v3/projects/9caf4fa84ec14033be394c3c7207e1ec/users/6bac2f32884a460dbe6434eb22565789/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:36:01.156726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1061/2135] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:36:00 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:01.158488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14fa9d-e67c-43ff-b60a-79d1a0a4af8b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:01.167844 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3eb518-b630-4574-856a-346fe43ff8d8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:01.168213 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3eb518-b630-4574-856a-346fe43ff8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:01.168838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3eb518-b630-4574-856a-346fe43ff8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:01.238399 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-da3eb518-b630-4574-856a-346fe43ff8d8 None None] MFA Rules not processed for user `6bac2f32884a460dbe6434eb22565789`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:01.239689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-da3eb518-b630-4574-856a-346fe43ff8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:01.247292 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14fa9d-e67c-43ff-b60a-79d1a0a4af8b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:01.268357 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced63db-ba2b-4d09-91b7-43ee9ab6441f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:01.268987 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced63db-ba2b-4d09-91b7-43ee9ab6441f admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:01.269313 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced63db-ba2b-4d09-91b7-43ee9ab6441f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:01.269600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced63db-ba2b-4d09-91b7-43ee9ab6441f admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:01.270285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced63db-ba2b-4d09-91b7-43ee9ab6441f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:01.271908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced63db-ba2b-4d09-91b7-43ee9ab6441f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:01.283227 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1075/2136] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:01.287278 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced63db-ba2b-4d09-91b7-43ee9ab6441f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:01.297918 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced63db-ba2b-4d09-91b7-43ee9ab6441f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:01.304076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd984705-121f-40b7-bcbe-4cf12d8672ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:01.304897 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd984705-121f-40b7-bcbe-4cf12d8672ad admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:01.305487 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd984705-121f-40b7-bcbe-4cf12d8672ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:01.305924 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd984705-121f-40b7-bcbe-4cf12d8672ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:01.306764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd984705-121f-40b7-bcbe-4cf12d8672ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:01.308564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd984705-121f-40b7-bcbe-4cf12d8672ad admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:01.319933 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1076/2137] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:36:01.324093 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd984705-121f-40b7-bcbe-4cf12d8672ad admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:01.331815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1062/2138] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:01.337349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd984705-121f-40b7-bcbe-4cf12d8672ad admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:01.342669 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375ca9a-d244-4d99-9b54-c0ce16d1a82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:01.342893 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3eb518-b630-4574-856a-346fe43ff8d8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:01.343322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375ca9a-d244-4d99-9b54-c0ce16d1a82d admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:01.343595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375ca9a-d244-4d99-9b54-c0ce16d1a82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:01.343865 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375ca9a-d244-4d99-9b54-c0ce16d1a82d admin admin] PATH_INFO: `/v3/projects/6feb80950dac46d4b47154315038611a/users/069a583d63464c0594ea51d5d3828244/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:01.364741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375ca9a-d244-4d99-9b54-c0ce16d1a82d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6feb80950dac46d4b47154315038611a, user_id=069a583d63464c0594ea51d5d3828244, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:01.368381 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375ca9a-d244-4d99-9b54-c0ce16d1a82d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:01.405496 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3eb518-b630-4574-856a-346fe43ff8d8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:01.410305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125302f-04fe-41fb-b549-2fc7d2022c31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:01.410976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125302f-04fe-41fb-b549-2fc7d2022c31 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:01.411260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125302f-04fe-41fb-b549-2fc7d2022c31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:01.411532 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125302f-04fe-41fb-b549-2fc7d2022c31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:01.420769 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125302f-04fe-41fb-b549-2fc7d2022c31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:01.422232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125302f-04fe-41fb-b549-2fc7d2022c31 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:01.432215 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1063/2139] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:01 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:36:01.473545 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1077/2140] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:01 2022] PUT /identity/v3/projects/6feb80950dac46d4b47154315038611a/users/069a583d63464c0594ea51d5d3828244/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:01.483810 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf040d-2502-4d90-a0cb-fdd7de0cd44a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:01.484272 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf040d-2502-4d90-a0cb-fdd7de0cd44a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:01.484667 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf040d-2502-4d90-a0cb-fdd7de0cd44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:01.512883 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b7cf040d-2502-4d90-a0cb-fdd7de0cd44a None None] MFA Rules not processed for user `069a583d63464c0594ea51d5d3828244`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:01.514116 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b7cf040d-2502-4d90-a0cb-fdd7de0cd44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:01.600810 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1064/2141] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:01.613939 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375ca9a-d244-4d99-9b54-c0ce16d1a82d admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:01.616182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9375ca9a-d244-4d99-9b54-c0ce16d1a82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:01.728181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375ca9a-d244-4d99-9b54-c0ce16d1a82d admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:01.735301 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b8a4e-ac67-4183-86b3-e6d02ee29b12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:01.736037 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b8a4e-ac67-4183-86b3-e6d02ee29b12 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:01.736439 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b8a4e-ac67-4183-86b3-e6d02ee29b12 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:01.736738 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b8a4e-ac67-4183-86b3-e6d02ee29b12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:01.746440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b8a4e-ac67-4183-86b3-e6d02ee29b12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:01.748232 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b8a4e-ac67-4183-86b3-e6d02ee29b12 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:01.760232 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1078/2142] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:02.031920 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf040d-2502-4d90-a0cb-fdd7de0cd44a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:02.119634 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf040d-2502-4d90-a0cb-fdd7de0cd44a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:02.131047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f90b1a-4dd0-427d-96c1-703301d2b5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:02.131840 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f90b1a-4dd0-427d-96c1-703301d2b5ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:02.132126 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f90b1a-4dd0-427d-96c1-703301d2b5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:02.132393 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f90b1a-4dd0-427d-96c1-703301d2b5ce admin admin] PATH_INFO: `/v3/users/069a583d63464c0594ea51d5d3828244` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:02.133581 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f90b1a-4dd0-427d-96c1-703301d2b5ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=069a583d63464c0594ea51d5d3828244)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:02.135547 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f90b1a-4dd0-427d-96c1-703301d2b5ce admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:02.349668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b3f90b1a-4dd0-427d-96c1-703301d2b5ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '069a583d63464c0594ea51d5d3828244'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:02.350312 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b3f90b1a-4dd0-427d-96c1-703301d2b5ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '069a583d63464c0594ea51d5d3828244'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:02.421665 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b3f90b1a-4dd0-427d-96c1-703301d2b5ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '069a583d63464c0594ea51d5d3828244'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:02.435614 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b3f90b1a-4dd0-427d-96c1-703301d2b5ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '069a583d63464c0594ea51d5d3828244'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:02.436309 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b3f90b1a-4dd0-427d-96c1-703301d2b5ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '069a583d63464c0594ea51d5d3828244'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:02.456214 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1065/2143] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:36:02 2022] DELETE /identity/v3/users/069a583d63464c0594ea51d5d3828244 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:02.464932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1700aa-373a-4cc2-b265-91662029cb5d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:02.464932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1700aa-373a-4cc2-b265-91662029cb5d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:02.464932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1700aa-373a-4cc2-b265-91662029cb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:02.489661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-9b1700aa-373a-4cc2-b265-91662029cb5d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:02.491511 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9b1700aa-373a-4cc2-b265-91662029cb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:02.603117 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1079/2144] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:02.616938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f90b1a-4dd0-427d-96c1-703301d2b5ce admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:02.618528 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b3f90b1a-4dd0-427d-96c1-703301d2b5ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:02.622132 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1700aa-373a-4cc2-b265-91662029cb5d None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:02.624017 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9b1700aa-373a-4cc2-b265-91662029cb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:02.676490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:02.697985 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1700aa-373a-4cc2-b265-91662029cb5d None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:02.698424 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f90b1a-4dd0-427d-96c1-703301d2b5ce admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:02.701732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7e391-81b6-41b5-93a6-8e0688f4b107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:02.702354 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7e391-81b6-41b5-93a6-8e0688f4b107 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:02.702641 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7e391-81b6-41b5-93a6-8e0688f4b107 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:02.702749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0d3ed-cb04-4323-beb8-27c68c5d1115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:02.702893 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7e391-81b6-41b5-93a6-8e0688f4b107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:02.703327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0d3ed-cb04-4323-beb8-27c68c5d1115 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:02.703607 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0d3ed-cb04-4323-beb8-27c68c5d1115 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:02.703885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0d3ed-cb04-4323-beb8-27c68c5d1115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:02.704862 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-59f7e391-81b6-41b5-93a6-8e0688f4b107 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:02.714086 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0d3ed-cb04-4323-beb8-27c68c5d1115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:02.715601 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0d3ed-cb04-4323-beb8-27c68c5d1115 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:02.726173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:02.727847 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1066/2145] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:36:02.772078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7e391-81b6-41b5-93a6-8e0688f4b107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:02.773666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7e391-81b6-41b5-93a6-8e0688f4b107 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:02.783686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1080/2146] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:03.212127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0d3ed-cb04-4323-beb8-27c68c5d1115 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:03.214142 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-76c0d3ed-cb04-4323-beb8-27c68c5d1115 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:03.240797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0d3ed-cb04-4323-beb8-27c68c5d1115 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:03.249583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27b1da-d508-4464-b5fb-4e9a59c00a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:03.250779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27b1da-d508-4464-b5fb-4e9a59c00a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:03.251857 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27b1da-d508-4464-b5fb-4e9a59c00a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:03.252755 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27b1da-d508-4464-b5fb-4e9a59c00a2d admin admin] PATH_INFO: `/v3/projects/6feb80950dac46d4b47154315038611a` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:03.267769 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27b1da-d508-4464-b5fb-4e9a59c00a2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6feb80950dac46d4b47154315038611a)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:03.272776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27b1da-d508-4464-b5fb-4e9a59c00a2d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:03.460382 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-aa27b1da-d508-4464-b5fb-4e9a59c00a2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6feb80950dac46d4b47154315038611a', 'request_id': 'req-aa27b1da-d508-4464-b5fb-4e9a59c00a2d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:03.466753 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-aa27b1da-d508-4464-b5fb-4e9a59c00a2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6feb80950dac46d4b47154315038611a', 'request_id': 'req-aa27b1da-d508-4464-b5fb-4e9a59c00a2d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:03.528438 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-aa27b1da-d508-4464-b5fb-4e9a59c00a2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6feb80950dac46d4b47154315038611a', 'request_id': 'req-aa27b1da-d508-4464-b5fb-4e9a59c00a2d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:03.545361 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-aa27b1da-d508-4464-b5fb-4e9a59c00a2d admin admin] The token cache is being invalidate because project 6feb80950dac46d4b47154315038611a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:36:03.545538 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-aa27b1da-d508-4464-b5fb-4e9a59c00a2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:03.546282 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-aa27b1da-d508-4464-b5fb-4e9a59c00a2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:03.551965 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1067/2147] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:36:03 2022] DELETE /identity/v3/projects/6feb80950dac46d4b47154315038611a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:03.553654 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c1076-2d59-46b1-bfca-8f55abb15383 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:03.554198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c1076-2d59-46b1-bfca-8f55abb15383 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:03.554468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c1076-2d59-46b1-bfca-8f55abb15383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:03.579864 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-9e1c1076-2d59-46b1-bfca-8f55abb15383 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:03.579864 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9e1c1076-2d59-46b1-bfca-8f55abb15383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:03.643008 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1081/2148] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:03.651926 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b282d5e-7ea3-44c0-aa03-7b4a9ff1c156 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:03.652260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b282d5e-7ea3-44c0-aa03-7b4a9ff1c156 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:03.652571 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b282d5e-7ea3-44c0-aa03-7b4a9ff1c156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:03.679876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-0b282d5e-7ea3-44c0-aa03-7b4a9ff1c156 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:03.681135 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0b282d5e-7ea3-44c0-aa03-7b4a9ff1c156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:03.689554 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1068/2149] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:03.693941 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c1076-2d59-46b1-bfca-8f55abb15383 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:03.705721 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c1076-2d59-46b1-bfca-8f55abb15383 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:03.711715 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d25d71-00a3-4e2c-a4f0-c065bf3d8e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:03.711715 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d25d71-00a3-4e2c-a4f0-c065bf3d8e78 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:03.711715 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d25d71-00a3-4e2c-a4f0-c065bf3d8e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:03.711977 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d25d71-00a3-4e2c-a4f0-c065bf3d8e78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:03.712576 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d25d71-00a3-4e2c-a4f0-c065bf3d8e78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:36:03.712886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d25d71-00a3-4e2c-a4f0-c065bf3d8e78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:03.714535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d25d71-00a3-4e2c-a4f0-c065bf3d8e78 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:03.728512 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1082/2150] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:36:03.743413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b282d5e-7ea3-44c0-aa03-7b4a9ff1c156 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:03.753502 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b282d5e-7ea3-44c0-aa03-7b4a9ff1c156 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:03.765544 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f2ca6-0c36-4f07-8e6b-5cdd41d4d4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:03.765544 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f2ca6-0c36-4f07-8e6b-5cdd41d4d4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:03.765544 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f2ca6-0c36-4f07-8e6b-5cdd41d4d4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:03.765544 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f2ca6-0c36-4f07-8e6b-5cdd41d4d4c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:03.766038 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f2ca6-0c36-4f07-8e6b-5cdd41d4d4c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:03.766038 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f2ca6-0c36-4f07-8e6b-5cdd41d4d4c8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:03.895826 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1069/2151] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:36:03 2022] POST /identity/v3/projects => generated 363 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:03.897224 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d25d71-00a3-4e2c-a4f0-c065bf3d8e78 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:03.908993 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d25d71-00a3-4e2c-a4f0-c065bf3d8e78 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:03.968641 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe42935-ef2f-4ae8-a262-dd3965c9563e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:03.969306 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe42935-ef2f-4ae8-a262-dd3965c9563e admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:03.970514 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe42935-ef2f-4ae8-a262-dd3965c9563e admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:03.970514 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe42935-ef2f-4ae8-a262-dd3965c9563e admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:03.971127 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe42935-ef2f-4ae8-a262-dd3965c9563e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:03.973039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe42935-ef2f-4ae8-a262-dd3965c9563e admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:04.050753 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:04.056786 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1083/2152] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:36:03 2022] POST /identity/v3/users => generated 282 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:04.061337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f2ca6-0c36-4f07-8e6b-5cdd41d4d4c8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:04.072197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f2ca6-0c36-4f07-8e6b-5cdd41d4d4c8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:04.077215 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfec23c-4219-4597-9ac1-20cf029cae77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:04.077822 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfec23c-4219-4597-9ac1-20cf029cae77 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:04.078100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfec23c-4219-4597-9ac1-20cf029cae77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:04.078547 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfec23c-4219-4597-9ac1-20cf029cae77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:04.079919 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfec23c-4219-4597-9ac1-20cf029cae77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:04.081549 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfec23c-4219-4597-9ac1-20cf029cae77 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:04.091818 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1070/2153] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:04.096472 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe42935-ef2f-4ae8-a262-dd3965c9563e admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:04.106635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe42935-ef2f-4ae8-a262-dd3965c9563e admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:04.111513 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c423cb-1256-45d6-a70f-5d306d60bf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:04.112107 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c423cb-1256-45d6-a70f-5d306d60bf5f admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:04.112383 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c423cb-1256-45d6-a70f-5d306d60bf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:04.112654 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c423cb-1256-45d6-a70f-5d306d60bf5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:04.113318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c423cb-1256-45d6-a70f-5d306d60bf5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:04.114929 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c423cb-1256-45d6-a70f-5d306d60bf5f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:04.125082 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1084/2154] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:04.130064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfec23c-4219-4597-9ac1-20cf029cae77 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:04.140088 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfec23c-4219-4597-9ac1-20cf029cae77 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:04.145763 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46534214-7e15-452e-8b4f-fba18c60d930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:04.146574 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46534214-7e15-452e-8b4f-fba18c60d930 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:04.146921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46534214-7e15-452e-8b4f-fba18c60d930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:04.147263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46534214-7e15-452e-8b4f-fba18c60d930 admin admin] PATH_INFO: `/v3/projects/399f67c571b34d79a6a60941caa480b6/users/bfff0629992c4aa4a3e6eaa4f2388ae5/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:04.165050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46534214-7e15-452e-8b4f-fba18c60d930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=399f67c571b34d79a6a60941caa480b6, user_id=bfff0629992c4aa4a3e6eaa4f2388ae5, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:04.165592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:04.168313 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46534214-7e15-452e-8b4f-fba18c60d930 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:04.243419 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1071/2155] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:04 2022] PUT /identity/v3/projects/399f67c571b34d79a6a60941caa480b6/users/bfff0629992c4aa4a3e6eaa4f2388ae5/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:04.252986 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea667e-d146-41b5-8239-82b85d99f083 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:04.253306 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea667e-d146-41b5-8239-82b85d99f083 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:04.253582 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea667e-d146-41b5-8239-82b85d99f083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:04.286601 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-4fea667e-d146-41b5-8239-82b85d99f083 None None] MFA Rules not processed for user `bfff0629992c4aa4a3e6eaa4f2388ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:04.287925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4fea667e-d146-41b5-8239-82b85d99f083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:04.384162 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1085/2156] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:04.388241 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46534214-7e15-452e-8b4f-fba18c60d930 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:04.453666 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46534214-7e15-452e-8b4f-fba18c60d930 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:04.459732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0025c40-699f-48be-ac3b-f6e4d48f79c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:04.460456 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0025c40-699f-48be-ac3b-f6e4d48f79c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:04.461027 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0025c40-699f-48be-ac3b-f6e4d48f79c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:04.461027 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0025c40-699f-48be-ac3b-f6e4d48f79c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:04.461696 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0025c40-699f-48be-ac3b-f6e4d48f79c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:04.463602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0025c40-699f-48be-ac3b-f6e4d48f79c7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:04.566529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1072/2157] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:36:04 2022] POST /identity/v3/projects => generated 365 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:04.566630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea667e-d146-41b5-8239-82b85d99f083 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:04.576151 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea667e-d146-41b5-8239-82b85d99f083 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:04.637685 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103abf8-30ff-4208-9f7b-09a8ede801f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:04.638857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103abf8-30ff-4208-9f7b-09a8ede801f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:04.639433 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103abf8-30ff-4208-9f7b-09a8ede801f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:04.639859 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103abf8-30ff-4208-9f7b-09a8ede801f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:04.640925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103abf8-30ff-4208-9f7b-09a8ede801f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:04.642813 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103abf8-30ff-4208-9f7b-09a8ede801f8 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:04.776676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1086/2158] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:36:04 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:04.780744 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0025c40-699f-48be-ac3b-f6e4d48f79c7 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:04.791714 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0025c40-699f-48be-ac3b-f6e4d48f79c7 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:04.796396 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772eb9b-f7d3-4157-b000-0b0332bcec2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:04.797026 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772eb9b-f7d3-4157-b000-0b0332bcec2d admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:04.797353 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772eb9b-f7d3-4157-b000-0b0332bcec2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:04.797742 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772eb9b-f7d3-4157-b000-0b0332bcec2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:04.799582 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772eb9b-f7d3-4157-b000-0b0332bcec2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:04.801903 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772eb9b-f7d3-4157-b000-0b0332bcec2d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:04.813798 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1073/2159] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:04.824092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103abf8-30ff-4208-9f7b-09a8ede801f8 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:04.835197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103abf8-30ff-4208-9f7b-09a8ede801f8 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:04.839943 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54c613-3bfa-45d4-94de-e84d88d15ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:04.840597 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54c613-3bfa-45d4-94de-e84d88d15ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:04.840876 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54c613-3bfa-45d4-94de-e84d88d15ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:04.841189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54c613-3bfa-45d4-94de-e84d88d15ca5 admin admin] PATH_INFO: `/v3/projects/7e242051a1f7448aa3890b5e5c86e633/users/6e044608fd0948049afd3d4eab7114fc/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:04.857304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54c613-3bfa-45d4-94de-e84d88d15ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e242051a1f7448aa3890b5e5c86e633, user_id=6e044608fd0948049afd3d4eab7114fc, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:04.860065 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54c613-3bfa-45d4-94de-e84d88d15ca5 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:05.026838 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1087/2160] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:04 2022] PUT /identity/v3/projects/7e242051a1f7448aa3890b5e5c86e633/users/6e044608fd0948049afd3d4eab7114fc/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:05.030741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772eb9b-f7d3-4157-b000-0b0332bcec2d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:05.041235 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772eb9b-f7d3-4157-b000-0b0332bcec2d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:05.107849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b700b-cd1b-4691-a1c1-1ca896a92cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:05.108464 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b700b-cd1b-4691-a1c1-1ca896a92cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:05.108853 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b700b-cd1b-4691-a1c1-1ca896a92cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:05.109008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b700b-cd1b-4691-a1c1-1ca896a92cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:05.109683 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b700b-cd1b-4691-a1c1-1ca896a92cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:05.111896 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b700b-cd1b-4691-a1c1-1ca896a92cf6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:05.122079 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1074/2161] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:05.126881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54c613-3bfa-45d4-94de-e84d88d15ca5 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:05.137393 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54c613-3bfa-45d4-94de-e84d88d15ca5 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:05.143076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b6b31-adfe-415c-b039-b09411b9f10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:05.144104 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b6b31-adfe-415c-b039-b09411b9f10b admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:05.144382 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b6b31-adfe-415c-b039-b09411b9f10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:05.144649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b6b31-adfe-415c-b039-b09411b9f10b admin admin] PATH_INFO: `/v3/projects/7e242051a1f7448aa3890b5e5c86e633/users/6e044608fd0948049afd3d4eab7114fc/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:05.146611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b6b31-adfe-415c-b039-b09411b9f10b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e242051a1f7448aa3890b5e5c86e633, user_id=6e044608fd0948049afd3d4eab7114fc, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:05.149317 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b6b31-adfe-415c-b039-b09411b9f10b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:05.169376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1088/2162] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:05 2022] PUT /identity/v3/projects/7e242051a1f7448aa3890b5e5c86e633/users/6e044608fd0948049afd3d4eab7114fc/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:05.175150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6164-6077-4284-b871-d1bdebd531a9 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:05.175449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6164-6077-4284-b871-d1bdebd531a9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:05.175904 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf6164-6077-4284-b871-d1bdebd531a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:05.216127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2cbf6164-6077-4284-b871-d1bdebd531a9 None None] MFA Rules not processed for user `6e044608fd0948049afd3d4eab7114fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:05.217497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2cbf6164-6077-4284-b871-d1bdebd531a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:05.327021 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1075/2163] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:05.776091 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:05.867331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:05.930012 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b6b31-adfe-415c-b039-b09411b9f10b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:05.931658 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b80b6b31-adfe-415c-b039-b09411b9f10b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:05.995043 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b6b31-adfe-415c-b039-b09411b9f10b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:05.998683 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c877581-644e-4aca-a8dd-281be0a74b97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:05.999292 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c877581-644e-4aca-a8dd-281be0a74b97 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:05.999602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c877581-644e-4aca-a8dd-281be0a74b97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:05.999835 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c877581-644e-4aca-a8dd-281be0a74b97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:06.013643 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c877581-644e-4aca-a8dd-281be0a74b97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:06.015294 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c877581-644e-4aca-a8dd-281be0a74b97 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:06.032957 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1089/2164] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:06.675015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf6164-6077-4284-b871-d1bdebd531a9 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:06.676748 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2cbf6164-6077-4284-b871-d1bdebd531a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:06.711992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf6164-6077-4284-b871-d1bdebd531a9 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:06.721530 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64992c47-a1d3-4d96-b43e-d6ca7b6fadbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:06.723111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64992c47-a1d3-4d96-b43e-d6ca7b6fadbd service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:06.723717 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64992c47-a1d3-4d96-b43e-d6ca7b6fadbd service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:06.724168 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64992c47-a1d3-4d96-b43e-d6ca7b6fadbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:06.809163 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64992c47-a1d3-4d96-b43e-d6ca7b6fadbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:06.810844 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64992c47-a1d3-4d96-b43e-d6ca7b6fadbd service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:06.822462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1076/2165] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:07.031213 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c877581-644e-4aca-a8dd-281be0a74b97 service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:07.042140 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c877581-644e-4aca-a8dd-281be0a74b97 service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:07.046195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b89f15-6f67-49bb-9d82-4155ed1f05a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:07.047009 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b89f15-6f67-49bb-9d82-4155ed1f05a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:07.047203 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b89f15-6f67-49bb-9d82-4155ed1f05a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:07.047507 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b89f15-6f67-49bb-9d82-4155ed1f05a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:07.050128 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c9b89f15-6f67-49bb-9d82-4155ed1f05a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:07.126405 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b89f15-6f67-49bb-9d82-4155ed1f05a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:07.128678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b89f15-6f67-49bb-9d82-4155ed1f05a3 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:07.140334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1090/2166] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:07.616084 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:08.203004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:08.521934 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64992c47-a1d3-4d96-b43e-d6ca7b6fadbd service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:08.531614 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64992c47-a1d3-4d96-b43e-d6ca7b6fadbd service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:08.535848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305b652-12ec-4979-8bd0-b30ad8d80bdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:08.536454 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305b652-12ec-4979-8bd0-b30ad8d80bdb service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:08.536733 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305b652-12ec-4979-8bd0-b30ad8d80bdb service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:08.537004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305b652-12ec-4979-8bd0-b30ad8d80bdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:08.538784 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7305b652-12ec-4979-8bd0-b30ad8d80bdb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:08.608952 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305b652-12ec-4979-8bd0-b30ad8d80bdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:08.611199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305b652-12ec-4979-8bd0-b30ad8d80bdb service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:08.622418 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1077/2167] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:09.622919 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b89f15-6f67-49bb-9d82-4155ed1f05a3 service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:09.622919 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b89f15-6f67-49bb-9d82-4155ed1f05a3 service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:09.628778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4da74-28cc-4ff4-a40e-d2dae9ae49e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:09.629597 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4da74-28cc-4ff4-a40e-d2dae9ae49e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:09.629977 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4da74-28cc-4ff4-a40e-d2dae9ae49e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:09.630381 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4da74-28cc-4ff4-a40e-d2dae9ae49e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:09.632271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ebf4da74-28cc-4ff4-a40e-d2dae9ae49e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:09.705117 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4da74-28cc-4ff4-a40e-d2dae9ae49e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:09.706858 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4da74-28cc-4ff4-a40e-d2dae9ae49e0 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:09.718235 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1091/2168] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:09.727162 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:10.404299 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:11.217952 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305b652-12ec-4979-8bd0-b30ad8d80bdb service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:11.289351 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305b652-12ec-4979-8bd0-b30ad8d80bdb service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:11.294283 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3c81e-1170-4ee9-b111-0663a52cf58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:11.294921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3c81e-1170-4ee9-b111-0663a52cf58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:11.295205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3c81e-1170-4ee9-b111-0663a52cf58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:11.295482 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3c81e-1170-4ee9-b111-0663a52cf58b admin admin] PATH_INFO: `/v3/users/bfff0629992c4aa4a3e6eaa4f2388ae5` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:11.296643 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3c81e-1170-4ee9-b111-0663a52cf58b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfff0629992c4aa4a3e6eaa4f2388ae5)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:11.298818 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3c81e-1170-4ee9-b111-0663a52cf58b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:11.577937 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f3c3c81e-1170-4ee9-b111-0663a52cf58b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfff0629992c4aa4a3e6eaa4f2388ae5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:11.579338 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f3c3c81e-1170-4ee9-b111-0663a52cf58b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfff0629992c4aa4a3e6eaa4f2388ae5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:11.639669 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f3c3c81e-1170-4ee9-b111-0663a52cf58b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfff0629992c4aa4a3e6eaa4f2388ae5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:11.654283 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f3c3c81e-1170-4ee9-b111-0663a52cf58b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfff0629992c4aa4a3e6eaa4f2388ae5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:11.655017 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f3c3c81e-1170-4ee9-b111-0663a52cf58b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfff0629992c4aa4a3e6eaa4f2388ae5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:11.675827 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1078/2169] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:36:11 2022] DELETE /identity/v3/users/bfff0629992c4aa4a3e6eaa4f2388ae5 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:11.676502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f13b5-6ed3-448e-8c07-52524c0d96bc None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:11.676972 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f13b5-6ed3-448e-8c07-52524c0d96bc None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:11.677119 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f13b5-6ed3-448e-8c07-52524c0d96bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:11.715862 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c62f13b5-6ed3-448e-8c07-52524c0d96bc None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:11.718651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c62f13b5-6ed3-448e-8c07-52524c0d96bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:11.799660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1092/2170] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:11.810024 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3c81e-1170-4ee9-b111-0663a52cf58b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:11.811497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f3c3c81e-1170-4ee9-b111-0663a52cf58b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:11.884996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3c81e-1170-4ee9-b111-0663a52cf58b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:11.888969 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec0ec6-212d-4d56-806c-8e011c6dd27b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:11.889610 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec0ec6-212d-4d56-806c-8e011c6dd27b service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:11.889890 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec0ec6-212d-4d56-806c-8e011c6dd27b service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:11.890373 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec0ec6-212d-4d56-806c-8e011c6dd27b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:11.900749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec0ec6-212d-4d56-806c-8e011c6dd27b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:11.902275 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec0ec6-212d-4d56-806c-8e011c6dd27b service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:11.913478 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1079/2171] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:11.959234 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:12.450030 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f13b5-6ed3-448e-8c07-52524c0d96bc None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:12.451560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c62f13b5-6ed3-448e-8c07-52524c0d96bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:12.464537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f13b5-6ed3-448e-8c07-52524c0d96bc None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:12.469923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d76e9-527d-4906-88de-caf7f4ff5e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:12.470648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d76e9-527d-4906-88de-caf7f4ff5e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:12.470999 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d76e9-527d-4906-88de-caf7f4ff5e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:12.471530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d76e9-527d-4906-88de-caf7f4ff5e94 admin admin] PATH_INFO: `/v3/projects/399f67c571b34d79a6a60941caa480b6` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:12.472795 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d76e9-527d-4906-88de-caf7f4ff5e94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=399f67c571b34d79a6a60941caa480b6)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:12.474859 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d76e9-527d-4906-88de-caf7f4ff5e94 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:12.621672 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0d0d76e9-527d-4906-88de-caf7f4ff5e94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '399f67c571b34d79a6a60941caa480b6', 'request_id': 'req-0d0d76e9-527d-4906-88de-caf7f4ff5e94'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:12.628311 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0d0d76e9-527d-4906-88de-caf7f4ff5e94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '399f67c571b34d79a6a60941caa480b6', 'request_id': 'req-0d0d76e9-527d-4906-88de-caf7f4ff5e94'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:12.675157 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:12.849300 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0d0d76e9-527d-4906-88de-caf7f4ff5e94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '399f67c571b34d79a6a60941caa480b6', 'request_id': 'req-0d0d76e9-527d-4906-88de-caf7f4ff5e94'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:12.869401 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0d0d76e9-527d-4906-88de-caf7f4ff5e94 admin admin] The token cache is being invalidate because project 399f67c571b34d79a6a60941caa480b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:36:12.869695 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0d0d76e9-527d-4906-88de-caf7f4ff5e94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:12.870546 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0d0d76e9-527d-4906-88de-caf7f4ff5e94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:12.872240 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1093/2172] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:36:12 2022] DELETE /identity/v3/projects/399f67c571b34d79a6a60941caa480b6 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:12.877433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec0ec6-212d-4d56-806c-8e011c6dd27b service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:12.890825 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec0ec6-212d-4d56-806c-8e011c6dd27b service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:12.955628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910b018-63d3-4a17-9fcb-6f47fd6100a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:12.956262 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910b018-63d3-4a17-9fcb-6f47fd6100a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:12.956539 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910b018-63d3-4a17-9fcb-6f47fd6100a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:12.956811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910b018-63d3-4a17-9fcb-6f47fd6100a5 admin admin] PATH_INFO: `/v3/users/6e044608fd0948049afd3d4eab7114fc` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:12.957971 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910b018-63d3-4a17-9fcb-6f47fd6100a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e044608fd0948049afd3d4eab7114fc)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:12.959896 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910b018-63d3-4a17-9fcb-6f47fd6100a5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:13.221463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e910b018-63d3-4a17-9fcb-6f47fd6100a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e044608fd0948049afd3d4eab7114fc'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:13.222152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e910b018-63d3-4a17-9fcb-6f47fd6100a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e044608fd0948049afd3d4eab7114fc'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:13.319098 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e910b018-63d3-4a17-9fcb-6f47fd6100a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e044608fd0948049afd3d4eab7114fc'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:13.333622 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e910b018-63d3-4a17-9fcb-6f47fd6100a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e044608fd0948049afd3d4eab7114fc'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:13.334359 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e910b018-63d3-4a17-9fcb-6f47fd6100a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e044608fd0948049afd3d4eab7114fc'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:13.347162 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1080/2173] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:36:12 2022] DELETE /identity/v3/users/6e044608fd0948049afd3d4eab7114fc => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:13.839162 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d76e9-527d-4906-88de-caf7f4ff5e94 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:13.840974 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0d0d76e9-527d-4906-88de-caf7f4ff5e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:13.857467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d76e9-527d-4906-88de-caf7f4ff5e94 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:13.984507 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae4d7f-1cce-4775-8cd5-b8d412e733fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:13.985416 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae4d7f-1cce-4775-8cd5-b8d412e733fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:13.985699 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae4d7f-1cce-4775-8cd5-b8d412e733fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:13.985965 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae4d7f-1cce-4775-8cd5-b8d412e733fb admin admin] PATH_INFO: `/v3/projects/7e242051a1f7448aa3890b5e5c86e633` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:13.987284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae4d7f-1cce-4775-8cd5-b8d412e733fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e242051a1f7448aa3890b5e5c86e633)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:13.994552 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae4d7f-1cce-4775-8cd5-b8d412e733fb admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:14.171106 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b1ae4d7f-1cce-4775-8cd5-b8d412e733fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e242051a1f7448aa3890b5e5c86e633', 'request_id': 'req-b1ae4d7f-1cce-4775-8cd5-b8d412e733fb'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:14.177650 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b1ae4d7f-1cce-4775-8cd5-b8d412e733fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e242051a1f7448aa3890b5e5c86e633', 'request_id': 'req-b1ae4d7f-1cce-4775-8cd5-b8d412e733fb'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:14.356287 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b1ae4d7f-1cce-4775-8cd5-b8d412e733fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e242051a1f7448aa3890b5e5c86e633', 'request_id': 'req-b1ae4d7f-1cce-4775-8cd5-b8d412e733fb'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:14.369030 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b1ae4d7f-1cce-4775-8cd5-b8d412e733fb admin admin] The token cache is being invalidate because project 7e242051a1f7448aa3890b5e5c86e633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:36:14.369354 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b1ae4d7f-1cce-4775-8cd5-b8d412e733fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:14.370073 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b1ae4d7f-1cce-4775-8cd5-b8d412e733fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:14.371658 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1094/2174] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:36:13 2022] DELETE /identity/v3/projects/7e242051a1f7448aa3890b5e5c86e633 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:14.378333 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef2e65-1236-40dd-9b8d-79e4440575a1 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:14.378848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef2e65-1236-40dd-9b8d-79e4440575a1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:14.378848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef2e65-1236-40dd-9b8d-79e4440575a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:14.388279 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:14.400116 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-77ef2e65-1236-40dd-9b8d-79e4440575a1 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:14.401413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-77ef2e65-1236-40dd-9b8d-79e4440575a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:14.464681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1081/2175] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:14.473104 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17145399-6543-4b58-a449-1b21e3820fa1 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:14.473394 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17145399-6543-4b58-a449-1b21e3820fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:14.473673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17145399-6543-4b58-a449-1b21e3820fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:14.493786 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-17145399-6543-4b58-a449-1b21e3820fa1 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:14.494990 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-17145399-6543-4b58-a449-1b21e3820fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:14.502934 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1095/2176] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:14.507254 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef2e65-1236-40dd-9b8d-79e4440575a1 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:14.516764 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef2e65-1236-40dd-9b8d-79e4440575a1 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:14.521577 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14600ff-b9aa-4886-b901-5abf046bc0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:14.522822 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14600ff-b9aa-4886-b901-5abf046bc0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:14.522822 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14600ff-b9aa-4886-b901-5abf046bc0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:14.523082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14600ff-b9aa-4886-b901-5abf046bc0f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:14.523596 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14600ff-b9aa-4886-b901-5abf046bc0f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:36:14.523906 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14600ff-b9aa-4886-b901-5abf046bc0f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:14.525547 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14600ff-b9aa-4886-b901-5abf046bc0f1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:14.539154 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1082/2177] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:36:14.547119 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17145399-6543-4b58-a449-1b21e3820fa1 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:14.558168 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17145399-6543-4b58-a449-1b21e3820fa1 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:14.564525 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c3dac-b604-4a26-a01f-6b25f034ddbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:14.569524 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c3dac-b604-4a26-a01f-6b25f034ddbe admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:14.572406 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c3dac-b604-4a26-a01f-6b25f034ddbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:14.572406 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c3dac-b604-4a26-a01f-6b25f034ddbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:14.572406 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c3dac-b604-4a26-a01f-6b25f034ddbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:14.573387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c3dac-b604-4a26-a01f-6b25f034ddbe admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:14.622555 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14600ff-b9aa-4886-b901-5abf046bc0f1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:14.624301 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b14600ff-b9aa-4886-b901-5abf046bc0f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:14.639199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14600ff-b9aa-4886-b901-5abf046bc0f1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:14.644413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea602ba3-3b95-42c7-8a18-3d02e9e77a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:14.645387 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea602ba3-3b95-42c7-8a18-3d02e9e77a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:14.645751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea602ba3-3b95-42c7-8a18-3d02e9e77a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:14.646105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea602ba3-3b95-42c7-8a18-3d02e9e77a10 admin admin] PATH_INFO: `/v3/users/4e6c1cfc65d1456ab754f5c55889f251` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:14.647487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea602ba3-3b95-42c7-8a18-3d02e9e77a10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e6c1cfc65d1456ab754f5c55889f251)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:14.649648 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea602ba3-3b95-42c7-8a18-3d02e9e77a10 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:14.712421 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1096/2178] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:36:14 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:14.716582 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c3dac-b604-4a26-a01f-6b25f034ddbe admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:14.780186 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c3dac-b604-4a26-a01f-6b25f034ddbe admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:14.785984 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674724f-3852-4fd7-bb22-4247b9adae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:14.786681 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674724f-3852-4fd7-bb22-4247b9adae13 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:14.787364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674724f-3852-4fd7-bb22-4247b9adae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:14.787364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674724f-3852-4fd7-bb22-4247b9adae13 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:14.787852 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674724f-3852-4fd7-bb22-4247b9adae13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:14.789873 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674724f-3852-4fd7-bb22-4247b9adae13 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:14.862520 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1097/2179] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:36:14 2022] POST /identity/v3/users => generated 294 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:36:14.866696 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674724f-3852-4fd7-bb22-4247b9adae13 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:14.876696 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674724f-3852-4fd7-bb22-4247b9adae13 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:14.881411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f07b2-b07a-4d9e-83c4-260df4b0e5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:14.881991 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f07b2-b07a-4d9e-83c4-260df4b0e5ff admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:14.882270 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f07b2-b07a-4d9e-83c4-260df4b0e5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:14.882543 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f07b2-b07a-4d9e-83c4-260df4b0e5ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:14.883169 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f07b2-b07a-4d9e-83c4-260df4b0e5ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:14.884759 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f07b2-b07a-4d9e-83c4-260df4b0e5ff admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:14.895707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1098/2180] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:36:14.899691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f07b2-b07a-4d9e-83c4-260df4b0e5ff admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:14.922902 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f07b2-b07a-4d9e-83c4-260df4b0e5ff admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:14.922902 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402b0ad-ef59-41fa-993f-89d18e16dee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:14.922902 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402b0ad-ef59-41fa-993f-89d18e16dee2 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:14.922902 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402b0ad-ef59-41fa-993f-89d18e16dee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:14.923420 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402b0ad-ef59-41fa-993f-89d18e16dee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:14.923420 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402b0ad-ef59-41fa-993f-89d18e16dee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:14.923749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402b0ad-ef59-41fa-993f-89d18e16dee2 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:14.924764 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ea602ba3-3b95-42c7-8a18-3d02e9e77a10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e6c1cfc65d1456ab754f5c55889f251'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:14.925627 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ea602ba3-3b95-42c7-8a18-3d02e9e77a10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e6c1cfc65d1456ab754f5c55889f251'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:14.935540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1099/2181] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:36:14.943168 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402b0ad-ef59-41fa-993f-89d18e16dee2 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:14.944821 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c402b0ad-ef59-41fa-993f-89d18e16dee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:14.957893 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402b0ad-ef59-41fa-993f-89d18e16dee2 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:14.962763 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f912a-5b3d-4d80-a724-03adcbedfcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:14.963417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f912a-5b3d-4d80-a724-03adcbedfcaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:14.963690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f912a-5b3d-4d80-a724-03adcbedfcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:14.964142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f912a-5b3d-4d80-a724-03adcbedfcaa admin admin] PATH_INFO: `/v3/projects/8870e438dc8d40c9b16e7ed329d114ac/users/017d830f90284682af03cea6d9c4383f/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:14.980036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f912a-5b3d-4d80-a724-03adcbedfcaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8870e438dc8d40c9b16e7ed329d114ac, user_id=017d830f90284682af03cea6d9c4383f, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:14.982716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f912a-5b3d-4d80-a724-03adcbedfcaa admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:15.089315 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ea602ba3-3b95-42c7-8a18-3d02e9e77a10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e6c1cfc65d1456ab754f5c55889f251'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:15.102605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ea602ba3-3b95-42c7-8a18-3d02e9e77a10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e6c1cfc65d1456ab754f5c55889f251'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:15.110793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ea602ba3-3b95-42c7-8a18-3d02e9e77a10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e6c1cfc65d1456ab754f5c55889f251'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:15.115535 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1083/2182] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:36:14 2022] DELETE /identity/v3/users/4e6c1cfc65d1456ab754f5c55889f251 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:36:15.119533 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fa19a-5e09-420e-aeef-35fa498975ce None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:15.119819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fa19a-5e09-420e-aeef-35fa498975ce None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:15.120107 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fa19a-5e09-420e-aeef-35fa498975ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:15.140621 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-387fa19a-5e09-420e-aeef-35fa498975ce None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:15.142653 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-387fa19a-5e09-420e-aeef-35fa498975ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:15.161868 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1100/2183] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:14 2022] PUT /identity/v3/projects/8870e438dc8d40c9b16e7ed329d114ac/users/017d830f90284682af03cea6d9c4383f/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:36:15.175372 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecdb0a-2bd2-4bee-b357-336e17b40556 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:15.175953 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecdb0a-2bd2-4bee-b357-336e17b40556 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:15.176467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecdb0a-2bd2-4bee-b357-336e17b40556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:15.216321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-89ecdb0a-2bd2-4bee-b357-336e17b40556 None None] MFA Rules not processed for user `017d830f90284682af03cea6d9c4383f`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:15.217954 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-89ecdb0a-2bd2-4bee-b357-336e17b40556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:15.223866 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1084/2184] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:36:15.300609 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1101/2185] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:15.305259 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fa19a-5e09-420e-aeef-35fa498975ce None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:15.307401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:15.319255 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fa19a-5e09-420e-aeef-35fa498975ce None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:15.386743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab66212-c8c8-46a3-a407-c009c99ba1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:15.387531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab66212-c8c8-46a3-a407-c009c99ba1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:15.387791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab66212-c8c8-46a3-a407-c009c99ba1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:15.388186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab66212-c8c8-46a3-a407-c009c99ba1f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:15.388856 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab66212-c8c8-46a3-a407-c009c99ba1f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:15.390824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab66212-c8c8-46a3-a407-c009c99ba1f5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:15.463956 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecdb0a-2bd2-4bee-b357-336e17b40556 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:15.465418 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-89ecdb0a-2bd2-4bee-b357-336e17b40556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:15.541942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecdb0a-2bd2-4bee-b357-336e17b40556 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:15.546564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a218e1-5eaa-45b9-b040-dd0e25b3aa29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:15.548047 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a218e1-5eaa-45b9-b040-dd0e25b3aa29 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:15.549885 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a218e1-5eaa-45b9-b040-dd0e25b3aa29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:15.550370 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a218e1-5eaa-45b9-b040-dd0e25b3aa29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:15.559115 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1085/2186] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:36:15 2022] POST /identity/v3/projects => generated 389 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:36:15.562227 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab66212-c8c8-46a3-a407-c009c99ba1f5 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:15.569971 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a218e1-5eaa-45b9-b040-dd0e25b3aa29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:15.571445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a218e1-5eaa-45b9-b040-dd0e25b3aa29 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:15.582710 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1102/2187] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:36:15.653509 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab66212-c8c8-46a3-a407-c009c99ba1f5 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:15.663350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30abcd-5f17-455b-8b3d-678c9949fb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:15.664156 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30abcd-5f17-455b-8b3d-678c9949fb52 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:15.664596 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30abcd-5f17-455b-8b3d-678c9949fb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:15.664999 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30abcd-5f17-455b-8b3d-678c9949fb52 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:15.665747 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30abcd-5f17-455b-8b3d-678c9949fb52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:15.667763 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30abcd-5f17-455b-8b3d-678c9949fb52 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:15.819824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1086/2188] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:36:15 2022] POST /identity/v3/users => generated 301 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:36:15.824114 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a218e1-5eaa-45b9-b040-dd0e25b3aa29 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:15.835372 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a218e1-5eaa-45b9-b040-dd0e25b3aa29 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:15.839994 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11384c-797c-4191-ad30-a95639a3d18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:15.840591 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11384c-797c-4191-ad30-a95639a3d18a admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:15.840869 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11384c-797c-4191-ad30-a95639a3d18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:15.841166 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11384c-797c-4191-ad30-a95639a3d18a admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:15.841794 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11384c-797c-4191-ad30-a95639a3d18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:15.843563 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11384c-797c-4191-ad30-a95639a3d18a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:15.855200 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1103/2189] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:15.859534 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30abcd-5f17-455b-8b3d-678c9949fb52 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:15.870914 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30abcd-5f17-455b-8b3d-678c9949fb52 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:15.876104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e6abd-00c6-4118-a2dc-45ad6d694140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:15.876850 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e6abd-00c6-4118-a2dc-45ad6d694140 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:15.877163 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e6abd-00c6-4118-a2dc-45ad6d694140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:15.877441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e6abd-00c6-4118-a2dc-45ad6d694140 admin admin] PATH_INFO: `/v3/projects/f12151037c3d4267a5931fe752badcef/users/95b744d3104d45048d7364877a98a7f4/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:15.893112 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e6abd-00c6-4118-a2dc-45ad6d694140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f12151037c3d4267a5931fe752badcef, user_id=95b744d3104d45048d7364877a98a7f4, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:15.895830 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e6abd-00c6-4118-a2dc-45ad6d694140 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:15.980831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1087/2190] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:15 2022] PUT /identity/v3/projects/f12151037c3d4267a5931fe752badcef/users/95b744d3104d45048d7364877a98a7f4/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:36:15.987096 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11384c-797c-4191-ad30-a95639a3d18a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:15.997881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11384c-797c-4191-ad30-a95639a3d18a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:16.062434 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e6abd-00c6-4118-a2dc-45ad6d694140 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:16.064338 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ea0e6abd-00c6-4118-a2dc-45ad6d694140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:16.080409 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd8d42-c019-4fd7-adbe-dddac3a17b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:16.081023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd8d42-c019-4fd7-adbe-dddac3a17b6f admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:16.081349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd8d42-c019-4fd7-adbe-dddac3a17b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:16.081624 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd8d42-c019-4fd7-adbe-dddac3a17b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:16.082333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd8d42-c019-4fd7-adbe-dddac3a17b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:16.084001 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd8d42-c019-4fd7-adbe-dddac3a17b6f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:16.095881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1104/2191] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:16.098733 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd8d42-c019-4fd7-adbe-dddac3a17b6f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:16.109087 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd8d42-c019-4fd7-adbe-dddac3a17b6f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:16.114754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbb26e-e138-4c92-9606-4e95449394dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:16.115403 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbb26e-e138-4c92-9606-4e95449394dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:16.115682 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbb26e-e138-4c92-9606-4e95449394dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:16.115965 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbb26e-e138-4c92-9606-4e95449394dc admin admin] PATH_INFO: `/v3/projects/f12151037c3d4267a5931fe752badcef/users/95b744d3104d45048d7364877a98a7f4/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:16.117922 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dbb26e-e138-4c92-9606-4e95449394dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f12151037c3d4267a5931fe752badcef, user_id=95b744d3104d45048d7364877a98a7f4, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:16.120592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dbb26e-e138-4c92-9606-4e95449394dc admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:16.132150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1105/2192] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:16 2022] PUT /identity/v3/projects/f12151037c3d4267a5931fe752badcef/users/95b744d3104d45048d7364877a98a7f4/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:36:16.134180 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbb26e-e138-4c92-9606-4e95449394dc admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:16.136422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-87dbb26e-e138-4c92-9606-4e95449394dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:16.149570 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e6abd-00c6-4118-a2dc-45ad6d694140 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:16.227924 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbb26e-e138-4c92-9606-4e95449394dc admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:16.240537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53318aa-7db9-4f7d-826b-ebedbd594a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:16.241382 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53318aa-7db9-4f7d-826b-ebedbd594a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:16.241717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53318aa-7db9-4f7d-826b-ebedbd594a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:16.241999 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53318aa-7db9-4f7d-826b-ebedbd594a61 admin admin] PATH_INFO: `/v3/projects/ea09a763920a41c2b32feef2468addce` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:16.243411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53318aa-7db9-4f7d-826b-ebedbd594a61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea09a763920a41c2b32feef2468addce)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:16.245484 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53318aa-7db9-4f7d-826b-ebedbd594a61 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:16.351830 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a76e3b-e22b-403b-81fd-d6be3a33885d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:16.352474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a76e3b-e22b-403b-81fd-d6be3a33885d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:16.352750 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a76e3b-e22b-403b-81fd-d6be3a33885d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:16.353020 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a76e3b-e22b-403b-81fd-d6be3a33885d admin admin] PATH_INFO: `/v3/users/501acd495aaf4f518fb7747c27821c11` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:16.354243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a76e3b-e22b-403b-81fd-d6be3a33885d admin admin] RBAC: Authorizing `identity:delete_user(user_id=501acd495aaf4f518fb7747c27821c11)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:16.356200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a76e3b-e22b-403b-81fd-d6be3a33885d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:16.404804 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a53318aa-7db9-4f7d-826b-ebedbd594a61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea09a763920a41c2b32feef2468addce', 'request_id': 'req-a53318aa-7db9-4f7d-826b-ebedbd594a61'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:16.412012 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a53318aa-7db9-4f7d-826b-ebedbd594a61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea09a763920a41c2b32feef2468addce', 'request_id': 'req-a53318aa-7db9-4f7d-826b-ebedbd594a61'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:16.522168 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a53318aa-7db9-4f7d-826b-ebedbd594a61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea09a763920a41c2b32feef2468addce', 'request_id': 'req-a53318aa-7db9-4f7d-826b-ebedbd594a61'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:16.534449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a53318aa-7db9-4f7d-826b-ebedbd594a61 admin admin] The token cache is being invalidate because project ea09a763920a41c2b32feef2468addce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:36:16.534742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a53318aa-7db9-4f7d-826b-ebedbd594a61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:16.535401 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a53318aa-7db9-4f7d-826b-ebedbd594a61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:16.536902 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1106/2193] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:36:16 2022] DELETE /identity/v3/projects/ea09a763920a41c2b32feef2468addce => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:36:16.539700 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9efc6-1fb4-4c3c-80bb-28d0dbe75979 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:16.539988 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9efc6-1fb4-4c3c-80bb-28d0dbe75979 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:16.540264 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9efc6-1fb4-4c3c-80bb-28d0dbe75979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:16.569886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-ceb9efc6-1fb4-4c3c-80bb-28d0dbe75979 None None] MFA Rules not processed for user `95b744d3104d45048d7364877a98a7f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:16.571177 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ceb9efc6-1fb4-4c3c-80bb-28d0dbe75979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:16.596986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-64a76e3b-e22b-403b-81fd-d6be3a33885d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '501acd495aaf4f518fb7747c27821c11'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:16.598142 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-64a76e3b-e22b-403b-81fd-d6be3a33885d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '501acd495aaf4f518fb7747c27821c11'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:16.662474 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1107/2194] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:16 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:16.663320 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9efc6-1fb4-4c3c-80bb-28d0dbe75979 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:16.664640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ceb9efc6-1fb4-4c3c-80bb-28d0dbe75979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:16.678089 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-64a76e3b-e22b-403b-81fd-d6be3a33885d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '501acd495aaf4f518fb7747c27821c11'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:16.691515 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-64a76e3b-e22b-403b-81fd-d6be3a33885d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '501acd495aaf4f518fb7747c27821c11'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:16.692278 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-64a76e3b-e22b-403b-81fd-d6be3a33885d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '501acd495aaf4f518fb7747c27821c11'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:16.705272 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1088/2195] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:36:16 2022] DELETE /identity/v3/users/501acd495aaf4f518fb7747c27821c11 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:16.706173 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a76e3b-e22b-403b-81fd-d6be3a33885d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:16.707553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-64a76e3b-e22b-403b-81fd-d6be3a33885d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:16.739827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9efc6-1fb4-4c3c-80bb-28d0dbe75979 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:16.770569 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a76e3b-e22b-403b-81fd-d6be3a33885d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:16.774448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2e681-6f39-4f91-bbb0-43d3a7516887 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:16.775106 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2e681-6f39-4f91-bbb0-43d3a7516887 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:16.775410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2e681-6f39-4f91-bbb0-43d3a7516887 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:16.775714 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2e681-6f39-4f91-bbb0-43d3a7516887 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:16.804223 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0334c99-74bb-4602-b2f6-5df58c744272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:16.804841 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0334c99-74bb-4602-b2f6-5df58c744272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:16.805153 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0334c99-74bb-4602-b2f6-5df58c744272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:16.805425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0334c99-74bb-4602-b2f6-5df58c744272 admin admin] PATH_INFO: `/v3/users/ab99a80fbd374a828e13489a614d0126` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:16.808258 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0334c99-74bb-4602-b2f6-5df58c744272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab99a80fbd374a828e13489a614d0126)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:16.810847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0334c99-74bb-4602-b2f6-5df58c744272 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:16.850527 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2e681-6f39-4f91-bbb0-43d3a7516887 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:16.851972 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2e681-6f39-4f91-bbb0-43d3a7516887 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:16.862991 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1089/2196] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:16 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:16.881167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd7547-522f-42d0-807a-1221ee4778c6 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:16.881167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd7547-522f-42d0-807a-1221ee4778c6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:16.881167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd7547-522f-42d0-807a-1221ee4778c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:16.908757 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4ffd7547-522f-42d0-807a-1221ee4778c6 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:16.910145 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4ffd7547-522f-42d0-807a-1221ee4778c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:16.921964 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1090/2197] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:16.928783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd7547-522f-42d0-807a-1221ee4778c6 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:16.930460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4ffd7547-522f-42d0-807a-1221ee4778c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:16.996807 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd7547-522f-42d0-807a-1221ee4778c6 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:17.001016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6023e0a-c08f-4452-a356-6838efc3ae33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:17.001654 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6023e0a-c08f-4452-a356-6838efc3ae33 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:17.002022 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6023e0a-c08f-4452-a356-6838efc3ae33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:17.002381 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6023e0a-c08f-4452-a356-6838efc3ae33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:17.012071 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6023e0a-c08f-4452-a356-6838efc3ae33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:17.013528 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6023e0a-c08f-4452-a356-6838efc3ae33 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:17.027709 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1091/2198] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:17.028566 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6023e0a-c08f-4452-a356-6838efc3ae33 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:17.032705 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f6023e0a-c08f-4452-a356-6838efc3ae33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:17.044386 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6023e0a-c08f-4452-a356-6838efc3ae33 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:17.049767 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50182a-6d4e-4a30-a504-d71f8041253e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:17.050385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50182a-6d4e-4a30-a504-d71f8041253e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:17.051171 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50182a-6d4e-4a30-a504-d71f8041253e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:17.051317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50182a-6d4e-4a30-a504-d71f8041253e admin admin] PATH_INFO: `/v3/users/017d830f90284682af03cea6d9c4383f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:17.052459 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50182a-6d4e-4a30-a504-d71f8041253e admin admin] RBAC: Authorizing `identity:delete_user(user_id=017d830f90284682af03cea6d9c4383f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:17.054460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50182a-6d4e-4a30-a504-d71f8041253e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:17.099980 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f0334c99-74bb-4602-b2f6-5df58c744272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab99a80fbd374a828e13489a614d0126'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:17.237474 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f0334c99-74bb-4602-b2f6-5df58c744272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab99a80fbd374a828e13489a614d0126'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:17.252247 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f0334c99-74bb-4602-b2f6-5df58c744272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab99a80fbd374a828e13489a614d0126'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:17.252996 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f0334c99-74bb-4602-b2f6-5df58c744272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab99a80fbd374a828e13489a614d0126'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:17.262445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f0334c99-74bb-4602-b2f6-5df58c744272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab99a80fbd374a828e13489a614d0126'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:17.270875 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1108/2199] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:36:16 2022] DELETE /identity/v3/users/ab99a80fbd374a828e13489a614d0126 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:17.347537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:17.405722 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5f50182a-6d4e-4a30-a504-d71f8041253e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '017d830f90284682af03cea6d9c4383f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:17.407308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5f50182a-6d4e-4a30-a504-d71f8041253e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '017d830f90284682af03cea6d9c4383f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:17.496752 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5f50182a-6d4e-4a30-a504-d71f8041253e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '017d830f90284682af03cea6d9c4383f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:17.503160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0334c99-74bb-4602-b2f6-5df58c744272 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:17.507834 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f0334c99-74bb-4602-b2f6-5df58c744272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:17.526143 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5f50182a-6d4e-4a30-a504-d71f8041253e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '017d830f90284682af03cea6d9c4383f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:17.527332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5f50182a-6d4e-4a30-a504-d71f8041253e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '017d830f90284682af03cea6d9c4383f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:17.576348 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1092/2200] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:36:17 2022] DELETE /identity/v3/users/017d830f90284682af03cea6d9c4383f => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:17.578089 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e13140-ae1f-48b1-95c0-7212f500e5cf None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:17.582958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e13140-ae1f-48b1-95c0-7212f500e5cf None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:17.582958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e13140-ae1f-48b1-95c0-7212f500e5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:17.611775 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-06e13140-ae1f-48b1-95c0-7212f500e5cf None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:17.613842 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-06e13140-ae1f-48b1-95c0-7212f500e5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:17.664977 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0334c99-74bb-4602-b2f6-5df58c744272 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:17.697122 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1093/2201] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:17.708170 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e13140-ae1f-48b1-95c0-7212f500e5cf None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:17.709849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-06e13140-ae1f-48b1-95c0-7212f500e5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:17.758594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadaf8d-fe75-4e4c-aa74-f946b4ce2bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:17.758594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadaf8d-fe75-4e4c-aa74-f946b4ce2bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:17.758594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadaf8d-fe75-4e4c-aa74-f946b4ce2bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:17.758594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadaf8d-fe75-4e4c-aa74-f946b4ce2bb6 admin admin] PATH_INFO: `/v3/projects/c9fe21975c6a4f769137e46bc4802392` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:17.760190 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aadaf8d-fe75-4e4c-aa74-f946b4ce2bb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9fe21975c6a4f769137e46bc4802392)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:17.763091 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aadaf8d-fe75-4e4c-aa74-f946b4ce2bb6 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:17.804280 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e13140-ae1f-48b1-95c0-7212f500e5cf None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:17.808120 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72decb4-ec57-4593-9ed2-2bbd50ba80eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:17.809408 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72decb4-ec57-4593-9ed2-2bbd50ba80eb service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:17.809408 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72decb4-ec57-4593-9ed2-2bbd50ba80eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:17.809623 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72decb4-ec57-4593-9ed2-2bbd50ba80eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:17.819361 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72decb4-ec57-4593-9ed2-2bbd50ba80eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:17.820835 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72decb4-ec57-4593-9ed2-2bbd50ba80eb service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:17.832051 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1094/2202] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:36:17.915595 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72decb4-ec57-4593-9ed2-2bbd50ba80eb service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:17.917550 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d72decb4-ec57-4593-9ed2-2bbd50ba80eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:17.941112 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72decb4-ec57-4593-9ed2-2bbd50ba80eb service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:17.951586 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5aadaf8d-fe75-4e4c-aa74-f946b4ce2bb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9fe21975c6a4f769137e46bc4802392', 'request_id': 'req-5aadaf8d-fe75-4e4c-aa74-f946b4ce2bb6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:17.956871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5aadaf8d-fe75-4e4c-aa74-f946b4ce2bb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9fe21975c6a4f769137e46bc4802392', 'request_id': 'req-5aadaf8d-fe75-4e4c-aa74-f946b4ce2bb6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:18.018092 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b874e-585a-452f-9a2a-cf040414a3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:18.018737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b874e-585a-452f-9a2a-cf040414a3c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:18.019020 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b874e-585a-452f-9a2a-cf040414a3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:18.019295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b874e-585a-452f-9a2a-cf040414a3c8 admin admin] PATH_INFO: `/v3/projects/15230a29d16b43a3a433ed744e971868` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:18.020625 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b874e-585a-452f-9a2a-cf040414a3c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15230a29d16b43a3a433ed744e971868)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:18.022651 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b874e-585a-452f-9a2a-cf040414a3c8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:18.061119 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5aadaf8d-fe75-4e4c-aa74-f946b4ce2bb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9fe21975c6a4f769137e46bc4802392', 'request_id': 'req-5aadaf8d-fe75-4e4c-aa74-f946b4ce2bb6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:18.085110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5aadaf8d-fe75-4e4c-aa74-f946b4ce2bb6 admin admin] The token cache is being invalidate because project c9fe21975c6a4f769137e46bc4802392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:36:18.085110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5aadaf8d-fe75-4e4c-aa74-f946b4ce2bb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:18.085110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5aadaf8d-fe75-4e4c-aa74-f946b4ce2bb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:18.085110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1109/2203] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:36:17 2022] DELETE /identity/v3/projects/c9fe21975c6a4f769137e46bc4802392 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:18.085110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadaf8d-fe75-4e4c-aa74-f946b4ce2bb6 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:18.085574 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5aadaf8d-fe75-4e4c-aa74-f946b4ce2bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:18.094697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadaf8d-fe75-4e4c-aa74-f946b4ce2bb6 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:18.103282 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e6b9d-5e8d-4736-85b0-ef6599b7386f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:18.103282 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e6b9d-5e8d-4736-85b0-ef6599b7386f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:18.103282 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e6b9d-5e8d-4736-85b0-ef6599b7386f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:18.103282 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e6b9d-5e8d-4736-85b0-ef6599b7386f admin admin] PATH_INFO: `/v3/users/6145fe0f63ef4ef28b657050bdae67f9` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:18.104130 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e6b9d-5e8d-4736-85b0-ef6599b7386f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6145fe0f63ef4ef28b657050bdae67f9)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:18.104330 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e6b9d-5e8d-4736-85b0-ef6599b7386f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:18.189937 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b95b874e-585a-452f-9a2a-cf040414a3c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15230a29d16b43a3a433ed744e971868', 'request_id': 'req-b95b874e-585a-452f-9a2a-cf040414a3c8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:18.197540 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b95b874e-585a-452f-9a2a-cf040414a3c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15230a29d16b43a3a433ed744e971868', 'request_id': 'req-b95b874e-585a-452f-9a2a-cf040414a3c8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:18.215727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:18.305274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b95b874e-585a-452f-9a2a-cf040414a3c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15230a29d16b43a3a433ed744e971868', 'request_id': 'req-b95b874e-585a-452f-9a2a-cf040414a3c8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:18.318707 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b95b874e-585a-452f-9a2a-cf040414a3c8 admin admin] The token cache is being invalidate because project 15230a29d16b43a3a433ed744e971868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:36:18.319001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b95b874e-585a-452f-9a2a-cf040414a3c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:18.319732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b95b874e-585a-452f-9a2a-cf040414a3c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:18.321379 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1095/2204] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:36:17 2022] DELETE /identity/v3/projects/15230a29d16b43a3a433ed744e971868 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:18.325154 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b874e-585a-452f-9a2a-cf040414a3c8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:18.326547 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b95b874e-585a-452f-9a2a-cf040414a3c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:18.353412 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d92e6b9d-5e8d-4736-85b0-ef6599b7386f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6145fe0f63ef4ef28b657050bdae67f9'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:18.404434 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b874e-585a-452f-9a2a-cf040414a3c8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:18.410221 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528d855-d7e0-4dc2-b35d-f5944f52161a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:18.410923 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528d855-d7e0-4dc2-b35d-f5944f52161a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:18.411279 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528d855-d7e0-4dc2-b35d-f5944f52161a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:18.411628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528d855-d7e0-4dc2-b35d-f5944f52161a admin admin] PATH_INFO: `/v3/users/6bac2f32884a460dbe6434eb22565789` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:18.412946 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528d855-d7e0-4dc2-b35d-f5944f52161a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bac2f32884a460dbe6434eb22565789)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:18.414947 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528d855-d7e0-4dc2-b35d-f5944f52161a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:18.456630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d92e6b9d-5e8d-4736-85b0-ef6599b7386f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6145fe0f63ef4ef28b657050bdae67f9'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:18.471738 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d92e6b9d-5e8d-4736-85b0-ef6599b7386f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6145fe0f63ef4ef28b657050bdae67f9'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:18.472546 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d92e6b9d-5e8d-4736-85b0-ef6599b7386f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6145fe0f63ef4ef28b657050bdae67f9'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:18.490874 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d92e6b9d-5e8d-4736-85b0-ef6599b7386f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6145fe0f63ef4ef28b657050bdae67f9'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:18.497309 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1110/2205] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:36:18 2022] DELETE /identity/v3/users/6145fe0f63ef4ef28b657050bdae67f9 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:36:18.500581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e6b9d-5e8d-4736-85b0-ef6599b7386f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:18.500581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d92e6b9d-5e8d-4736-85b0-ef6599b7386f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:18.585314 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e6b9d-5e8d-4736-85b0-ef6599b7386f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:18.590500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfebea8-25fe-48eb-87d3-5d9776fb46aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:18.591203 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfebea8-25fe-48eb-87d3-5d9776fb46aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:18.591482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfebea8-25fe-48eb-87d3-5d9776fb46aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:18.591786 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfebea8-25fe-48eb-87d3-5d9776fb46aa admin admin] PATH_INFO: `/v3/projects/8870e438dc8d40c9b16e7ed329d114ac` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:18.592923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfebea8-25fe-48eb-87d3-5d9776fb46aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8870e438dc8d40c9b16e7ed329d114ac)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:18.595547 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfebea8-25fe-48eb-87d3-5d9776fb46aa admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:18.720366 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9528d855-d7e0-4dc2-b35d-f5944f52161a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bac2f32884a460dbe6434eb22565789'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:18.721116 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9528d855-d7e0-4dc2-b35d-f5944f52161a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bac2f32884a460dbe6434eb22565789'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:18.780234 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fdfebea8-25fe-48eb-87d3-5d9776fb46aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8870e438dc8d40c9b16e7ed329d114ac', 'request_id': 'req-fdfebea8-25fe-48eb-87d3-5d9776fb46aa'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:18.786988 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fdfebea8-25fe-48eb-87d3-5d9776fb46aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8870e438dc8d40c9b16e7ed329d114ac', 'request_id': 'req-fdfebea8-25fe-48eb-87d3-5d9776fb46aa'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:18.967619 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9528d855-d7e0-4dc2-b35d-f5944f52161a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bac2f32884a460dbe6434eb22565789'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:18.985718 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9528d855-d7e0-4dc2-b35d-f5944f52161a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bac2f32884a460dbe6434eb22565789'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:18.986619 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9528d855-d7e0-4dc2-b35d-f5944f52161a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bac2f32884a460dbe6434eb22565789'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:19.000137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1096/2206] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:36:18 2022] DELETE /identity/v3/users/6bac2f32884a460dbe6434eb22565789 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:19.060758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fdfebea8-25fe-48eb-87d3-5d9776fb46aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8870e438dc8d40c9b16e7ed329d114ac', 'request_id': 'req-fdfebea8-25fe-48eb-87d3-5d9776fb46aa'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:19.070868 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528d855-d7e0-4dc2-b35d-f5944f52161a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:19.074934 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9528d855-d7e0-4dc2-b35d-f5944f52161a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:19.077953 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fdfebea8-25fe-48eb-87d3-5d9776fb46aa admin admin] The token cache is being invalidate because project 8870e438dc8d40c9b16e7ed329d114ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:36:19.079501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fdfebea8-25fe-48eb-87d3-5d9776fb46aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:19.080608 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fdfebea8-25fe-48eb-87d3-5d9776fb46aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:19.083508 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1111/2207] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:36:18 2022] DELETE /identity/v3/projects/8870e438dc8d40c9b16e7ed329d114ac => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:19.088676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfebea8-25fe-48eb-87d3-5d9776fb46aa admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:19.100925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fdfebea8-25fe-48eb-87d3-5d9776fb46aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:19.166258 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528d855-d7e0-4dc2-b35d-f5944f52161a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:19.171091 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429d690-38fc-45e2-820f-5ad710737475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:19.171723 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429d690-38fc-45e2-820f-5ad710737475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:19.171998 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429d690-38fc-45e2-820f-5ad710737475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:19.174496 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429d690-38fc-45e2-820f-5ad710737475 admin admin] PATH_INFO: `/v3/projects/6478df589c1042669f0903915d81c103` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:19.174496 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429d690-38fc-45e2-820f-5ad710737475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6478df589c1042669f0903915d81c103)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:19.175688 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429d690-38fc-45e2-820f-5ad710737475 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:19.199542 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfebea8-25fe-48eb-87d3-5d9776fb46aa admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:19.211757 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa074b23-c136-4e1d-9c66-96f2063dc60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:19.212404 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa074b23-c136-4e1d-9c66-96f2063dc60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:19.212675 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa074b23-c136-4e1d-9c66-96f2063dc60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:19.212939 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa074b23-c136-4e1d-9c66-96f2063dc60b admin admin] PATH_INFO: `/v3/users/95b744d3104d45048d7364877a98a7f4` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:19.215071 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa074b23-c136-4e1d-9c66-96f2063dc60b admin admin] RBAC: Authorizing `identity:delete_user(user_id=95b744d3104d45048d7364877a98a7f4)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:19.216417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa074b23-c136-4e1d-9c66-96f2063dc60b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:19.297710 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7429d690-38fc-45e2-820f-5ad710737475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6478df589c1042669f0903915d81c103', 'request_id': 'req-7429d690-38fc-45e2-820f-5ad710737475'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:19.303496 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7429d690-38fc-45e2-820f-5ad710737475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6478df589c1042669f0903915d81c103', 'request_id': 'req-7429d690-38fc-45e2-820f-5ad710737475'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:19.393215 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7429d690-38fc-45e2-820f-5ad710737475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6478df589c1042669f0903915d81c103', 'request_id': 'req-7429d690-38fc-45e2-820f-5ad710737475'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:19.405760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7429d690-38fc-45e2-820f-5ad710737475 admin admin] The token cache is being invalidate because project 6478df589c1042669f0903915d81c103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:36:19.406123 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7429d690-38fc-45e2-820f-5ad710737475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:19.407652 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7429d690-38fc-45e2-820f-5ad710737475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:19.409350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1097/2208] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:36:19 2022] DELETE /identity/v3/projects/6478df589c1042669f0903915d81c103 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:19.414266 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fa074b23-c136-4e1d-9c66-96f2063dc60b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95b744d3104d45048d7364877a98a7f4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:19.415534 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66743f71-bd5c-4e74-bbf0-c2a06d9327ab None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:19.415816 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66743f71-bd5c-4e74-bbf0-c2a06d9327ab None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:19.416092 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66743f71-bd5c-4e74-bbf0-c2a06d9327ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:19.435938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-66743f71-bd5c-4e74-bbf0-c2a06d9327ab None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:19.437167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-66743f71-bd5c-4e74-bbf0-c2a06d9327ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:19.504167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1098/2209] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:36:19.512627 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee85aff-6cc4-452b-88a0-e4d45b508bf9 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:19.512920 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee85aff-6cc4-452b-88a0-e4d45b508bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:19.513225 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee85aff-6cc4-452b-88a0-e4d45b508bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:19.517695 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fa074b23-c136-4e1d-9c66-96f2063dc60b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95b744d3104d45048d7364877a98a7f4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:19.536701 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fa074b23-c136-4e1d-9c66-96f2063dc60b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95b744d3104d45048d7364877a98a7f4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:19.537845 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fa074b23-c136-4e1d-9c66-96f2063dc60b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95b744d3104d45048d7364877a98a7f4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:19.547085 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fa074b23-c136-4e1d-9c66-96f2063dc60b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95b744d3104d45048d7364877a98a7f4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:19.548793 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-bee85aff-6cc4-452b-88a0-e4d45b508bf9 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:19.550552 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bee85aff-6cc4-452b-88a0-e4d45b508bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:19.564730 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1112/2210] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:36:19 2022] DELETE /identity/v3/users/95b744d3104d45048d7364877a98a7f4 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:19.564730 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa074b23-c136-4e1d-9c66-96f2063dc60b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:19.574728 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fa074b23-c136-4e1d-9c66-96f2063dc60b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:19.638775 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1099/2211] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:19.643521 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee85aff-6cc4-452b-88a0-e4d45b508bf9 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:19.657494 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee85aff-6cc4-452b-88a0-e4d45b508bf9 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:19.658553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa074b23-c136-4e1d-9c66-96f2063dc60b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:19.666332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae4ba8-99e2-4552-bba7-588a760c1cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:19.666958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae4ba8-99e2-4552-bba7-588a760c1cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:19.667238 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae4ba8-99e2-4552-bba7-588a760c1cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:19.667529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae4ba8-99e2-4552-bba7-588a760c1cd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:19.668562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae4ba8-99e2-4552-bba7-588a760c1cd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:36:19.668562 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae4ba8-99e2-4552-bba7-588a760c1cd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:19.670092 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae4ba8-99e2-4552-bba7-588a760c1cd1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:19.682441 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e479c6-dc18-4902-9470-411b748138cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:19.684961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e479c6-dc18-4902-9470-411b748138cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:19.685680 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e479c6-dc18-4902-9470-411b748138cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:19.685995 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e479c6-dc18-4902-9470-411b748138cc admin admin] PATH_INFO: `/v3/projects/9caf4fa84ec14033be394c3c7207e1ec` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:19.688305 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e479c6-dc18-4902-9470-411b748138cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9caf4fa84ec14033be394c3c7207e1ec)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:19.690834 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e479c6-dc18-4902-9470-411b748138cc admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:19.691474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1100/2212] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:36:19.692572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae4ba8-99e2-4552-bba7-588a760c1cd1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:19.711189 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae4ba8-99e2-4552-bba7-588a760c1cd1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:19.717155 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31c93c-2973-4137-9eba-2ed01b6db03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:19.718303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31c93c-2973-4137-9eba-2ed01b6db03a admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:19.719608 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31c93c-2973-4137-9eba-2ed01b6db03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:19.720258 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31c93c-2973-4137-9eba-2ed01b6db03a admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:19.721269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31c93c-2973-4137-9eba-2ed01b6db03a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:19.724544 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31c93c-2973-4137-9eba-2ed01b6db03a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:19.994031 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1101/2213] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:36:19 2022] POST /identity/v3/projects => generated 375 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:19.995102 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31c93c-2973-4137-9eba-2ed01b6db03a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:20.038113 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a0e479c6-dc18-4902-9470-411b748138cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9caf4fa84ec14033be394c3c7207e1ec', 'request_id': 'req-a0e479c6-dc18-4902-9470-411b748138cc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:20.049898 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a0e479c6-dc18-4902-9470-411b748138cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9caf4fa84ec14033be394c3c7207e1ec', 'request_id': 'req-a0e479c6-dc18-4902-9470-411b748138cc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:20.331178 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31c93c-2973-4137-9eba-2ed01b6db03a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:20.331178 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38430769-1066-4386-8175-94db007a19e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:20.331178 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38430769-1066-4386-8175-94db007a19e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:20.331178 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38430769-1066-4386-8175-94db007a19e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:20.331561 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38430769-1066-4386-8175-94db007a19e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:20.331561 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38430769-1066-4386-8175-94db007a19e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:20.331561 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38430769-1066-4386-8175-94db007a19e1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:20.479060 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a0e479c6-dc18-4902-9470-411b748138cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9caf4fa84ec14033be394c3c7207e1ec', 'request_id': 'req-a0e479c6-dc18-4902-9470-411b748138cc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:20.485500 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1102/2214] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:36:19 2022] POST /identity/v3/users => generated 288 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:20.488906 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38430769-1066-4386-8175-94db007a19e1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:20.492707 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-38430769-1066-4386-8175-94db007a19e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:20.500758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a0e479c6-dc18-4902-9470-411b748138cc admin admin] The token cache is being invalidate because project 9caf4fa84ec14033be394c3c7207e1ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:36:20.503056 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a0e479c6-dc18-4902-9470-411b748138cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:20.506586 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a0e479c6-dc18-4902-9470-411b748138cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:20.509126 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1113/2215] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:36:19 2022] DELETE /identity/v3/projects/9caf4fa84ec14033be394c3c7207e1ec => generated 0 bytes in 945 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:20.513794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38430769-1066-4386-8175-94db007a19e1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:20.518796 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e479c6-dc18-4902-9470-411b748138cc admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:20.523329 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:20.525557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a0e479c6-dc18-4902-9470-411b748138cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:20.540844 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4de66-f0fa-45b0-a0f3-ed7655612762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:20.542012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4de66-f0fa-45b0-a0f3-ed7655612762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:20.543267 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4de66-f0fa-45b0-a0f3-ed7655612762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:20.543774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4de66-f0fa-45b0-a0f3-ed7655612762 admin admin] PATH_INFO: `/v3/projects/f12151037c3d4267a5931fe752badcef` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:20.545443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4de66-f0fa-45b0-a0f3-ed7655612762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f12151037c3d4267a5931fe752badcef)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:20.549182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4de66-f0fa-45b0-a0f3-ed7655612762 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:20.553077 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e479c6-dc18-4902-9470-411b748138cc admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:20.564144 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ee57b-af2d-4fe8-8d2f-a8cbc0625284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:20.564955 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ee57b-af2d-4fe8-8d2f-a8cbc0625284 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:20.565443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ee57b-af2d-4fe8-8d2f-a8cbc0625284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:20.565873 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ee57b-af2d-4fe8-8d2f-a8cbc0625284 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:20.566875 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ee57b-af2d-4fe8-8d2f-a8cbc0625284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:20.569456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ee57b-af2d-4fe8-8d2f-a8cbc0625284 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:20.593517 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1114/2216] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:20.595346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2aab2f-63b9-4cc0-95cf-07675dc8967e None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:20.595961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2aab2f-63b9-4cc0-95cf-07675dc8967e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:20.597644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2aab2f-63b9-4cc0-95cf-07675dc8967e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:20.624869 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-1e2aab2f-63b9-4cc0-95cf-07675dc8967e None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:20.636959 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1e2aab2f-63b9-4cc0-95cf-07675dc8967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:20.652622 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1115/2217] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:20.654401 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2aab2f-63b9-4cc0-95cf-07675dc8967e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:20.666497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2aab2f-63b9-4cc0-95cf-07675dc8967e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:20.671541 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a8062-7e7b-49ec-b7ac-c90517a42edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:20.672214 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a8062-7e7b-49ec-b7ac-c90517a42edc admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:20.672496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a8062-7e7b-49ec-b7ac-c90517a42edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:20.672795 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a8062-7e7b-49ec-b7ac-c90517a42edc admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:20.673593 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a8062-7e7b-49ec-b7ac-c90517a42edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:20.675256 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a8062-7e7b-49ec-b7ac-c90517a42edc admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:20.686208 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1116/2218] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:20.691046 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e522d10-a8fb-49fc-b2b3-b0fd7d2543ce None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:20.691587 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e522d10-a8fb-49fc-b2b3-b0fd7d2543ce None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:20.691903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e522d10-a8fb-49fc-b2b3-b0fd7d2543ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:20.713841 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-6e522d10-a8fb-49fc-b2b3-b0fd7d2543ce None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:20.715037 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6e522d10-a8fb-49fc-b2b3-b0fd7d2543ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:20.723036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1117/2219] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:20.723919 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e522d10-a8fb-49fc-b2b3-b0fd7d2543ce None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:20.736732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e522d10-a8fb-49fc-b2b3-b0fd7d2543ce None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:20.756179 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ebe4de66-f0fa-45b0-a0f3-ed7655612762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f12151037c3d4267a5931fe752badcef', 'request_id': 'req-ebe4de66-f0fa-45b0-a0f3-ed7655612762'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:20.761654 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ebe4de66-f0fa-45b0-a0f3-ed7655612762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f12151037c3d4267a5931fe752badcef', 'request_id': 'req-ebe4de66-f0fa-45b0-a0f3-ed7655612762'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:20.792611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640b972-2f8f-4656-a725-c215ee9cce46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:20.793303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640b972-2f8f-4656-a725-c215ee9cce46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:20.793580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640b972-2f8f-4656-a725-c215ee9cce46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:20.793851 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a640b972-2f8f-4656-a725-c215ee9cce46 admin admin] PATH_INFO: `/v3/projects/d55903f880ef40b082af99b4af2a1a3c/users/cfc12789eff1498f80fdb45d474e4078/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:20.808931 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a640b972-2f8f-4656-a725-c215ee9cce46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d55903f880ef40b082af99b4af2a1a3c, user_id=cfc12789eff1498f80fdb45d474e4078, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:20.813469 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a640b972-2f8f-4656-a725-c215ee9cce46 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:20.833716 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ebe4de66-f0fa-45b0-a0f3-ed7655612762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f12151037c3d4267a5931fe752badcef', 'request_id': 'req-ebe4de66-f0fa-45b0-a0f3-ed7655612762'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:20.848543 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ebe4de66-f0fa-45b0-a0f3-ed7655612762 admin admin] The token cache is being invalidate because project f12151037c3d4267a5931fe752badcef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:36:20.848832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ebe4de66-f0fa-45b0-a0f3-ed7655612762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:20.849504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ebe4de66-f0fa-45b0-a0f3-ed7655612762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:20.850979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1103/2220] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:36:20 2022] DELETE /identity/v3/projects/f12151037c3d4267a5931fe752badcef => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:20.851803 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4de66-f0fa-45b0-a0f3-ed7655612762 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:20.853104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ebe4de66-f0fa-45b0-a0f3-ed7655612762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:20.868648 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4de66-f0fa-45b0-a0f3-ed7655612762 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:20.872477 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357aa684-8fca-487d-8a37-b39cbc3e396b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:20.873127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357aa684-8fca-487d-8a37-b39cbc3e396b admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:20.873409 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357aa684-8fca-487d-8a37-b39cbc3e396b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:20.873680 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357aa684-8fca-487d-8a37-b39cbc3e396b admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:20.874317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357aa684-8fca-487d-8a37-b39cbc3e396b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:36:20.874619 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357aa684-8fca-487d-8a37-b39cbc3e396b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:20.877012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357aa684-8fca-487d-8a37-b39cbc3e396b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:20.893192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1104/2221] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:36:20.893192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c4191-7b79-40fc-a276-c5edef22f5d8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:20.893192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c4191-7b79-40fc-a276-c5edef22f5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:20.893192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c4191-7b79-40fc-a276-c5edef22f5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:20.899888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1118/2222] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:20 2022] PUT /identity/v3/projects/d55903f880ef40b082af99b4af2a1a3c/users/cfc12789eff1498f80fdb45d474e4078/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:20.901081 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640b972-2f8f-4656-a725-c215ee9cce46 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:20.933465 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-806c4191-7b79-40fc-a276-c5edef22f5d8 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:20.934971 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-806c4191-7b79-40fc-a276-c5edef22f5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:20.976677 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a640b972-2f8f-4656-a725-c215ee9cce46 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:20.982073 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf50e7c-5674-4ce1-9f11-0af46c26a024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:20.982678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf50e7c-5674-4ce1-9f11-0af46c26a024 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:20.982958 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf50e7c-5674-4ce1-9f11-0af46c26a024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:20.983226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf50e7c-5674-4ce1-9f11-0af46c26a024 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:20.983859 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf50e7c-5674-4ce1-9f11-0af46c26a024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:20.986582 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf50e7c-5674-4ce1-9f11-0af46c26a024 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:21.008366 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1105/2223] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:21.008366 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcaa7b3-6dd0-466b-b289-218a5476deca None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:21.008366 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcaa7b3-6dd0-466b-b289-218a5476deca None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:21.008366 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcaa7b3-6dd0-466b-b289-218a5476deca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:21.034825 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2dcaa7b3-6dd0-466b-b289-218a5476deca None None] MFA Rules not processed for user `cfc12789eff1498f80fdb45d474e4078`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:21.036061 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2dcaa7b3-6dd0-466b-b289-218a5476deca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:21.089357 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1119/2224] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:36:20 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:21.091286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dce93c-0fa3-4476-9915-5345624ab7c4 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:21.091756 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dce93c-0fa3-4476-9915-5345624ab7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:21.092023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dce93c-0fa3-4476-9915-5345624ab7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:21.112362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-41dce93c-0fa3-4476-9915-5345624ab7c4 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:21.113498 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-41dce93c-0fa3-4476-9915-5345624ab7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:21.116287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1106/2225] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:21.117368 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcaa7b3-6dd0-466b-b289-218a5476deca None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:21.136077 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcaa7b3-6dd0-466b-b289-218a5476deca None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:21.202629 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1120/2226] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:21.204796 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dce93c-0fa3-4476-9915-5345624ab7c4 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:21.206296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-41dce93c-0fa3-4476-9915-5345624ab7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:21.208743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06b8ac-b9ac-46e3-9aba-d2ea34ba55c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:21.209500 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06b8ac-b9ac-46e3-9aba-d2ea34ba55c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:21.209772 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06b8ac-b9ac-46e3-9aba-d2ea34ba55c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:21.210046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06b8ac-b9ac-46e3-9aba-d2ea34ba55c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:21.210692 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06b8ac-b9ac-46e3-9aba-d2ea34ba55c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:21.212736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06b8ac-b9ac-46e3-9aba-d2ea34ba55c4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:21.302154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dce93c-0fa3-4476-9915-5345624ab7c4 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:21.306260 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c220b-682e-46df-87b6-40611bd5b616 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a7e9f0daa1c48eca87d92ced265afdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:21.306838 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c220b-682e-46df-87b6-40611bd5b616 service glance] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:21.307117 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c220b-682e-46df-87b6-40611bd5b616 service glance] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:21.307385 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c220b-682e-46df-87b6-40611bd5b616 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:21.332887 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1107/2227] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:36:21 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:21.332887 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06b8ac-b9ac-46e3-9aba-d2ea34ba55c4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:21.354278 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06b8ac-b9ac-46e3-9aba-d2ea34ba55c4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:21.370289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=80,keystone:DELETE=14,keystone:INSERT=6 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:21.376449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6e228-09fa-473f-9016-116332709302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:21.377097 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6e228-09fa-473f-9016-116332709302 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:21.377377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6e228-09fa-473f-9016-116332709302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:21.377732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6e228-09fa-473f-9016-116332709302 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:21.378361 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6e228-09fa-473f-9016-116332709302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:36:21.378672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6e228-09fa-473f-9016-116332709302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:21.380611 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6e228-09fa-473f-9016-116332709302 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:21.383442 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c220b-682e-46df-87b6-40611bd5b616 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:21.385589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c220b-682e-46df-87b6-40611bd5b616 service glance] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:21.402031 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1108/2228] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:36:21.402547 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1121/2229] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:21.403112 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6e228-09fa-473f-9016-116332709302 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:21.403493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c220b-682e-46df-87b6-40611bd5b616 service glance] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:21.425200 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c220b-682e-46df-87b6-40611bd5b616 service glance] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:21.428268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0487b-8faa-4988-b493-32d1a0663565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:21.428934 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0487b-8faa-4988-b493-32d1a0663565 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:21.429243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0487b-8faa-4988-b493-32d1a0663565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:21.429534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0487b-8faa-4988-b493-32d1a0663565 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:21.430185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0487b-8faa-4988-b493-32d1a0663565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:21.432254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0487b-8faa-4988-b493-32d1a0663565 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:21.441728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6e228-09fa-473f-9016-116332709302 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:21.448251 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecc190-3945-41da-9140-feb5ff5974c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:21.449152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecc190-3945-41da-9140-feb5ff5974c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:21.449780 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecc190-3945-41da-9140-feb5ff5974c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:21.450277 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecc190-3945-41da-9140-feb5ff5974c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:21.451171 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecc190-3945-41da-9140-feb5ff5974c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:21.452920 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecc190-3945-41da-9140-feb5ff5974c8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:21.463862 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1109/2230] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:21.470368 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecc190-3945-41da-9140-feb5ff5974c8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:21.482528 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecc190-3945-41da-9140-feb5ff5974c8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:21.487507 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe182771-3cc8-4136-97fd-15cf92f7f221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:21.488107 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe182771-3cc8-4136-97fd-15cf92f7f221 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:21.488575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe182771-3cc8-4136-97fd-15cf92f7f221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:21.488923 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe182771-3cc8-4136-97fd-15cf92f7f221 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:21.489600 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe182771-3cc8-4136-97fd-15cf92f7f221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:21.491211 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe182771-3cc8-4136-97fd-15cf92f7f221 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:21.502956 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1110/2231] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:21.507069 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe182771-3cc8-4136-97fd-15cf92f7f221 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:21.517461 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe182771-3cc8-4136-97fd-15cf92f7f221 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:21.522384 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbf6f8-ce47-4247-b301-68569a08c122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:21.523217 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbf6f8-ce47-4247-b301-68569a08c122 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:21.523733 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbf6f8-ce47-4247-b301-68569a08c122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:21.524076 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbf6f8-ce47-4247-b301-68569a08c122 admin admin] PATH_INFO: `/v3/projects/5d49c00c74c0478dbc859e42d4624e03/users/9f44c400611d4dff9f5b826776443b87/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:21.540469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbf6f8-ce47-4247-b301-68569a08c122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d49c00c74c0478dbc859e42d4624e03, user_id=9f44c400611d4dff9f5b826776443b87, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:21.543796 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbf6f8-ce47-4247-b301-68569a08c122 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:21.577089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1122/2232] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:36:21 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:21.579936 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0487b-8faa-4988-b493-32d1a0663565 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:21.657469 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0487b-8faa-4988-b493-32d1a0663565 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:21.662259 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d92461-68f2-41c9-bd57-119231bcfd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:21.662860 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d92461-68f2-41c9-bd57-119231bcfd9b admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:21.663133 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d92461-68f2-41c9-bd57-119231bcfd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:21.663401 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d92461-68f2-41c9-bd57-119231bcfd9b admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:21.664147 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d92461-68f2-41c9-bd57-119231bcfd9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:21.666106 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d92461-68f2-41c9-bd57-119231bcfd9b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:21.722532 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1111/2233] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:21 2022] PUT /identity/v3/projects/5d49c00c74c0478dbc859e42d4624e03/users/9f44c400611d4dff9f5b826776443b87/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:36:21.734144 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870ba0f-9763-4115-908e-ff1df75a66e4 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:21.734414 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870ba0f-9763-4115-908e-ff1df75a66e4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:21.734717 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870ba0f-9763-4115-908e-ff1df75a66e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:21.763035 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a870ba0f-9763-4115-908e-ff1df75a66e4 None None] MFA Rules not processed for user `9f44c400611d4dff9f5b826776443b87`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:21.764330 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a870ba0f-9763-4115-908e-ff1df75a66e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:21.794337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1123/2234] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:36:21 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:36:21.798094 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d92461-68f2-41c9-bd57-119231bcfd9b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:21.810130 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d92461-68f2-41c9-bd57-119231bcfd9b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:21.837929 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1112/2235] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:36:21.841203 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870ba0f-9763-4115-908e-ff1df75a66e4 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:21.901770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe787c-d68d-4b86-a856-4497b4db817e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:21.902452 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe787c-d68d-4b86-a856-4497b4db817e admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:21.902736 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe787c-d68d-4b86-a856-4497b4db817e admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:21.903010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe787c-d68d-4b86-a856-4497b4db817e admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:21.903940 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe787c-d68d-4b86-a856-4497b4db817e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:21.905689 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe787c-d68d-4b86-a856-4497b4db817e admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:21.921107 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1124/2236] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:36:21.923067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870ba0f-9763-4115-908e-ff1df75a66e4 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:21.924344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe787c-d68d-4b86-a856-4497b4db817e admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:21.928486 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdac3c-1df8-4431-9cfe-712734d27590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:21.929117 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdac3c-1df8-4431-9cfe-712734d27590 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:21.929387 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdac3c-1df8-4431-9cfe-712734d27590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:21.929785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdac3c-1df8-4431-9cfe-712734d27590 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:21.930364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdac3c-1df8-4431-9cfe-712734d27590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:21.932246 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdac3c-1df8-4431-9cfe-712734d27590 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:21.934985 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe787c-d68d-4b86-a856-4497b4db817e admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:21.940539 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb4384-7078-48d1-82a9-8dd2479cb46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:21.941169 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb4384-7078-48d1-82a9-8dd2479cb46a admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:21.941453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb4384-7078-48d1-82a9-8dd2479cb46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:21.941731 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb4384-7078-48d1-82a9-8dd2479cb46a admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:21.942372 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb4384-7078-48d1-82a9-8dd2479cb46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:21.943982 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb4384-7078-48d1-82a9-8dd2479cb46a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:21.955582 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1125/2237] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:21.960311 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb4384-7078-48d1-82a9-8dd2479cb46a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:21.970601 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb4384-7078-48d1-82a9-8dd2479cb46a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:21.975445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288701d-cb01-405b-93ba-58037deacf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:21.976080 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288701d-cb01-405b-93ba-58037deacf5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:21.976359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288701d-cb01-405b-93ba-58037deacf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:21.976676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288701d-cb01-405b-93ba-58037deacf5d admin admin] PATH_INFO: `/v3/projects/00fded00d4a7441a93e0fabf10ae1b45/users/12a64bbbdb664f03b3b295fe03ab9ee3/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:21.991639 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288701d-cb01-405b-93ba-58037deacf5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=00fded00d4a7441a93e0fabf10ae1b45, user_id=12a64bbbdb664f03b3b295fe03ab9ee3, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:21.994442 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288701d-cb01-405b-93ba-58037deacf5d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:22.027232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1113/2238] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:36:21 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:36:22.035065 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdac3c-1df8-4431-9cfe-712734d27590 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:22.116684 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1126/2239] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:21 2022] PUT /identity/v3/projects/00fded00d4a7441a93e0fabf10ae1b45/users/12a64bbbdb664f03b3b295fe03ab9ee3/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:36:22.122914 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdac3c-1df8-4431-9cfe-712734d27590 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:22.127769 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43234cf4-1683-4943-b6e5-3b0d5e56abd8 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:22.128674 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43234cf4-1683-4943-b6e5-3b0d5e56abd8 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:22.129178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43234cf4-1683-4943-b6e5-3b0d5e56abd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:22.213121 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-43234cf4-1683-4943-b6e5-3b0d5e56abd8 None None] MFA Rules not processed for user `12a64bbbdb664f03b3b295fe03ab9ee3`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:22.216038 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-43234cf4-1683-4943-b6e5-3b0d5e56abd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:22.243728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc9ab1-9672-4ce8-b52a-46d9249f2021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:22.244229 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc9ab1-9672-4ce8-b52a-46d9249f2021 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:22.253695 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc9ab1-9672-4ce8-b52a-46d9249f2021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:22.253695 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc9ab1-9672-4ce8-b52a-46d9249f2021 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:22.253695 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc9ab1-9672-4ce8-b52a-46d9249f2021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:22.253695 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc9ab1-9672-4ce8-b52a-46d9249f2021 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:22.314550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1127/2240] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:36:22.318921 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43234cf4-1683-4943-b6e5-3b0d5e56abd8 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:22.329883 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43234cf4-1683-4943-b6e5-3b0d5e56abd8 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:22.334421 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fe99a-4b51-46a7-8f58-5b084254a741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:22.335021 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fe99a-4b51-46a7-8f58-5b084254a741 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:22.335299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fe99a-4b51-46a7-8f58-5b084254a741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:22.337266 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fe99a-4b51-46a7-8f58-5b084254a741 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:22.337266 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fe99a-4b51-46a7-8f58-5b084254a741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:22.338110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fe99a-4b51-46a7-8f58-5b084254a741 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:22.365096 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1114/2241] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:36:22 2022] POST /identity/v3/users => generated 289 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:36:22.367840 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc9ab1-9672-4ce8-b52a-46d9249f2021 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:22.378509 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc9ab1-9672-4ce8-b52a-46d9249f2021 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:22.384955 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed799a3-2999-47b2-8665-d8b93b03abff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:22.385749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed799a3-2999-47b2-8665-d8b93b03abff admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:22.385936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed799a3-2999-47b2-8665-d8b93b03abff admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:22.386204 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed799a3-2999-47b2-8665-d8b93b03abff admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:22.386868 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed799a3-2999-47b2-8665-d8b93b03abff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:22.388573 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed799a3-2999-47b2-8665-d8b93b03abff admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:22.400836 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1115/2242] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:36:22.405344 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed799a3-2999-47b2-8665-d8b93b03abff admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:22.415167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed799a3-2999-47b2-8665-d8b93b03abff admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:22.421800 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfbd19-211d-4b00-8994-fc424a943630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:22.422971 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfbd19-211d-4b00-8994-fc424a943630 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:22.423244 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfbd19-211d-4b00-8994-fc424a943630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:22.429266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfbd19-211d-4b00-8994-fc424a943630 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:22.429266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfbd19-211d-4b00-8994-fc424a943630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:22.429266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfbd19-211d-4b00-8994-fc424a943630 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:22.438211 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1116/2243] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:36:22.442411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfbd19-211d-4b00-8994-fc424a943630 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:22.451991 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfbd19-211d-4b00-8994-fc424a943630 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:22.457776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f419871-9685-4ff1-a2d2-472060811868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:22.458411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f419871-9685-4ff1-a2d2-472060811868 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:22.458800 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f419871-9685-4ff1-a2d2-472060811868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:22.459075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f419871-9685-4ff1-a2d2-472060811868 admin admin] PATH_INFO: `/v3/projects/a7a66e3439e64c8f805234a1a5fa147b/users/3ee94709026b4f259ae7b416dc1afc0a/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:22.471801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1128/2244] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:36:22 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:36:22.475514 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fe99a-4b51-46a7-8f58-5b084254a741 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:22.480407 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f419871-9685-4ff1-a2d2-472060811868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a66e3439e64c8f805234a1a5fa147b, user_id=3ee94709026b4f259ae7b416dc1afc0a, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:22.483141 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f419871-9685-4ff1-a2d2-472060811868 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:22.574234 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fe99a-4b51-46a7-8f58-5b084254a741 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:22.574234 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5046ae-af7d-4ae7-8253-5d4b9dd55ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:22.574234 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5046ae-af7d-4ae7-8253-5d4b9dd55ccd admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:22.574234 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5046ae-af7d-4ae7-8253-5d4b9dd55ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:22.574773 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5046ae-af7d-4ae7-8253-5d4b9dd55ccd admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:22.574773 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5046ae-af7d-4ae7-8253-5d4b9dd55ccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:22.574773 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5046ae-af7d-4ae7-8253-5d4b9dd55ccd admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:22.814582 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:22.815652 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1117/2245] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:22 2022] PUT /identity/v3/projects/a7a66e3439e64c8f805234a1a5fa147b/users/3ee94709026b4f259ae7b416dc1afc0a/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:36:22.818512 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1129/2246] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:36:22 2022] POST /identity/v3/users => generated 297 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:22.823092 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f419871-9685-4ff1-a2d2-472060811868 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:22.823298 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50840099-8b8a-4d69-ba36-4a5813456e52 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:22.823548 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50840099-8b8a-4d69-ba36-4a5813456e52 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:22.824200 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50840099-8b8a-4d69-ba36-4a5813456e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:22.909466 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-50840099-8b8a-4d69-ba36-4a5813456e52 None None] MFA Rules not processed for user `3ee94709026b4f259ae7b416dc1afc0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:22.917598 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-50840099-8b8a-4d69-ba36-4a5813456e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:22.950686 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f419871-9685-4ff1-a2d2-472060811868 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:22.957330 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7bef3-ab0a-4454-bec3-08f80a73f7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:22.958130 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7bef3-ab0a-4454-bec3-08f80a73f7cf admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:22.958631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7bef3-ab0a-4454-bec3-08f80a73f7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:22.959081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7bef3-ab0a-4454-bec3-08f80a73f7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:22.960152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7bef3-ab0a-4454-bec3-08f80a73f7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:22.962052 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7bef3-ab0a-4454-bec3-08f80a73f7cf admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:22.977120 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1118/2247] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:22.980404 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7bef3-ab0a-4454-bec3-08f80a73f7cf admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:22.993954 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7bef3-ab0a-4454-bec3-08f80a73f7cf admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:23.008874 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1130/2248] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:36:23.010334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50840099-8b8a-4d69-ba36-4a5813456e52 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:23.015105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e75b5f-d1d5-4bfb-9ce2-583fc1289936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:23.016356 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e75b5f-d1d5-4bfb-9ce2-583fc1289936 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:23.016698 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e75b5f-d1d5-4bfb-9ce2-583fc1289936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:23.016928 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e75b5f-d1d5-4bfb-9ce2-583fc1289936 admin admin] PATH_INFO: `/v3/projects/cf1f2eb373b342d8bde866ddab18726a/users/c48cf1ed685c419998bbb890439b06fe/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:23.044749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e75b5f-d1d5-4bfb-9ce2-583fc1289936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf1f2eb373b342d8bde866ddab18726a, user_id=c48cf1ed685c419998bbb890439b06fe, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:23.046812 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50840099-8b8a-4d69-ba36-4a5813456e52 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:23.051741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e75b5f-d1d5-4bfb-9ce2-583fc1289936 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:23.055500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf6813-246b-4b5d-9e17-7e4b17224d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:23.056651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf6813-246b-4b5d-9e17-7e4b17224d71 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:23.057131 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf6813-246b-4b5d-9e17-7e4b17224d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:23.057509 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf6813-246b-4b5d-9e17-7e4b17224d71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:23.058324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf6813-246b-4b5d-9e17-7e4b17224d71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:23.060977 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf6813-246b-4b5d-9e17-7e4b17224d71 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:23.143036 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1119/2249] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:22 2022] PUT /identity/v3/projects/cf1f2eb373b342d8bde866ddab18726a/users/c48cf1ed685c419998bbb890439b06fe/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:36:23.147531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e75b5f-d1d5-4bfb-9ce2-583fc1289936 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:23.210058 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1131/2250] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:36:23 2022] POST /identity/v3/projects => generated 375 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:23.214141 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf6813-246b-4b5d-9e17-7e4b17224d71 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:23.248521 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e75b5f-d1d5-4bfb-9ce2-583fc1289936 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:23.329930 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf6813-246b-4b5d-9e17-7e4b17224d71 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:23.337655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeeabcb-8143-48e1-822c-1d9ac851c499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:23.339072 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeabcb-8143-48e1-822c-1d9ac851c499 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:23.339547 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeabcb-8143-48e1-822c-1d9ac851c499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:23.340023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeeabcb-8143-48e1-822c-1d9ac851c499 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:23.341198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeeabcb-8143-48e1-822c-1d9ac851c499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:23.343295 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeeabcb-8143-48e1-822c-1d9ac851c499 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:23.374067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a56ae-5db2-45e7-92ed-376906a61cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:23.374928 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a56ae-5db2-45e7-92ed-376906a61cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:23.375255 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a56ae-5db2-45e7-92ed-376906a61cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:23.375597 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a56ae-5db2-45e7-92ed-376906a61cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:23.376255 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a56ae-5db2-45e7-92ed-376906a61cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:23.377979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a56ae-5db2-45e7-92ed-376906a61cf6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:23.396928 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1120/2251] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:36:23.396928 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57502a-3330-42aa-95ba-f6bd8dfde6f3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:23.396928 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57502a-3330-42aa-95ba-f6bd8dfde6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:23.396928 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57502a-3330-42aa-95ba-f6bd8dfde6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:23.416651 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7b57502a-3330-42aa-95ba-f6bd8dfde6f3 None None] MFA Rules not processed for user `38c0666fea2948c29d94e297222e2df1`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:23.417944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7b57502a-3330-42aa-95ba-f6bd8dfde6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:23.471119 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1132/2252] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:36:23 2022] POST /identity/v3/users => generated 294 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:23.472030 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeeabcb-8143-48e1-822c-1d9ac851c499 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:23.483647 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeeabcb-8143-48e1-822c-1d9ac851c499 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:23.489731 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b865d-d088-456e-84dd-85cf566112a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:23.499203 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b865d-d088-456e-84dd-85cf566112a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:23.499203 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b865d-d088-456e-84dd-85cf566112a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:23.499203 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b865d-d088-456e-84dd-85cf566112a5 admin admin] PATH_INFO: `/v3/projects/cf1f2eb373b342d8bde866ddab18726a/users/c48cf1ed685c419998bbb890439b06fe/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:23.499203 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b865d-d088-456e-84dd-85cf566112a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf1f2eb373b342d8bde866ddab18726a, user_id=c48cf1ed685c419998bbb890439b06fe, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:23.499203 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b865d-d088-456e-84dd-85cf566112a5 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:23.501461 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1121/2253] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:23.502424 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57502a-3330-42aa-95ba-f6bd8dfde6f3 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:23.511152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1133/2254] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:23 2022] PUT /identity/v3/projects/cf1f2eb373b342d8bde866ddab18726a/users/c48cf1ed685c419998bbb890439b06fe/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:23.522319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57502a-3330-42aa-95ba-f6bd8dfde6f3 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:23.523810 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39877244-57d4-47b7-b168-bb5ad87e277c None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:23.524232 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39877244-57d4-47b7-b168-bb5ad87e277c None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:23.524506 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39877244-57d4-47b7-b168-bb5ad87e277c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:23.560138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-39877244-57d4-47b7-b168-bb5ad87e277c None None] MFA Rules not processed for user `c48cf1ed685c419998bbb890439b06fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:23.561906 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-39877244-57d4-47b7-b168-bb5ad87e277c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:23.587351 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21435356-5f94-4a06-88c8-23f0e40218b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:23.587977 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21435356-5f94-4a06-88c8-23f0e40218b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:23.588893 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21435356-5f94-4a06-88c8-23f0e40218b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:23.589203 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21435356-5f94-4a06-88c8-23f0e40218b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:23.590037 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21435356-5f94-4a06-88c8-23f0e40218b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:23.592166 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21435356-5f94-4a06-88c8-23f0e40218b2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:23.604693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1122/2255] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:23.608585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21435356-5f94-4a06-88c8-23f0e40218b2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:23.624307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21435356-5f94-4a06-88c8-23f0e40218b2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:23.629497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305fe0d-3210-4b20-a4ca-a79c47b85170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:23.630229 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305fe0d-3210-4b20-a4ca-a79c47b85170 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:23.630801 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305fe0d-3210-4b20-a4ca-a79c47b85170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:23.630932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305fe0d-3210-4b20-a4ca-a79c47b85170 admin admin] PATH_INFO: `/v3/projects/74899cee462841e69e725b2643f958b0/users/326b04bb5436402f80ed040bb303a6b4/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:23.652098 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305fe0d-3210-4b20-a4ca-a79c47b85170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74899cee462841e69e725b2643f958b0, user_id=326b04bb5436402f80ed040bb303a6b4, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:23.655361 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305fe0d-3210-4b20-a4ca-a79c47b85170 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:23.688461 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1134/2256] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:23.702697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39877244-57d4-47b7-b168-bb5ad87e277c None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:23.712416 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-39877244-57d4-47b7-b168-bb5ad87e277c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:23.784887 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1123/2257] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:23 2022] PUT /identity/v3/projects/74899cee462841e69e725b2643f958b0/users/326b04bb5436402f80ed040bb303a6b4/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:36:23.792448 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305fe0d-3210-4b20-a4ca-a79c47b85170 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:23.825854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39877244-57d4-47b7-b168-bb5ad87e277c None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:23.892316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305fe0d-3210-4b20-a4ca-a79c47b85170 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:23.894296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e246e-598f-4e53-8560-be5f025af2bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:23.894933 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e246e-598f-4e53-8560-be5f025af2bc service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:23.895237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e246e-598f-4e53-8560-be5f025af2bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:23.895542 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e246e-598f-4e53-8560-be5f025af2bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:23.899764 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c20153-7cf0-4d42-b899-846d70d0b91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:23.900470 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c20153-7cf0-4d42-b899-846d70d0b91c admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:23.900835 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c20153-7cf0-4d42-b899-846d70d0b91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:23.901610 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c20153-7cf0-4d42-b899-846d70d0b91c admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:23.903269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c20153-7cf0-4d42-b899-846d70d0b91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:23.904887 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c20153-7cf0-4d42-b899-846d70d0b91c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:23.918509 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1124/2258] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:23.923548 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c20153-7cf0-4d42-b899-846d70d0b91c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:23.958848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c20153-7cf0-4d42-b899-846d70d0b91c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:23.964945 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbf742-cff9-4824-8fdd-8c212ede4f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:23.970727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbf742-cff9-4824-8fdd-8c212ede4f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:23.970727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbf742-cff9-4824-8fdd-8c212ede4f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:23.970727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbf742-cff9-4824-8fdd-8c212ede4f6c admin admin] PATH_INFO: `/v3/projects/74899cee462841e69e725b2643f958b0/users/326b04bb5436402f80ed040bb303a6b4/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:23.970727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbf742-cff9-4824-8fdd-8c212ede4f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=74899cee462841e69e725b2643f958b0, user_id=326b04bb5436402f80ed040bb303a6b4, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:23.971756 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbf742-cff9-4824-8fdd-8c212ede4f6c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:23.997400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1125/2259] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:23 2022] PUT /identity/v3/projects/74899cee462841e69e725b2643f958b0/users/326b04bb5436402f80ed040bb303a6b4/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:23.997496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e246e-598f-4e53-8560-be5f025af2bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:23.997496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e246e-598f-4e53-8560-be5f025af2bc service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:24.007009 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1f48a-e208-43b2-bf81-ada90050f81d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:24.007455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1f48a-e208-43b2-bf81-ada90050f81d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:24.007732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1f48a-e208-43b2-bf81-ada90050f81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:24.011012 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1135/2260] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:24.048953 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a2d1f48a-e208-43b2-bf81-ada90050f81d None None] MFA Rules not processed for user `326b04bb5436402f80ed040bb303a6b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:24.052400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a2d1f48a-e208-43b2-bf81-ada90050f81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:24.122941 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1126/2261] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:24.153672 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e246e-598f-4e53-8560-be5f025af2bc service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:24.163783 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e246e-598f-4e53-8560-be5f025af2bc service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:24.230954 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ad0d4-c8fa-4a40-83bd-0d00a07e1177 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:24.231570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ad0d4-c8fa-4a40-83bd-0d00a07e1177 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:24.231844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ad0d4-c8fa-4a40-83bd-0d00a07e1177 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:24.232262 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ad0d4-c8fa-4a40-83bd-0d00a07e1177 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:24.303505 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ad0d4-c8fa-4a40-83bd-0d00a07e1177 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:24.304997 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ad0d4-c8fa-4a40-83bd-0d00a07e1177 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:24.314909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1136/2262] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:24.381435 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:24.766981 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1f48a-e208-43b2-bf81-ada90050f81d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:24.883296 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1f48a-e208-43b2-bf81-ada90050f81d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:24.887982 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccd40c-941e-4e55-b6b1-e27ce694ccd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:24.888618 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccd40c-941e-4e55-b6b1-e27ce694ccd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:24.888952 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccd40c-941e-4e55-b6b1-e27ce694ccd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:24.889196 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccd40c-941e-4e55-b6b1-e27ce694ccd8 admin admin] PATH_INFO: `/v3/users/12a64bbbdb664f03b3b295fe03ab9ee3` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:24.890450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccd40c-941e-4e55-b6b1-e27ce694ccd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12a64bbbdb664f03b3b295fe03ab9ee3)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:24.892651 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccd40c-941e-4e55-b6b1-e27ce694ccd8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:25.194253 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-efccd40c-941e-4e55-b6b1-e27ce694ccd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12a64bbbdb664f03b3b295fe03ab9ee3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:25.194929 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-efccd40c-941e-4e55-b6b1-e27ce694ccd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12a64bbbdb664f03b3b295fe03ab9ee3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:25.278649 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-efccd40c-941e-4e55-b6b1-e27ce694ccd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12a64bbbdb664f03b3b295fe03ab9ee3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:25.295995 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-efccd40c-941e-4e55-b6b1-e27ce694ccd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12a64bbbdb664f03b3b295fe03ab9ee3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:25.296892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-efccd40c-941e-4e55-b6b1-e27ce694ccd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12a64bbbdb664f03b3b295fe03ab9ee3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:25.301911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:25.319265 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1127/2263] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:36:24 2022] DELETE /identity/v3/users/12a64bbbdb664f03b3b295fe03ab9ee3 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:25.321132 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecba55e-3b61-4a17-aa83-ffc3ea06d9a5 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:25.321493 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecba55e-3b61-4a17-aa83-ffc3ea06d9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:25.321837 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecba55e-3b61-4a17-aa83-ffc3ea06d9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:25.343131 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-fecba55e-3b61-4a17-aa83-ffc3ea06d9a5 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:25.345085 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fecba55e-3b61-4a17-aa83-ffc3ea06d9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:25.419361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1137/2264] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:36:25.429515 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccd40c-941e-4e55-b6b1-e27ce694ccd8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:25.430950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-efccd40c-941e-4e55-b6b1-e27ce694ccd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:25.503620 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccd40c-941e-4e55-b6b1-e27ce694ccd8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:25.508968 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812938e3-d587-4fd0-a491-d769026ace44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:25.513865 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812938e3-d587-4fd0-a491-d769026ace44 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:25.514212 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812938e3-d587-4fd0-a491-d769026ace44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:25.514522 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812938e3-d587-4fd0-a491-d769026ace44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:25.525842 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812938e3-d587-4fd0-a491-d769026ace44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:25.527376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812938e3-d587-4fd0-a491-d769026ace44 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:25.539113 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1128/2265] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:26.198158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecba55e-3b61-4a17-aa83-ffc3ea06d9a5 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:26.199801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fecba55e-3b61-4a17-aa83-ffc3ea06d9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:26.212462 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecba55e-3b61-4a17-aa83-ffc3ea06d9a5 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:26.226044 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08c0d3-f831-423f-b639-9ad957a1ef2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:26.227167 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08c0d3-f831-423f-b639-9ad957a1ef2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:26.227167 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08c0d3-f831-423f-b639-9ad957a1ef2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:26.227393 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08c0d3-f831-423f-b639-9ad957a1ef2c admin admin] PATH_INFO: `/v3/projects/00fded00d4a7441a93e0fabf10ae1b45` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:26.228517 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08c0d3-f831-423f-b639-9ad957a1ef2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=00fded00d4a7441a93e0fabf10ae1b45)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:26.230603 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08c0d3-f831-423f-b639-9ad957a1ef2c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:26.405543 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-af08c0d3-f831-423f-b639-9ad957a1ef2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00fded00d4a7441a93e0fabf10ae1b45', 'request_id': 'req-af08c0d3-f831-423f-b639-9ad957a1ef2c'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:26.411962 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-af08c0d3-f831-423f-b639-9ad957a1ef2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00fded00d4a7441a93e0fabf10ae1b45', 'request_id': 'req-af08c0d3-f831-423f-b639-9ad957a1ef2c'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:26.491219 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-af08c0d3-f831-423f-b639-9ad957a1ef2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00fded00d4a7441a93e0fabf10ae1b45', 'request_id': 'req-af08c0d3-f831-423f-b639-9ad957a1ef2c'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:26.506808 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-af08c0d3-f831-423f-b639-9ad957a1ef2c admin admin] The token cache is being invalidate because project 00fded00d4a7441a93e0fabf10ae1b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:36:26.507344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-af08c0d3-f831-423f-b639-9ad957a1ef2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:26.508084 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-af08c0d3-f831-423f-b639-9ad957a1ef2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:26.509776 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1138/2266] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:36:26 2022] DELETE /identity/v3/projects/00fded00d4a7441a93e0fabf10ae1b45 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:26.513919 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812938e3-d587-4fd0-a491-d769026ace44 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:26.526474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812938e3-d587-4fd0-a491-d769026ace44 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:26.605791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc5090-6a1b-49cf-964d-1bced7fa8a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:26.605791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc5090-6a1b-49cf-964d-1bced7fa8a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:26.605791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc5090-6a1b-49cf-964d-1bced7fa8a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:26.605791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc5090-6a1b-49cf-964d-1bced7fa8a73 admin admin] PATH_INFO: `/v3/users/c48cf1ed685c419998bbb890439b06fe` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:26.606653 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc5090-6a1b-49cf-964d-1bced7fa8a73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c48cf1ed685c419998bbb890439b06fe)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:26.608597 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc5090-6a1b-49cf-964d-1bced7fa8a73 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:26.798826 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:26.812662 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ebfc5090-6a1b-49cf-964d-1bced7fa8a73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c48cf1ed685c419998bbb890439b06fe'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:26.813329 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ebfc5090-6a1b-49cf-964d-1bced7fa8a73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c48cf1ed685c419998bbb890439b06fe'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:26.918386 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:26.934982 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ebfc5090-6a1b-49cf-964d-1bced7fa8a73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c48cf1ed685c419998bbb890439b06fe'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:26.947804 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ebfc5090-6a1b-49cf-964d-1bced7fa8a73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c48cf1ed685c419998bbb890439b06fe'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:26.948452 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ebfc5090-6a1b-49cf-964d-1bced7fa8a73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c48cf1ed685c419998bbb890439b06fe'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:26.961758 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1129/2267] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:36:26 2022] DELETE /identity/v3/users/c48cf1ed685c419998bbb890439b06fe => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:27.510976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:27.571399 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08c0d3-f831-423f-b639-9ad957a1ef2c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:27.574350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-af08c0d3-f831-423f-b639-9ad957a1ef2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:27.603323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08c0d3-f831-423f-b639-9ad957a1ef2c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:27.742731 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b2ba6-daed-4acd-8695-1b27a2245e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:27.743389 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b2ba6-daed-4acd-8695-1b27a2245e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:27.743678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b2ba6-daed-4acd-8695-1b27a2245e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:27.743944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b2ba6-daed-4acd-8695-1b27a2245e7a admin admin] PATH_INFO: `/v3/projects/cf1f2eb373b342d8bde866ddab18726a` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:27.745122 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b2ba6-daed-4acd-8695-1b27a2245e7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf1f2eb373b342d8bde866ddab18726a)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:27.747383 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b2ba6-daed-4acd-8695-1b27a2245e7a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:27.920105 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-869b2ba6-daed-4acd-8695-1b27a2245e7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf1f2eb373b342d8bde866ddab18726a', 'request_id': 'req-869b2ba6-daed-4acd-8695-1b27a2245e7a'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:27.926685 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-869b2ba6-daed-4acd-8695-1b27a2245e7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf1f2eb373b342d8bde866ddab18726a', 'request_id': 'req-869b2ba6-daed-4acd-8695-1b27a2245e7a'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:27.969911 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc5090-6a1b-49cf-964d-1bced7fa8a73 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:27.971673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ebfc5090-6a1b-49cf-964d-1bced7fa8a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:28.035274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc5090-6a1b-49cf-964d-1bced7fa8a73 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:28.054948 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-869b2ba6-daed-4acd-8695-1b27a2245e7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf1f2eb373b342d8bde866ddab18726a', 'request_id': 'req-869b2ba6-daed-4acd-8695-1b27a2245e7a'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:28.081360 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-869b2ba6-daed-4acd-8695-1b27a2245e7a admin admin] The token cache is being invalidate because project cf1f2eb373b342d8bde866ddab18726a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:36:28.081805 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-869b2ba6-daed-4acd-8695-1b27a2245e7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:28.082476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-869b2ba6-daed-4acd-8695-1b27a2245e7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:28.084109 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1139/2268] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:36:27 2022] DELETE /identity/v3/projects/cf1f2eb373b342d8bde866ddab18726a => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:28.090431 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e853cd-4556-49c9-965a-785abec71120 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:28.090704 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e853cd-4556-49c9-965a-785abec71120 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:28.090972 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e853cd-4556-49c9-965a-785abec71120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:28.101100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71865b-4c71-4c81-a250-42d6b5733211 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:28.101100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71865b-4c71-4c81-a250-42d6b5733211 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:28.101358 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71865b-4c71-4c81-a250-42d6b5733211 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:28.101597 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71865b-4c71-4c81-a250-42d6b5733211 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:28.103312 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7a71865b-4c71-4c81-a250-42d6b5733211 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:28.116372 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-92e853cd-4556-49c9-965a-785abec71120 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:28.117869 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-92e853cd-4556-49c9-965a-785abec71120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:28.168395 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71865b-4c71-4c81-a250-42d6b5733211 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:28.169902 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71865b-4c71-4c81-a250-42d6b5733211 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:28.179906 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1130/2269] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:28.193876 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1140/2270] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:28.204338 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4e3ef-fbbd-40f8-bef5-88ffd8d9d024 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:28.204992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4e3ef-fbbd-40f8-bef5-88ffd8d9d024 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:28.210262 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4e3ef-fbbd-40f8-bef5-88ffd8d9d024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:28.227983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-89b4e3ef-fbbd-40f8-bef5-88ffd8d9d024 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:28.233323 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-89b4e3ef-fbbd-40f8-bef5-88ffd8d9d024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:28.242949 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1131/2271] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:28.247284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e853cd-4556-49c9-965a-785abec71120 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:28.257534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e853cd-4556-49c9-965a-785abec71120 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:28.262207 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e4f2c-eb96-4cb1-9377-78bda977f9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:28.262803 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e4f2c-eb96-4cb1-9377-78bda977f9cb admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:28.263084 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e4f2c-eb96-4cb1-9377-78bda977f9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:28.263356 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e4f2c-eb96-4cb1-9377-78bda977f9cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:28.264002 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e4f2c-eb96-4cb1-9377-78bda977f9cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:36:28.264305 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e4f2c-eb96-4cb1-9377-78bda977f9cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:28.266057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e4f2c-eb96-4cb1-9377-78bda977f9cb admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:28.278160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1141/2272] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:36:28.283332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4e3ef-fbbd-40f8-bef5-88ffd8d9d024 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:28.293019 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4e3ef-fbbd-40f8-bef5-88ffd8d9d024 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:28.299905 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90f2f4-de2b-4f70-821e-9c81189b5e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:28.300512 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90f2f4-de2b-4f70-821e-9c81189b5e31 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:28.300790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90f2f4-de2b-4f70-821e-9c81189b5e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:28.301084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90f2f4-de2b-4f70-821e-9c81189b5e31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:28.301724 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90f2f4-de2b-4f70-821e-9c81189b5e31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:28.303657 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90f2f4-de2b-4f70-821e-9c81189b5e31 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:28.454912 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1132/2273] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:36:28 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:28.457578 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e4f2c-eb96-4cb1-9377-78bda977f9cb admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:28.481565 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e4f2c-eb96-4cb1-9377-78bda977f9cb admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:28.594822 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477a04e-5806-46da-810e-b5ffa96d4b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:28.595484 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477a04e-5806-46da-810e-b5ffa96d4b84 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:28.595898 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477a04e-5806-46da-810e-b5ffa96d4b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:28.596025 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477a04e-5806-46da-810e-b5ffa96d4b84 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:28.596630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477a04e-5806-46da-810e-b5ffa96d4b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:28.598859 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3477a04e-5806-46da-810e-b5ffa96d4b84 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:28.788960 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1142/2274] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:36:28 2022] POST /identity/v3/users => generated 287 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:28.791653 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90f2f4-de2b-4f70-821e-9c81189b5e31 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:28.803978 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90f2f4-de2b-4f70-821e-9c81189b5e31 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:28.809564 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8db6b3-6220-4914-8cb0-cc26d95652e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:28.810169 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8db6b3-6220-4914-8cb0-cc26d95652e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:28.810603 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8db6b3-6220-4914-8cb0-cc26d95652e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:28.810880 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8db6b3-6220-4914-8cb0-cc26d95652e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:28.811526 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8db6b3-6220-4914-8cb0-cc26d95652e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:28.813157 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8db6b3-6220-4914-8cb0-cc26d95652e2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:28.824211 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1133/2275] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:28.828323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477a04e-5806-46da-810e-b5ffa96d4b84 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:28.839098 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477a04e-5806-46da-810e-b5ffa96d4b84 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:28.845481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0f9c9-8717-401c-9a3b-7ab0f517e6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:28.846084 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0f9c9-8717-401c-9a3b-7ab0f517e6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:28.846913 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0f9c9-8717-401c-9a3b-7ab0f517e6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:28.846913 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0f9c9-8717-401c-9a3b-7ab0f517e6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:28.847531 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0f9c9-8717-401c-9a3b-7ab0f517e6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:28.849718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0f9c9-8717-401c-9a3b-7ab0f517e6b1 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:28.861468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1143/2276] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:36:28.865841 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8db6b3-6220-4914-8cb0-cc26d95652e2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:28.875895 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8db6b3-6220-4914-8cb0-cc26d95652e2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:28.880402 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20404dfb-3b19-4952-8f5f-d63cf8a32067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:28.881047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20404dfb-3b19-4952-8f5f-d63cf8a32067 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:28.881353 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20404dfb-3b19-4952-8f5f-d63cf8a32067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:28.881623 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20404dfb-3b19-4952-8f5f-d63cf8a32067 admin admin] PATH_INFO: `/v3/projects/768236d2680f4b86864ad13d1cdf2d0a/users/3ccf02bba03b4a99bd8e0d0d8405d875/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:28.897998 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20404dfb-3b19-4952-8f5f-d63cf8a32067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=768236d2680f4b86864ad13d1cdf2d0a, user_id=3ccf02bba03b4a99bd8e0d0d8405d875, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:28.900719 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20404dfb-3b19-4952-8f5f-d63cf8a32067 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:29.005250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1134/2277] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:28 2022] PUT /identity/v3/projects/768236d2680f4b86864ad13d1cdf2d0a/users/3ccf02bba03b4a99bd8e0d0d8405d875/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:29.017883 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5736e-1011-4bc9-9a8c-76511207ca2e None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:29.018143 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5736e-1011-4bc9-9a8c-76511207ca2e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:29.018425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5736e-1011-4bc9-9a8c-76511207ca2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:29.057285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-17f5736e-1011-4bc9-9a8c-76511207ca2e None None] MFA Rules not processed for user `3ccf02bba03b4a99bd8e0d0d8405d875`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:29.057285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-17f5736e-1011-4bc9-9a8c-76511207ca2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:29.106287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:29.128853 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1144/2278] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:29.145847 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20404dfb-3b19-4952-8f5f-d63cf8a32067 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:29.147696 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-20404dfb-3b19-4952-8f5f-d63cf8a32067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:29.213822 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20404dfb-3b19-4952-8f5f-d63cf8a32067 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:29.217618 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35551155-9230-4102-828a-de9950e741d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:29.218188 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35551155-9230-4102-828a-de9950e741d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:29.218469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35551155-9230-4102-828a-de9950e741d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:29.218883 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35551155-9230-4102-828a-de9950e741d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:29.227606 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35551155-9230-4102-828a-de9950e741d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:29.229200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35551155-9230-4102-828a-de9950e741d4 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:29.239504 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1135/2279] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:29.278132 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5736e-1011-4bc9-9a8c-76511207ca2e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:29.356626 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5736e-1011-4bc9-9a8c-76511207ca2e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:29.361943 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370d81a-fb12-4daa-bff9-1e3384f9bb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:29.362580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370d81a-fb12-4daa-bff9-1e3384f9bb84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:29.362863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370d81a-fb12-4daa-bff9-1e3384f9bb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:29.363136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370d81a-fb12-4daa-bff9-1e3384f9bb84 admin admin] PATH_INFO: `/v3/users/3ccf02bba03b4a99bd8e0d0d8405d875` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:29.364277 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370d81a-fb12-4daa-bff9-1e3384f9bb84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ccf02bba03b4a99bd8e0d0d8405d875)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:29.366267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370d81a-fb12-4daa-bff9-1e3384f9bb84 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:29.749652 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5370d81a-fb12-4daa-bff9-1e3384f9bb84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ccf02bba03b4a99bd8e0d0d8405d875'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:29.875769 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5370d81a-fb12-4daa-bff9-1e3384f9bb84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ccf02bba03b4a99bd8e0d0d8405d875'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:29.890335 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5370d81a-fb12-4daa-bff9-1e3384f9bb84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ccf02bba03b4a99bd8e0d0d8405d875'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:29.891721 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5370d81a-fb12-4daa-bff9-1e3384f9bb84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ccf02bba03b4a99bd8e0d0d8405d875'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:29.899453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5370d81a-fb12-4daa-bff9-1e3384f9bb84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ccf02bba03b4a99bd8e0d0d8405d875'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:29.907527 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1145/2280] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:36:29 2022] DELETE /identity/v3/users/3ccf02bba03b4a99bd8e0d0d8405d875 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:29.917500 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62e683-4926-4a57-9bce-07377db71abe None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:29.917771 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62e683-4926-4a57-9bce-07377db71abe None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:29.918043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62e683-4926-4a57-9bce-07377db71abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:29.929973 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:29.938706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-db62e683-4926-4a57-9bce-07377db71abe None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:29.939945 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-db62e683-4926-4a57-9bce-07377db71abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:30.019457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1136/2281] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:30.030149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370d81a-fb12-4daa-bff9-1e3384f9bb84 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:30.032240 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5370d81a-fb12-4daa-bff9-1e3384f9bb84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:30.156825 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370d81a-fb12-4daa-bff9-1e3384f9bb84 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:30.156825 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8846560-388d-4af7-a132-44ca5b08a4aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:30.156825 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8846560-388d-4af7-a132-44ca5b08a4aa service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:30.156825 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8846560-388d-4af7-a132-44ca5b08a4aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:30.158012 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8846560-388d-4af7-a132-44ca5b08a4aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:30.181508 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8846560-388d-4af7-a132-44ca5b08a4aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:30.184002 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8846560-388d-4af7-a132-44ca5b08a4aa service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:30.206637 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1146/2282] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:30.404487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62e683-4926-4a57-9bce-07377db71abe None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:30.405945 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-db62e683-4926-4a57-9bce-07377db71abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:30.473101 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62e683-4926-4a57-9bce-07377db71abe None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:30.477854 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcebaa-b091-4ead-a063-edf8023eae0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:30.478556 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcebaa-b091-4ead-a063-edf8023eae0c service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:30.479293 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcebaa-b091-4ead-a063-edf8023eae0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:30.479293 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcebaa-b091-4ead-a063-edf8023eae0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:30.481442 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-92fcebaa-b091-4ead-a063-edf8023eae0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:30.561891 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcebaa-b091-4ead-a063-edf8023eae0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:30.563979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcebaa-b091-4ead-a063-edf8023eae0c service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:30.575725 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1137/2283] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:30.982528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8846560-388d-4af7-a132-44ca5b08a4aa service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:30.986438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a8846560-388d-4af7-a132-44ca5b08a4aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:31.003112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8846560-388d-4af7-a132-44ca5b08a4aa service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:31.009521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c81cbd-cf5e-4ab1-b7f0-a03910c336ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:31.010212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c81cbd-cf5e-4ab1-b7f0-a03910c336ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:31.010536 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c81cbd-cf5e-4ab1-b7f0-a03910c336ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:31.010809 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c81cbd-cf5e-4ab1-b7f0-a03910c336ba admin admin] PATH_INFO: `/v3/projects/768236d2680f4b86864ad13d1cdf2d0a` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:31.011999 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c81cbd-cf5e-4ab1-b7f0-a03910c336ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=768236d2680f4b86864ad13d1cdf2d0a)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:31.014140 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c81cbd-cf5e-4ab1-b7f0-a03910c336ba admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:31.178999 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-00c81cbd-cf5e-4ab1-b7f0-a03910c336ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '768236d2680f4b86864ad13d1cdf2d0a', 'request_id': 'req-00c81cbd-cf5e-4ab1-b7f0-a03910c336ba'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:31.185430 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-00c81cbd-cf5e-4ab1-b7f0-a03910c336ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '768236d2680f4b86864ad13d1cdf2d0a', 'request_id': 'req-00c81cbd-cf5e-4ab1-b7f0-a03910c336ba'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:31.318375 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-00c81cbd-cf5e-4ab1-b7f0-a03910c336ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '768236d2680f4b86864ad13d1cdf2d0a', 'request_id': 'req-00c81cbd-cf5e-4ab1-b7f0-a03910c336ba'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:31.330464 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-00c81cbd-cf5e-4ab1-b7f0-a03910c336ba admin admin] The token cache is being invalidate because project 768236d2680f4b86864ad13d1cdf2d0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:36:31.330694 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-00c81cbd-cf5e-4ab1-b7f0-a03910c336ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:31.331352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-00c81cbd-cf5e-4ab1-b7f0-a03910c336ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:31.332942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1147/2284] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:36:30 2022] DELETE /identity/v3/projects/768236d2680f4b86864ad13d1cdf2d0a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:36:31.338005 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ff29b-1cfc-40ea-8bd8-fbcc11dadc78 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:31.338561 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ff29b-1cfc-40ea-8bd8-fbcc11dadc78 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:31.338561 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ff29b-1cfc-40ea-8bd8-fbcc11dadc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:31.358822 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d19ff29b-1cfc-40ea-8bd8-fbcc11dadc78 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:31.360594 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d19ff29b-1cfc-40ea-8bd8-fbcc11dadc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:31.436787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1138/2285] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:31.447862 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19bdda-a6d5-4b88-b00f-0e351c636b90 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:31.448195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19bdda-a6d5-4b88-b00f-0e351c636b90 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:31.448343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19bdda-a6d5-4b88-b00f-0e351c636b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:31.470305 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-ab19bdda-a6d5-4b88-b00f-0e351c636b90 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:31.471629 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ab19bdda-a6d5-4b88-b00f-0e351c636b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:31.479602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1148/2286] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:36:31.484111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ff29b-1cfc-40ea-8bd8-fbcc11dadc78 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:31.494573 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ff29b-1cfc-40ea-8bd8-fbcc11dadc78 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:31.499251 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17110ba7-1f05-4598-bc0a-da9f956cf367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:31.499906 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17110ba7-1f05-4598-bc0a-da9f956cf367 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:31.500365 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17110ba7-1f05-4598-bc0a-da9f956cf367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:31.500811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17110ba7-1f05-4598-bc0a-da9f956cf367 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:31.501514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17110ba7-1f05-4598-bc0a-da9f956cf367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:36:31.501822 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17110ba7-1f05-4598-bc0a-da9f956cf367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:31.503440 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17110ba7-1f05-4598-bc0a-da9f956cf367 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:31.516298 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1139/2287] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:36:31.520739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19bdda-a6d5-4b88-b00f-0e351c636b90 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:31.530149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19bdda-a6d5-4b88-b00f-0e351c636b90 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:31.535859 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8ef15-1819-4916-bf1a-672d7711894c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:31.536615 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8ef15-1819-4916-bf1a-672d7711894c admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:31.536995 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8ef15-1819-4916-bf1a-672d7711894c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:31.537475 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8ef15-1819-4916-bf1a-672d7711894c admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:31.538230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8ef15-1819-4916-bf1a-672d7711894c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:31.540329 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8ef15-1819-4916-bf1a-672d7711894c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:31.689583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:31.700084 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1149/2288] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:36:31 2022] POST /identity/v3/projects => generated 397 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:31.701201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17110ba7-1f05-4598-bc0a-da9f956cf367 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:31.711134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17110ba7-1f05-4598-bc0a-da9f956cf367 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:31.779354 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741aeb33-aa1a-4422-8f57-8bd7bf68d951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:31.779972 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aeb33-aa1a-4422-8f57-8bd7bf68d951 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:31.780253 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aeb33-aa1a-4422-8f57-8bd7bf68d951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:31.780548 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aeb33-aa1a-4422-8f57-8bd7bf68d951 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:31.782678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741aeb33-aa1a-4422-8f57-8bd7bf68d951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:31.784650 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741aeb33-aa1a-4422-8f57-8bd7bf68d951 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:31.946184 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1140/2289] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:36:31 2022] POST /identity/v3/users => generated 299 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:31.946277 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8ef15-1819-4916-bf1a-672d7711894c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:31.958006 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8ef15-1819-4916-bf1a-672d7711894c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:31.964531 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48580a-7f9e-4f9b-ae54-66899f59e7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:31.965443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48580a-7f9e-4f9b-ae54-66899f59e7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:31.965443 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48580a-7f9e-4f9b-ae54-66899f59e7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:31.969392 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48580a-7f9e-4f9b-ae54-66899f59e7e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:31.969392 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48580a-7f9e-4f9b-ae54-66899f59e7e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:31.969392 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48580a-7f9e-4f9b-ae54-66899f59e7e5 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:31.980190 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1150/2290] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:31.985050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741aeb33-aa1a-4422-8f57-8bd7bf68d951 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:31.995633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741aeb33-aa1a-4422-8f57-8bd7bf68d951 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:32.000392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd591823-a33f-46fb-a49c-7b493b10b1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:32.000992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd591823-a33f-46fb-a49c-7b493b10b1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:32.001367 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd591823-a33f-46fb-a49c-7b493b10b1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:32.001824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd591823-a33f-46fb-a49c-7b493b10b1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:32.002450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd591823-a33f-46fb-a49c-7b493b10b1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:32.004045 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd591823-a33f-46fb-a49c-7b493b10b1c1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:32.016397 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1141/2291] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:36:32.020532 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48580a-7f9e-4f9b-ae54-66899f59e7e5 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:32.031435 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48580a-7f9e-4f9b-ae54-66899f59e7e5 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:32.036545 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee887c0-b1ad-48f6-830d-ae05c2c0b35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:32.037235 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee887c0-b1ad-48f6-830d-ae05c2c0b35e admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:32.037515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee887c0-b1ad-48f6-830d-ae05c2c0b35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:32.037785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee887c0-b1ad-48f6-830d-ae05c2c0b35e admin admin] PATH_INFO: `/v3/projects/b7d5819dc56c4c53b8cf7647b576780f/users/42f7227f704041298d0912309117897f/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:32.053286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee887c0-b1ad-48f6-830d-ae05c2c0b35e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d5819dc56c4c53b8cf7647b576780f, user_id=42f7227f704041298d0912309117897f, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:32.055957 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee887c0-b1ad-48f6-830d-ae05c2c0b35e admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:32.176020 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1151/2292] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:32 2022] PUT /identity/v3/projects/b7d5819dc56c4c53b8cf7647b576780f/users/42f7227f704041298d0912309117897f/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:32.179978 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb9c9b-8ec4-4fbf-9e60-65768a789bf9 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:32.180341 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb9c9b-8ec4-4fbf-9e60-65768a789bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:32.180679 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb9c9b-8ec4-4fbf-9e60-65768a789bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:32.215580 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-21bb9c9b-8ec4-4fbf-9e60-65768a789bf9 None None] MFA Rules not processed for user `42f7227f704041298d0912309117897f`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:32.217143 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-21bb9c9b-8ec4-4fbf-9e60-65768a789bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:32.298060 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1142/2293] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:32 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:32.519395 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee887c0-b1ad-48f6-830d-ae05c2c0b35e admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:32.521282 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-cee887c0-b1ad-48f6-830d-ae05c2c0b35e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:32.596720 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee887c0-b1ad-48f6-830d-ae05c2c0b35e admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:32.603109 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422a0e0-7e3e-4ef6-b17c-2c3d8851899f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:32.604333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422a0e0-7e3e-4ef6-b17c-2c3d8851899f service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:32.604960 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422a0e0-7e3e-4ef6-b17c-2c3d8851899f service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:32.605508 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422a0e0-7e3e-4ef6-b17c-2c3d8851899f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:32.620121 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422a0e0-7e3e-4ef6-b17c-2c3d8851899f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:32.622591 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422a0e0-7e3e-4ef6-b17c-2c3d8851899f service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:32.654205 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1152/2294] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:32 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:32.980848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:33.682973 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d9576-e90d-4999-b117-b96d6652b128 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:33.683429 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d9576-e90d-4999-b117-b96d6652b128 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:33.683795 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d9576-e90d-4999-b117-b96d6652b128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:33.710957 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f34d9576-e90d-4999-b117-b96d6652b128 None None] MFA Rules not processed for user `c74f8acfc15647f4b3606bc46fb16992`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:33.712166 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f34d9576-e90d-4999-b117-b96d6652b128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:33.809666 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1143/2295] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:36:34.043583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:35.525270 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fad3f3-2d29-42de-ac5f-da4358f2deef None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:35.525774 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fad3f3-2d29-42de-ac5f-da4358f2deef None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:35.525774 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fad3f3-2d29-42de-ac5f-da4358f2deef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:35.549021 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d1fad3f3-2d29-42de-ac5f-da4358f2deef None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:35.550629 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d1fad3f3-2d29-42de-ac5f-da4358f2deef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:35.619521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1153/2296] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Sep 5 14:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:35.643560 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d9576-e90d-4999-b117-b96d6652b128 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:35.645102 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f34d9576-e90d-4999-b117-b96d6652b128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:35.730391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d9576-e90d-4999-b117-b96d6652b128 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:35.736554 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485cba9-adc2-4a04-a89f-38e154601ea1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:35.737275 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485cba9-adc2-4a04-a89f-38e154601ea1 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:35.737614 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485cba9-adc2-4a04-a89f-38e154601ea1 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:35.737918 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485cba9-adc2-4a04-a89f-38e154601ea1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:35.747963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485cba9-adc2-4a04-a89f-38e154601ea1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:35.749693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485cba9-adc2-4a04-a89f-38e154601ea1 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:35.761249 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1144/2297] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:37.032616 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fad3f3-2d29-42de-ac5f-da4358f2deef None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:37.034203 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d1fad3f3-2d29-42de-ac5f-da4358f2deef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:37.049130 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fad3f3-2d29-42de-ac5f-da4358f2deef None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:37.054373 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd181750-ece2-4950-9764-bd57cf927890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:37.055112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd181750-ece2-4950-9764-bd57cf927890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:37.055357 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd181750-ece2-4950-9764-bd57cf927890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:37.055634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd181750-ece2-4950-9764-bd57cf927890 admin admin] PATH_INFO: `/v3/users/9f44c400611d4dff9f5b826776443b87` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:37.056803 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd181750-ece2-4950-9764-bd57cf927890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f44c400611d4dff9f5b826776443b87)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:37.059129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd181750-ece2-4950-9764-bd57cf927890 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:37.346682 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-cd181750-ece2-4950-9764-bd57cf927890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f44c400611d4dff9f5b826776443b87'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:37.460238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-cd181750-ece2-4950-9764-bd57cf927890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f44c400611d4dff9f5b826776443b87'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:37.475450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-cd181750-ece2-4950-9764-bd57cf927890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f44c400611d4dff9f5b826776443b87'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:37.476189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-cd181750-ece2-4950-9764-bd57cf927890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f44c400611d4dff9f5b826776443b87'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:37.483348 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-cd181750-ece2-4950-9764-bd57cf927890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f44c400611d4dff9f5b826776443b87'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:37.491465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1154/2298] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:36:37 2022] DELETE /identity/v3/users/9f44c400611d4dff9f5b826776443b87 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:37.494732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0fcca-e628-47ef-b720-db6b2e458e01 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:37.495271 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0fcca-e628-47ef-b720-db6b2e458e01 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:37.495394 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0fcca-e628-47ef-b720-db6b2e458e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:37.515203 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-0ca0fcca-e628-47ef-b720-db6b2e458e01 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:37.516888 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0ca0fcca-e628-47ef-b720-db6b2e458e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:37.581734 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1145/2299] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:36:37.591936 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd181750-ece2-4950-9764-bd57cf927890 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:37.593945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-cd181750-ece2-4950-9764-bd57cf927890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:37.680516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd181750-ece2-4950-9764-bd57cf927890 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:37.698616 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cf0bb-268d-4a93-a2b9-631edb3593b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:37.699395 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cf0bb-268d-4a93-a2b9-631edb3593b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:37.699577 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cf0bb-268d-4a93-a2b9-631edb3593b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:37.699820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cf0bb-268d-4a93-a2b9-631edb3593b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:37.715206 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cf0bb-268d-4a93-a2b9-631edb3593b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:37.715206 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cf0bb-268d-4a93-a2b9-631edb3593b7 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:37.728267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1155/2300] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:38.033601 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:38.291158 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0fcca-e628-47ef-b720-db6b2e458e01 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:38.295367 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0ca0fcca-e628-47ef-b720-db6b2e458e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:38.305621 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0fcca-e628-47ef-b720-db6b2e458e01 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:38.310564 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa39c8-180d-4299-80b8-87c083c3665e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:38.311207 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa39c8-180d-4299-80b8-87c083c3665e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:38.311475 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa39c8-180d-4299-80b8-87c083c3665e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:38.312589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa39c8-180d-4299-80b8-87c083c3665e admin admin] PATH_INFO: `/v3/projects/5d49c00c74c0478dbc859e42d4624e03` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:38.313785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa39c8-180d-4299-80b8-87c083c3665e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d49c00c74c0478dbc859e42d4624e03)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:38.316209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa39c8-180d-4299-80b8-87c083c3665e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:38.522930 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4efa39c8-180d-4299-80b8-87c083c3665e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d49c00c74c0478dbc859e42d4624e03', 'request_id': 'req-4efa39c8-180d-4299-80b8-87c083c3665e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:38.528432 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4efa39c8-180d-4299-80b8-87c083c3665e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d49c00c74c0478dbc859e42d4624e03', 'request_id': 'req-4efa39c8-180d-4299-80b8-87c083c3665e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:38.654548 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4efa39c8-180d-4299-80b8-87c083c3665e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d49c00c74c0478dbc859e42d4624e03', 'request_id': 'req-4efa39c8-180d-4299-80b8-87c083c3665e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:38.669584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4efa39c8-180d-4299-80b8-87c083c3665e admin admin] The token cache is being invalidate because project 5d49c00c74c0478dbc859e42d4624e03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:36:38.669584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4efa39c8-180d-4299-80b8-87c083c3665e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:38.669584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4efa39c8-180d-4299-80b8-87c083c3665e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:38.671142 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1146/2301] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:36:38 2022] DELETE /identity/v3/projects/5d49c00c74c0478dbc859e42d4624e03 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:38.675407 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cf0bb-268d-4a93-a2b9-631edb3593b7 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:38.685784 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cf0bb-268d-4a93-a2b9-631edb3593b7 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:38.755048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ba56d-3131-4bb2-87ef-7536c03aba32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:38.755922 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ba56d-3131-4bb2-87ef-7536c03aba32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:38.756200 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ba56d-3131-4bb2-87ef-7536c03aba32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:38.756470 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ba56d-3131-4bb2-87ef-7536c03aba32 admin admin] PATH_INFO: `/v3/users/3ee94709026b4f259ae7b416dc1afc0a` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:38.757658 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ba56d-3131-4bb2-87ef-7536c03aba32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ee94709026b4f259ae7b416dc1afc0a)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:38.759651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ba56d-3131-4bb2-87ef-7536c03aba32 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:39.064836 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-295ba56d-3131-4bb2-87ef-7536c03aba32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ee94709026b4f259ae7b416dc1afc0a'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:39.208977 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-295ba56d-3131-4bb2-87ef-7536c03aba32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ee94709026b4f259ae7b416dc1afc0a'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:39.223100 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-295ba56d-3131-4bb2-87ef-7536c03aba32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ee94709026b4f259ae7b416dc1afc0a'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:39.223809 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-295ba56d-3131-4bb2-87ef-7536c03aba32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ee94709026b4f259ae7b416dc1afc0a'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:39.235203 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-295ba56d-3131-4bb2-87ef-7536c03aba32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ee94709026b4f259ae7b416dc1afc0a'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:39.241979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1156/2302] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:36:38 2022] DELETE /identity/v3/users/3ee94709026b4f259ae7b416dc1afc0a => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:39.420897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:40.007883 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa39c8-180d-4299-80b8-87c083c3665e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:40.009407 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4efa39c8-180d-4299-80b8-87c083c3665e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:40.023441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa39c8-180d-4299-80b8-87c083c3665e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:40.082013 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82325d96-3be4-4cd1-a8ca-118b64fc362f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:40.082767 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82325d96-3be4-4cd1-a8ca-118b64fc362f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:40.083088 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82325d96-3be4-4cd1-a8ca-118b64fc362f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:40.084839 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82325d96-3be4-4cd1-a8ca-118b64fc362f admin admin] PATH_INFO: `/v3/projects/a7a66e3439e64c8f805234a1a5fa147b` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:40.087045 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82325d96-3be4-4cd1-a8ca-118b64fc362f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a66e3439e64c8f805234a1a5fa147b)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:40.089848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82325d96-3be4-4cd1-a8ca-118b64fc362f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:40.262076 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-82325d96-3be4-4cd1-a8ca-118b64fc362f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a66e3439e64c8f805234a1a5fa147b', 'request_id': 'req-82325d96-3be4-4cd1-a8ca-118b64fc362f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:40.269348 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-82325d96-3be4-4cd1-a8ca-118b64fc362f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a66e3439e64c8f805234a1a5fa147b', 'request_id': 'req-82325d96-3be4-4cd1-a8ca-118b64fc362f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:40.455485 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-82325d96-3be4-4cd1-a8ca-118b64fc362f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a66e3439e64c8f805234a1a5fa147b', 'request_id': 'req-82325d96-3be4-4cd1-a8ca-118b64fc362f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:40.468048 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-82325d96-3be4-4cd1-a8ca-118b64fc362f admin admin] The token cache is being invalidate because project a7a66e3439e64c8f805234a1a5fa147b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:36:40.469179 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-82325d96-3be4-4cd1-a8ca-118b64fc362f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:40.469811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-82325d96-3be4-4cd1-a8ca-118b64fc362f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:40.471321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1147/2303] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:36:40 2022] DELETE /identity/v3/projects/a7a66e3439e64c8f805234a1a5fa147b => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:40.476009 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ba56d-3131-4bb2-87ef-7536c03aba32 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:40.483855 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-295ba56d-3131-4bb2-87ef-7536c03aba32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:40.490299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ba56d-3131-4bb2-87ef-7536c03aba32 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:40.549484 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e84362-2298-4366-bd67-531106c2f413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:40.550105 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e84362-2298-4366-bd67-531106c2f413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:40.550381 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e84362-2298-4366-bd67-531106c2f413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:40.550723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e84362-2298-4366-bd67-531106c2f413 admin admin] PATH_INFO: `/v3/users/326b04bb5436402f80ed040bb303a6b4` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:40.551749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e84362-2298-4366-bd67-531106c2f413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=326b04bb5436402f80ed040bb303a6b4)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:40.553723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e84362-2298-4366-bd67-531106c2f413 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:40.802837 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d4e84362-2298-4366-bd67-531106c2f413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '326b04bb5436402f80ed040bb303a6b4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:40.938610 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d4e84362-2298-4366-bd67-531106c2f413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '326b04bb5436402f80ed040bb303a6b4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:40.951574 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d4e84362-2298-4366-bd67-531106c2f413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '326b04bb5436402f80ed040bb303a6b4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:40.952270 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d4e84362-2298-4366-bd67-531106c2f413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '326b04bb5436402f80ed040bb303a6b4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:40.959949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d4e84362-2298-4366-bd67-531106c2f413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '326b04bb5436402f80ed040bb303a6b4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:40.965864 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1157/2304] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:36:40 2022] DELETE /identity/v3/users/326b04bb5436402f80ed040bb303a6b4 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:41.031594 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e3f84-8d9f-4822-aea3-6ccf330e3f30 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:41.032563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e3f84-8d9f-4822-aea3-6ccf330e3f30 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:41.032842 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e3f84-8d9f-4822-aea3-6ccf330e3f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:41.054249 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4c7e3f84-8d9f-4822-aea3-6ccf330e3f30 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:41.056169 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4c7e3f84-8d9f-4822-aea3-6ccf330e3f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:41.119814 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1148/2305] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Sep 5 14:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:41.145264 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e84362-2298-4366-bd67-531106c2f413 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:41.146684 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d4e84362-2298-4366-bd67-531106c2f413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:41.225022 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e84362-2298-4366-bd67-531106c2f413 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:41.243539 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd7206-b2a4-45bc-bc96-b7f287aaadda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:41.244080 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd7206-b2a4-45bc-bc96-b7f287aaadda service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:41.244364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd7206-b2a4-45bc-bc96-b7f287aaadda service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:41.244637 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd7206-b2a4-45bc-bc96-b7f287aaadda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:41.257603 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd7206-b2a4-45bc-bc96-b7f287aaadda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:41.259438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd7206-b2a4-45bc-bc96-b7f287aaadda service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:41.271888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1158/2306] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:41.419000 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:41.627960 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e3f84-8d9f-4822-aea3-6ccf330e3f30 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:41.629544 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4c7e3f84-8d9f-4822-aea3-6ccf330e3f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:41.642164 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e3f84-8d9f-4822-aea3-6ccf330e3f30 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:41.646972 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c570009-3197-4d7b-a148-646a21d52a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:41.647659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c570009-3197-4d7b-a148-646a21d52a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:41.647938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c570009-3197-4d7b-a148-646a21d52a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:41.648210 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c570009-3197-4d7b-a148-646a21d52a57 admin admin] PATH_INFO: `/v3/projects/74899cee462841e69e725b2643f958b0` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:41.649483 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c570009-3197-4d7b-a148-646a21d52a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74899cee462841e69e725b2643f958b0)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:41.651407 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c570009-3197-4d7b-a148-646a21d52a57 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:41.756355 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd7206-b2a4-45bc-bc96-b7f287aaadda service nova] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:41.758093 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-95bd7206-b2a4-45bc-bc96-b7f287aaadda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:41.775107 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd7206-b2a4-45bc-bc96-b7f287aaadda service nova] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:41.779658 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed5fbd-9025-4f0b-8995-d40a452b312c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:41.780276 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed5fbd-9025-4f0b-8995-d40a452b312c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:41.781416 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed5fbd-9025-4f0b-8995-d40a452b312c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:41.781648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed5fbd-9025-4f0b-8995-d40a452b312c admin admin] PATH_INFO: `/v3/users/42f7227f704041298d0912309117897f` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:41.782860 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed5fbd-9025-4f0b-8995-d40a452b312c admin admin] RBAC: Authorizing `identity:delete_user(user_id=42f7227f704041298d0912309117897f)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:41.784764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed5fbd-9025-4f0b-8995-d40a452b312c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:41.825272 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c570009-3197-4d7b-a148-646a21d52a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74899cee462841e69e725b2643f958b0', 'request_id': 'req-4c570009-3197-4d7b-a148-646a21d52a57'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:41.832283 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c570009-3197-4d7b-a148-646a21d52a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74899cee462841e69e725b2643f958b0', 'request_id': 'req-4c570009-3197-4d7b-a148-646a21d52a57'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:41.979716 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c570009-3197-4d7b-a148-646a21d52a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74899cee462841e69e725b2643f958b0', 'request_id': 'req-4c570009-3197-4d7b-a148-646a21d52a57'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:41.995380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c570009-3197-4d7b-a148-646a21d52a57 admin admin] The token cache is being invalidate because project 74899cee462841e69e725b2643f958b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:36:41.995657 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c570009-3197-4d7b-a148-646a21d52a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:41.996343 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c570009-3197-4d7b-a148-646a21d52a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:41.997936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1149/2307] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:36:41 2022] DELETE /identity/v3/projects/74899cee462841e69e725b2643f958b0 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:42.005194 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340a8e2-e23b-45aa-9dbe-db29c8215e85 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:42.005597 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340a8e2-e23b-45aa-9dbe-db29c8215e85 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:42.007116 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340a8e2-e23b-45aa-9dbe-db29c8215e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:42.028868 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-0340a8e2-e23b-45aa-9dbe-db29c8215e85 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:42.030216 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0340a8e2-e23b-45aa-9dbe-db29c8215e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:42.091718 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1150/2308] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:36:42.100110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f81bf-7685-4b89-bf2e-0ea012bc9ac9 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:42.100393 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f81bf-7685-4b89-bf2e-0ea012bc9ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:42.100669 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f81bf-7685-4b89-bf2e-0ea012bc9ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:42.120057 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-985f81bf-7685-4b89-bf2e-0ea012bc9ac9 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:42.121261 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-985f81bf-7685-4b89-bf2e-0ea012bc9ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:42.123252 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6bed5fbd-9025-4f0b-8995-d40a452b312c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42f7227f704041298d0912309117897f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:42.129775 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1151/2309] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:36:42.133908 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f81bf-7685-4b89-bf2e-0ea012bc9ac9 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:42.143376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f81bf-7685-4b89-bf2e-0ea012bc9ac9 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:42.148160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb9924-e483-4f1e-a0fb-22621863616d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:42.148697 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb9924-e483-4f1e-a0fb-22621863616d admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:42.148967 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb9924-e483-4f1e-a0fb-22621863616d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:42.149279 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb9924-e483-4f1e-a0fb-22621863616d admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:42.149919 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb9924-e483-4f1e-a0fb-22621863616d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:36:42.150216 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb9924-e483-4f1e-a0fb-22621863616d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:42.151884 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb9924-e483-4f1e-a0fb-22621863616d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:42.163670 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1152/2310] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:36:42.167827 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb9924-e483-4f1e-a0fb-22621863616d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:42.177337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb9924-e483-4f1e-a0fb-22621863616d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:42.181876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3cf7f-5f59-47ff-9ce6-fc73fec7df04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:42.182471 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3cf7f-5f59-47ff-9ce6-fc73fec7df04 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:42.182751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3cf7f-5f59-47ff-9ce6-fc73fec7df04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:42.183024 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3cf7f-5f59-47ff-9ce6-fc73fec7df04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:42.183891 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3cf7f-5f59-47ff-9ce6-fc73fec7df04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:42.185796 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3cf7f-5f59-47ff-9ce6-fc73fec7df04 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:42.212758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6bed5fbd-9025-4f0b-8995-d40a452b312c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42f7227f704041298d0912309117897f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:42.225955 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6bed5fbd-9025-4f0b-8995-d40a452b312c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42f7227f704041298d0912309117897f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:42.226660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6bed5fbd-9025-4f0b-8995-d40a452b312c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42f7227f704041298d0912309117897f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:42.239597 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6bed5fbd-9025-4f0b-8995-d40a452b312c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42f7227f704041298d0912309117897f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:42.245910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1159/2311] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:36:41 2022] DELETE /identity/v3/users/42f7227f704041298d0912309117897f => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:42.250760 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3a301-07fa-43fa-ab3e-dbf64f2d6480 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:42.251044 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3a301-07fa-43fa-ab3e-dbf64f2d6480 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:42.251316 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3a301-07fa-43fa-ab3e-dbf64f2d6480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:42.270600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-cfe3a301-07fa-43fa-ab3e-dbf64f2d6480 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:42.271823 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-cfe3a301-07fa-43fa-ab3e-dbf64f2d6480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:42.315551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1153/2312] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:36:42 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:36:42.319804 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3cf7f-5f59-47ff-9ce6-fc73fec7df04 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:42.321656 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7ec3cf7f-5f59-47ff-9ce6-fc73fec7df04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:42.348403 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1160/2313] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:36:42.358303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3a301-07fa-43fa-ab3e-dbf64f2d6480 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:42.360621 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-cfe3a301-07fa-43fa-ab3e-dbf64f2d6480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:42.394982 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3cf7f-5f59-47ff-9ce6-fc73fec7df04 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:42.401509 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08912f0d-8586-4579-b06c-be365582d56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:42.402054 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08912f0d-8586-4579-b06c-be365582d56b admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:42.402369 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08912f0d-8586-4579-b06c-be365582d56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:42.402640 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08912f0d-8586-4579-b06c-be365582d56b admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:42.403276 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08912f0d-8586-4579-b06c-be365582d56b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:42.405253 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08912f0d-8586-4579-b06c-be365582d56b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:42.433048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3a301-07fa-43fa-ab3e-dbf64f2d6480 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:42.478106 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:42.491730 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76910b-fdc5-4358-be93-03aa99aacc7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:42.492467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76910b-fdc5-4358-be93-03aa99aacc7f service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:42.492912 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76910b-fdc5-4358-be93-03aa99aacc7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:42.493265 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76910b-fdc5-4358-be93-03aa99aacc7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:42.504565 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76910b-fdc5-4358-be93-03aa99aacc7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:42.506042 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76910b-fdc5-4358-be93-03aa99aacc7f service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:42.516658 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1161/2314] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:36:42.553674 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1154/2315] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:36:42 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:36:42.554796 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76910b-fdc5-4358-be93-03aa99aacc7f service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:42.566725 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76910b-fdc5-4358-be93-03aa99aacc7f service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:42.571687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdaf40-22fb-482b-bea7-2fb775eeef29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:42.577930 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdaf40-22fb-482b-bea7-2fb775eeef29 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:42.577930 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdaf40-22fb-482b-bea7-2fb775eeef29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:42.577930 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdaf40-22fb-482b-bea7-2fb775eeef29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:42.577930 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fdaf40-22fb-482b-bea7-2fb775eeef29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:42.577930 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fdaf40-22fb-482b-bea7-2fb775eeef29 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:42.590568 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1162/2316] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:42.591703 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08912f0d-8586-4579-b06c-be365582d56b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:42.603605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08912f0d-8586-4579-b06c-be365582d56b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:42.609865 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a23cb-caf2-4523-ab4f-7bdd14040d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:42.610635 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a23cb-caf2-4523-ab4f-7bdd14040d5e admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:42.611807 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a23cb-caf2-4523-ab4f-7bdd14040d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:42.611807 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a23cb-caf2-4523-ab4f-7bdd14040d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:42.612765 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a23cb-caf2-4523-ab4f-7bdd14040d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:42.613825 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a23cb-caf2-4523-ab4f-7bdd14040d5e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:42.631814 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1155/2317] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:42.632927 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdaf40-22fb-482b-bea7-2fb775eeef29 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:42.643694 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdaf40-22fb-482b-bea7-2fb775eeef29 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:42.648392 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ee780-7f70-4cd9-bc39-99470d2a7500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:42.649043 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ee780-7f70-4cd9-bc39-99470d2a7500 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:42.649405 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ee780-7f70-4cd9-bc39-99470d2a7500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:42.649681 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ee780-7f70-4cd9-bc39-99470d2a7500 admin admin] PATH_INFO: `/v3/projects/a3b4345269ca4013881a124680303254/users/76aaed21a9bf4226bcfd722f1e1a325d/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:42.666701 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ee780-7f70-4cd9-bc39-99470d2a7500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b4345269ca4013881a124680303254, user_id=76aaed21a9bf4226bcfd722f1e1a325d, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:42.669617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ee780-7f70-4cd9-bc39-99470d2a7500 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:42.823808 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1163/2318] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:42 2022] PUT /identity/v3/projects/a3b4345269ca4013881a124680303254/users/76aaed21a9bf4226bcfd722f1e1a325d/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:42.836412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071cb0d-bc23-4bcb-bc95-6a50e8eb5bf0 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:42.836737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071cb0d-bc23-4bcb-bc95-6a50e8eb5bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:42.837331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071cb0d-bc23-4bcb-bc95-6a50e8eb5bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:42.879446 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a071cb0d-bc23-4bcb-bc95-6a50e8eb5bf0 None None] MFA Rules not processed for user `76aaed21a9bf4226bcfd722f1e1a325d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:42.881866 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a071cb0d-bc23-4bcb-bc95-6a50e8eb5bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:42.975067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1156/2319] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:42.979354 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ee780-7f70-4cd9-bc39-99470d2a7500 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:43.047766 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ee780-7f70-4cd9-bc39-99470d2a7500 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:43.052801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09091051-cee2-41a4-821a-a0d64d0243a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:43.053475 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09091051-cee2-41a4-821a-a0d64d0243a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:43.053756 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09091051-cee2-41a4-821a-a0d64d0243a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:43.054030 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09091051-cee2-41a4-821a-a0d64d0243a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:43.054664 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09091051-cee2-41a4-821a-a0d64d0243a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:43.056644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09091051-cee2-41a4-821a-a0d64d0243a9 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:43.087944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071cb0d-bc23-4bcb-bc95-6a50e8eb5bf0 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:43.089696 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a071cb0d-bc23-4bcb-bc95-6a50e8eb5bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:43.119145 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071cb0d-bc23-4bcb-bc95-6a50e8eb5bf0 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:43.127024 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f23534-fa7e-4103-bec4-b444cf399aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:43.127748 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f23534-fa7e-4103-bec4-b444cf399aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:43.128085 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f23534-fa7e-4103-bec4-b444cf399aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:43.128258 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f23534-fa7e-4103-bec4-b444cf399aba admin admin] PATH_INFO: `/v3/projects/b7d5819dc56c4c53b8cf7647b576780f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:43.129523 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f23534-fa7e-4103-bec4-b444cf399aba admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7d5819dc56c4c53b8cf7647b576780f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:43.131404 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f23534-fa7e-4103-bec4-b444cf399aba admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:43.247246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1164/2320] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:36:42 2022] POST /identity/v3/projects => generated 383 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:43.256104 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09091051-cee2-41a4-821a-a0d64d0243a9 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:43.329183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09091051-cee2-41a4-821a-a0d64d0243a9 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:43.334387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903e370-4d91-467b-a69a-78e51ea8e253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:43.335041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903e370-4d91-467b-a69a-78e51ea8e253 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:43.335281 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903e370-4d91-467b-a69a-78e51ea8e253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:43.335556 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903e370-4d91-467b-a69a-78e51ea8e253 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:43.336294 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903e370-4d91-467b-a69a-78e51ea8e253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:43.338299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903e370-4d91-467b-a69a-78e51ea8e253 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:43.401744 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-54f23534-fa7e-4103-bec4-b444cf399aba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7d5819dc56c4c53b8cf7647b576780f', 'request_id': 'req-54f23534-fa7e-4103-bec4-b444cf399aba'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:43.417971 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-54f23534-fa7e-4103-bec4-b444cf399aba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7d5819dc56c4c53b8cf7647b576780f', 'request_id': 'req-54f23534-fa7e-4103-bec4-b444cf399aba'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:43.570416 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1165/2321] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:36:43 2022] POST /identity/v3/users => generated 292 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:43.574312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903e370-4d91-467b-a69a-78e51ea8e253 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:43.585045 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903e370-4d91-467b-a69a-78e51ea8e253 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:43.603262 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-54f23534-fa7e-4103-bec4-b444cf399aba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7d5819dc56c4c53b8cf7647b576780f', 'request_id': 'req-54f23534-fa7e-4103-bec4-b444cf399aba'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:43.621266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-54f23534-fa7e-4103-bec4-b444cf399aba admin admin] The token cache is being invalidate because project b7d5819dc56c4c53b8cf7647b576780f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:36:43.621963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-54f23534-fa7e-4103-bec4-b444cf399aba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:43.623152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-54f23534-fa7e-4103-bec4-b444cf399aba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:43.625718 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1157/2322] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:36:43 2022] DELETE /identity/v3/projects/b7d5819dc56c4c53b8cf7647b576780f => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:43.630767 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31cbde-f275-4871-a84f-cde424f7a78c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:43.631279 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31cbde-f275-4871-a84f-cde424f7a78c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:43.632345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31cbde-f275-4871-a84f-cde424f7a78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:43.656055 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8f31cbde-f275-4871-a84f-cde424f7a78c None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:43.657728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8f31cbde-f275-4871-a84f-cde424f7a78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:43.668787 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b502e9-1535-4f8c-93cd-c924e0c3fc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:43.669967 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b502e9-1535-4f8c-93cd-c924e0c3fc4a admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:43.670279 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b502e9-1535-4f8c-93cd-c924e0c3fc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:43.670639 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b502e9-1535-4f8c-93cd-c924e0c3fc4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:43.671232 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b502e9-1535-4f8c-93cd-c924e0c3fc4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:43.673190 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b502e9-1535-4f8c-93cd-c924e0c3fc4a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:43.688360 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1166/2323] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:36:43.689968 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b502e9-1535-4f8c-93cd-c924e0c3fc4a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:43.692760 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-75b502e9-1535-4f8c-93cd-c924e0c3fc4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:43.708042 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b502e9-1535-4f8c-93cd-c924e0c3fc4a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:43.713079 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f733fe-e5fa-4d83-8e47-65dadab39c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:43.713885 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f733fe-e5fa-4d83-8e47-65dadab39c4f admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:43.714230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f733fe-e5fa-4d83-8e47-65dadab39c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:43.714671 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f733fe-e5fa-4d83-8e47-65dadab39c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:43.715376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f733fe-e5fa-4d83-8e47-65dadab39c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:43.717531 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f733fe-e5fa-4d83-8e47-65dadab39c4f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:43.730719 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1158/2324] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:43.740734 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe561adb-86ea-4fd7-a700-218e915403eb None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:43.741020 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe561adb-86ea-4fd7-a700-218e915403eb None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:43.741379 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe561adb-86ea-4fd7-a700-218e915403eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:43.744551 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1167/2325] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:43.745580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f733fe-e5fa-4d83-8e47-65dadab39c4f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:43.756557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f733fe-e5fa-4d83-8e47-65dadab39c4f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:43.761326 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffbe6e-895b-4862-a29b-c4df5fda55c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:43.762076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffbe6e-895b-4862-a29b-c4df5fda55c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:43.762341 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-fe561adb-86ea-4fd7-a700-218e915403eb None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:43.762445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffbe6e-895b-4862-a29b-c4df5fda55c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:43.762799 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffbe6e-895b-4862-a29b-c4df5fda55c9 admin admin] PATH_INFO: `/v3/projects/09afa17bcecc427fb1c56ca57d4da25a/users/f7dfe641b5454e31a43a00086e2b2ae1/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:43.763596 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fe561adb-86ea-4fd7-a700-218e915403eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:43.776696 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1159/2326] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:43.778144 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffbe6e-895b-4862-a29b-c4df5fda55c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09afa17bcecc427fb1c56ca57d4da25a, user_id=f7dfe641b5454e31a43a00086e2b2ae1, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:43.779556 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe561adb-86ea-4fd7-a700-218e915403eb None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:43.780986 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffbe6e-895b-4862-a29b-c4df5fda55c9 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:43.794460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe561adb-86ea-4fd7-a700-218e915403eb None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:43.798754 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1de502-cbfc-4161-9abe-2315a0758e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:43.799419 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1de502-cbfc-4161-9abe-2315a0758e9c admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:43.799713 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1de502-cbfc-4161-9abe-2315a0758e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:43.799985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1de502-cbfc-4161-9abe-2315a0758e9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:43.800633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1de502-cbfc-4161-9abe-2315a0758e9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:36:43.800937 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1de502-cbfc-4161-9abe-2315a0758e9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:43.802649 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1de502-cbfc-4161-9abe-2315a0758e9c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:43.818658 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1160/2327] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:36:43.822999 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1de502-cbfc-4161-9abe-2315a0758e9c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:43.833178 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1de502-cbfc-4161-9abe-2315a0758e9c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:43.837906 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605d03c-e938-4c30-bd50-d0eb8113464c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:43.838496 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605d03c-e938-4c30-bd50-d0eb8113464c admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:43.838778 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605d03c-e938-4c30-bd50-d0eb8113464c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:43.839054 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605d03c-e938-4c30-bd50-d0eb8113464c admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:43.839731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605d03c-e938-4c30-bd50-d0eb8113464c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:43.841608 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605d03c-e938-4c30-bd50-d0eb8113464c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:43.969866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1168/2328] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:43 2022] PUT /identity/v3/projects/09afa17bcecc427fb1c56ca57d4da25a/users/f7dfe641b5454e31a43a00086e2b2ae1/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:43.973872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1161/2329] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:36:43 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:36:43.978459 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605d03c-e938-4c30-bd50-d0eb8113464c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:43.984640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714a8d1-be11-4ec5-be36-dd46e642cf1e None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:43.986260 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714a8d1-be11-4ec5-be36-dd46e642cf1e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:43.986696 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714a8d1-be11-4ec5-be36-dd46e642cf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:44.043934 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-5714a8d1-be11-4ec5-be36-dd46e642cf1e None None] MFA Rules not processed for user `f7dfe641b5454e31a43a00086e2b2ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:44.045135 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5714a8d1-be11-4ec5-be36-dd46e642cf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:44.100580 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605d03c-e938-4c30-bd50-d0eb8113464c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:44.107681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7695389-d297-4063-800c-ad328c0cfe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:44.108312 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7695389-d297-4063-800c-ad328c0cfe64 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:44.108621 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7695389-d297-4063-800c-ad328c0cfe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:44.109894 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7695389-d297-4063-800c-ad328c0cfe64 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:44.110803 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7695389-d297-4063-800c-ad328c0cfe64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:44.113014 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7695389-d297-4063-800c-ad328c0cfe64 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:44.154624 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1169/2330] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:44.159404 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714a8d1-be11-4ec5-be36-dd46e642cf1e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:44.171256 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714a8d1-be11-4ec5-be36-dd46e642cf1e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:44.177207 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7fe92-f444-4e37-a5d9-6e5d41d4b7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:44.178046 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7fe92-f444-4e37-a5d9-6e5d41d4b7b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:44.180125 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7fe92-f444-4e37-a5d9-6e5d41d4b7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:44.180125 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7fe92-f444-4e37-a5d9-6e5d41d4b7b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:44.180864 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7fe92-f444-4e37-a5d9-6e5d41d4b7b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:44.182988 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7fe92-f444-4e37-a5d9-6e5d41d4b7b9 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:44.222090 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1162/2331] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:36:43 2022] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:36:44.225437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7695389-d297-4063-800c-ad328c0cfe64 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:44.238479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:44.247971 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7695389-d297-4063-800c-ad328c0cfe64 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:44.253726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bbba3-8462-4601-a3f8-818a33e1cbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:44.254463 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bbba3-8462-4601-a3f8-818a33e1cbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:44.254801 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bbba3-8462-4601-a3f8-818a33e1cbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:44.255136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bbba3-8462-4601-a3f8-818a33e1cbb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:44.256202 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bbba3-8462-4601-a3f8-818a33e1cbb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:44.257943 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bbba3-8462-4601-a3f8-818a33e1cbb4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:44.272570 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1163/2332] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:36:44.273658 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bbba3-8462-4601-a3f8-818a33e1cbb4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:44.283320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bbba3-8462-4601-a3f8-818a33e1cbb4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:44.288230 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258630b-8d27-4c32-ae90-21cbbc5a0028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:44.288823 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258630b-8d27-4c32-ae90-21cbbc5a0028 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:44.289130 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258630b-8d27-4c32-ae90-21cbbc5a0028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:44.289407 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258630b-8d27-4c32-ae90-21cbbc5a0028 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:44.290056 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258630b-8d27-4c32-ae90-21cbbc5a0028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:44.291652 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258630b-8d27-4c32-ae90-21cbbc5a0028 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:44.302200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1164/2333] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:36:44.306273 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258630b-8d27-4c32-ae90-21cbbc5a0028 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:44.313030 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1170/2334] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:36:44 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:36:44.317107 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7fe92-f444-4e37-a5d9-6e5d41d4b7b9 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:44.319585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258630b-8d27-4c32-ae90-21cbbc5a0028 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:44.391239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7fe92-f444-4e37-a5d9-6e5d41d4b7b9 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:44.394053 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ba808-c08e-4855-b805-0a15794603df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:44.394735 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ba808-c08e-4855-b805-0a15794603df admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:44.395022 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ba808-c08e-4855-b805-0a15794603df admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:44.395735 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ba808-c08e-4855-b805-0a15794603df admin admin] PATH_INFO: `/v3/projects/f1822c0a9c4441158992038fc41b25ba/users/45383671ca37408a9be6f17571025bbc/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:44.400109 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f71a4-321f-4407-9a7c-38879907870c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:44.400109 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f71a4-321f-4407-9a7c-38879907870c admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:44.400109 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f71a4-321f-4407-9a7c-38879907870c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:44.400109 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f71a4-321f-4407-9a7c-38879907870c admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:44.400752 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f71a4-321f-4407-9a7c-38879907870c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:44.402819 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f71a4-321f-4407-9a7c-38879907870c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:44.417489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ba808-c08e-4855-b805-0a15794603df admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1822c0a9c4441158992038fc41b25ba, user_id=45383671ca37408a9be6f17571025bbc, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:44.423389 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ba808-c08e-4855-b805-0a15794603df admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:44.525858 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1165/2335] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:44 2022] PUT /identity/v3/projects/f1822c0a9c4441158992038fc41b25ba/users/45383671ca37408a9be6f17571025bbc/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:44.533636 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1171/2336] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:36:44 2022] POST /identity/v3/users => generated 299 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:36:44.533829 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a785-80ac-40f6-b05d-ad2f5b11250d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:44.533829 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a785-80ac-40f6-b05d-ad2f5b11250d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:44.533829 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a785-80ac-40f6-b05d-ad2f5b11250d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:44.535317 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f71a4-321f-4407-9a7c-38879907870c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:44.546571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f71a4-321f-4407-9a7c-38879907870c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:44.560884 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b1b5a785-80ac-40f6-b05d-ad2f5b11250d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:44.563381 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b1b5a785-80ac-40f6-b05d-ad2f5b11250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:44.622719 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009938c-7dc3-4164-87e7-b73392f3db18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:44.623444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009938c-7dc3-4164-87e7-b73392f3db18 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:44.623828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009938c-7dc3-4164-87e7-b73392f3db18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:44.624271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009938c-7dc3-4164-87e7-b73392f3db18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:44.626379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009938c-7dc3-4164-87e7-b73392f3db18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:44.628084 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009938c-7dc3-4164-87e7-b73392f3db18 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:44.636540 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1166/2337] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:44.641251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1172/2338] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:44.645312 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5a785-80ac-40f6-b05d-ad2f5b11250d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:44.648922 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009938c-7dc3-4164-87e7-b73392f3db18 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:44.653826 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e009938c-7dc3-4164-87e7-b73392f3db18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:44.656503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5a785-80ac-40f6-b05d-ad2f5b11250d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:44.663992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b68a68-3a38-49ff-a093-588edb12694d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:44.664676 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b68a68-3a38-49ff-a093-588edb12694d admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:44.666045 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b68a68-3a38-49ff-a093-588edb12694d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:44.666296 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b68a68-3a38-49ff-a093-588edb12694d admin admin] PATH_INFO: `/v3/projects/6226109bbc2c43eab24b18782f8afa9d/users/1dd71f1bb2e4401f93397384b1d2384e/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:44.702679 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b68a68-3a38-49ff-a093-588edb12694d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6226109bbc2c43eab24b18782f8afa9d, user_id=1dd71f1bb2e4401f93397384b1d2384e, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:44.707032 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b68a68-3a38-49ff-a093-588edb12694d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:44.742920 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009938c-7dc3-4164-87e7-b73392f3db18 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:44.746809 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f53373-807b-4b80-af46-80641ec4e86e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:44.747448 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f53373-807b-4b80-af46-80641ec4e86e service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:44.747727 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f53373-807b-4b80-af46-80641ec4e86e service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:44.748012 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f53373-807b-4b80-af46-80641ec4e86e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:44.758095 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f53373-807b-4b80-af46-80641ec4e86e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:44.759540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f53373-807b-4b80-af46-80641ec4e86e service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:44.769008 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1173/2339] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:36:44.809285 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1167/2340] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:44 2022] PUT /identity/v3/projects/6226109bbc2c43eab24b18782f8afa9d/users/1dd71f1bb2e4401f93397384b1d2384e/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:44.813869 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f53373-807b-4b80-af46-80641ec4e86e service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:44.823783 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f53373-807b-4b80-af46-80641ec4e86e service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:44.862789 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b68a68-3a38-49ff-a093-588edb12694d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:44.864568 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-99b68a68-3a38-49ff-a093-588edb12694d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:44.900276 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c6156-a92f-455e-946e-204ebfb79bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:44.902267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c6156-a92f-455e-946e-204ebfb79bee admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:44.902553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c6156-a92f-455e-946e-204ebfb79bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:44.902766 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c6156-a92f-455e-946e-204ebfb79bee admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:44.903539 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c6156-a92f-455e-946e-204ebfb79bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:44.905364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c6156-a92f-455e-946e-204ebfb79bee admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:44.923932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1174/2341] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:44.934331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c6156-a92f-455e-946e-204ebfb79bee admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:44.956038 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c6156-a92f-455e-946e-204ebfb79bee admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:44.973741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:44.979845 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b68a68-3a38-49ff-a093-588edb12694d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:44.983523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58602a5d-742d-4264-af65-1869dc2dca2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:44.984895 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58602a5d-742d-4264-af65-1869dc2dca2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:44.985232 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58602a5d-742d-4264-af65-1869dc2dca2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:44.985506 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58602a5d-742d-4264-af65-1869dc2dca2b admin admin] PATH_INFO: `/v3/projects/6226109bbc2c43eab24b18782f8afa9d/users/1dd71f1bb2e4401f93397384b1d2384e/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:44.989405 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58602a5d-742d-4264-af65-1869dc2dca2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6226109bbc2c43eab24b18782f8afa9d, user_id=1dd71f1bb2e4401f93397384b1d2384e, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:44.990047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac17e2e-8d21-4475-ac9a-b1762157ad93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:44.991008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac17e2e-8d21-4475-ac9a-b1762157ad93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:44.991390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac17e2e-8d21-4475-ac9a-b1762157ad93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:44.991766 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac17e2e-8d21-4475-ac9a-b1762157ad93 admin admin] PATH_INFO: `/v3/users/8acb5686883a43fc8984e2f6e23c56d3` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:44.994208 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac17e2e-8d21-4475-ac9a-b1762157ad93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8acb5686883a43fc8984e2f6e23c56d3)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:44.996432 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58602a5d-742d-4264-af65-1869dc2dca2b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:44.996858 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac17e2e-8d21-4475-ac9a-b1762157ad93 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:45.035904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1175/2342] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:44 2022] PUT /identity/v3/projects/6226109bbc2c43eab24b18782f8afa9d/users/1dd71f1bb2e4401f93397384b1d2384e/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:45.037627 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d16bdf-9701-4d2e-94f7-d6cee0ca6146 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:45.037918 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d16bdf-9701-4d2e-94f7-d6cee0ca6146 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:45.039316 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d16bdf-9701-4d2e-94f7-d6cee0ca6146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:45.090987 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-54d16bdf-9701-4d2e-94f7-d6cee0ca6146 None None] MFA Rules not processed for user `1dd71f1bb2e4401f93397384b1d2384e`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:45.093597 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-54d16bdf-9701-4d2e-94f7-d6cee0ca6146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:45.153559 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:45.189607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1176/2343] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:45.204278 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d16bdf-9701-4d2e-94f7-d6cee0ca6146 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:45.207630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-54d16bdf-9701-4d2e-94f7-d6cee0ca6146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:45.221630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4ac17e2e-8d21-4475-ac9a-b1762157ad93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8acb5686883a43fc8984e2f6e23c56d3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:45.222970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4ac17e2e-8d21-4475-ac9a-b1762157ad93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8acb5686883a43fc8984e2f6e23c56d3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:45.287181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d16bdf-9701-4d2e-94f7-d6cee0ca6146 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:45.291618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3dedc9-c66c-4377-866d-3c4b4492bf49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:45.292401 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dedc9-c66c-4377-866d-3c4b4492bf49 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:45.292776 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dedc9-c66c-4377-866d-3c4b4492bf49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:45.293203 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dedc9-c66c-4377-866d-3c4b4492bf49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:45.295592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9e3dedc9-c66c-4377-866d-3c4b4492bf49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:45.362945 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4ac17e2e-8d21-4475-ac9a-b1762157ad93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8acb5686883a43fc8984e2f6e23c56d3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:45.382491 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4ac17e2e-8d21-4475-ac9a-b1762157ad93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8acb5686883a43fc8984e2f6e23c56d3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:45.383200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4ac17e2e-8d21-4475-ac9a-b1762157ad93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8acb5686883a43fc8984e2f6e23c56d3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:45.395356 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3dedc9-c66c-4377-866d-3c4b4492bf49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:45.398313 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3dedc9-c66c-4377-866d-3c4b4492bf49 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:45.399292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1168/2344] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:36:44 2022] DELETE /identity/v3/users/8acb5686883a43fc8984e2f6e23c56d3 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:36:45.416360 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1177/2345] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:36:45.881365 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac17e2e-8d21-4475-ac9a-b1762157ad93 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:45.883541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4ac17e2e-8d21-4475-ac9a-b1762157ad93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:45.992585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac17e2e-8d21-4475-ac9a-b1762157ad93 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:46.000203 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32665b5-7dd3-40c1-9c97-832da9fccca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:46.002739 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32665b5-7dd3-40c1-9c97-832da9fccca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:46.004795 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32665b5-7dd3-40c1-9c97-832da9fccca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:46.005257 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32665b5-7dd3-40c1-9c97-832da9fccca0 admin admin] PATH_INFO: `/v3/projects/d7cd0446e5b04910b0886f4ede510e70` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:46.006742 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32665b5-7dd3-40c1-9c97-832da9fccca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7cd0446e5b04910b0886f4ede510e70)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:46.010090 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32665b5-7dd3-40c1-9c97-832da9fccca0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:46.154768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f32665b5-7dd3-40c1-9c97-832da9fccca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7cd0446e5b04910b0886f4ede510e70', 'request_id': 'req-f32665b5-7dd3-40c1-9c97-832da9fccca0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:46.162029 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f32665b5-7dd3-40c1-9c97-832da9fccca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7cd0446e5b04910b0886f4ede510e70', 'request_id': 'req-f32665b5-7dd3-40c1-9c97-832da9fccca0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:46.328553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f32665b5-7dd3-40c1-9c97-832da9fccca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7cd0446e5b04910b0886f4ede510e70', 'request_id': 'req-f32665b5-7dd3-40c1-9c97-832da9fccca0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:46.340794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f32665b5-7dd3-40c1-9c97-832da9fccca0 admin admin] The token cache is being invalidate because project d7cd0446e5b04910b0886f4ede510e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:36:46.345155 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f32665b5-7dd3-40c1-9c97-832da9fccca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:46.345155 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f32665b5-7dd3-40c1-9c97-832da9fccca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:46.345155 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1169/2346] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:36:45 2022] DELETE /identity/v3/projects/d7cd0446e5b04910b0886f4ede510e70 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:46.347317 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3dedc9-c66c-4377-866d-3c4b4492bf49 service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:46.416266 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3dedc9-c66c-4377-866d-3c4b4492bf49 service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:46.510078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b8164-9d3b-41d5-a1be-4791c359374c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:46.511102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b8164-9d3b-41d5-a1be-4791c359374c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:46.511102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b8164-9d3b-41d5-a1be-4791c359374c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:46.511280 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b8164-9d3b-41d5-a1be-4791c359374c admin admin] PATH_INFO: `/v3/users/06d2f6687c7f41b0b1d5faee851d4ee6` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:46.512527 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b8164-9d3b-41d5-a1be-4791c359374c admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d2f6687c7f41b0b1d5faee851d4ee6)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:46.514534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b8164-9d3b-41d5-a1be-4791c359374c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:47.020277 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-901b8164-9d3b-41d5-a1be-4791c359374c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d2f6687c7f41b0b1d5faee851d4ee6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:47.089799 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-901b8164-9d3b-41d5-a1be-4791c359374c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d2f6687c7f41b0b1d5faee851d4ee6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:47.114522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-901b8164-9d3b-41d5-a1be-4791c359374c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d2f6687c7f41b0b1d5faee851d4ee6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:47.115404 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-901b8164-9d3b-41d5-a1be-4791c359374c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d2f6687c7f41b0b1d5faee851d4ee6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:47.128980 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-901b8164-9d3b-41d5-a1be-4791c359374c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d2f6687c7f41b0b1d5faee851d4ee6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:47.149215 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1178/2347] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:36:46 2022] DELETE /identity/v3/users/06d2f6687c7f41b0b1d5faee851d4ee6 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:47.711630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32665b5-7dd3-40c1-9c97-832da9fccca0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:47.713799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f32665b5-7dd3-40c1-9c97-832da9fccca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:47.751531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32665b5-7dd3-40c1-9c97-832da9fccca0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:47.930647 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:47.974580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b8164-9d3b-41d5-a1be-4791c359374c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:47.976105 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-901b8164-9d3b-41d5-a1be-4791c359374c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:47.990356 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3bec3-ed8d-4b17-aca1-e7ff1b151cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:47.990939 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3bec3-ed8d-4b17-aca1-e7ff1b151cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:47.991218 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3bec3-ed8d-4b17-aca1-e7ff1b151cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:47.991490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3bec3-ed8d-4b17-aca1-e7ff1b151cc5 admin admin] PATH_INFO: `/v3/users/cfc12789eff1498f80fdb45d474e4078` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:47.998366 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3bec3-ed8d-4b17-aca1-e7ff1b151cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfc12789eff1498f80fdb45d474e4078)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:48.002783 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b8164-9d3b-41d5-a1be-4791c359374c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:48.006421 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3bec3-ed8d-4b17-aca1-e7ff1b151cc5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:48.020812 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e8f24-81f1-49ad-aa14-cea58bbea304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:48.021995 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e8f24-81f1-49ad-aa14-cea58bbea304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:48.022927 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e8f24-81f1-49ad-aa14-cea58bbea304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:48.023374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e8f24-81f1-49ad-aa14-cea58bbea304 admin admin] PATH_INFO: `/v3/projects/67da7c3ef1ba4aa49bed791a6da11519` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:48.025331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e8f24-81f1-49ad-aa14-cea58bbea304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67da7c3ef1ba4aa49bed791a6da11519)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:48.027852 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e8f24-81f1-49ad-aa14-cea58bbea304 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:48.146355 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:48.347825 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fe9e8f24-81f1-49ad-aa14-cea58bbea304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67da7c3ef1ba4aa49bed791a6da11519', 'request_id': 'req-fe9e8f24-81f1-49ad-aa14-cea58bbea304'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:48.357044 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9ac3bec3-ed8d-4b17-aca1-e7ff1b151cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfc12789eff1498f80fdb45d474e4078'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:48.358592 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9ac3bec3-ed8d-4b17-aca1-e7ff1b151cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfc12789eff1498f80fdb45d474e4078'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:48.362880 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fe9e8f24-81f1-49ad-aa14-cea58bbea304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67da7c3ef1ba4aa49bed791a6da11519', 'request_id': 'req-fe9e8f24-81f1-49ad-aa14-cea58bbea304'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:48.434316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9ac3bec3-ed8d-4b17-aca1-e7ff1b151cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfc12789eff1498f80fdb45d474e4078'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:48.479940 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9ac3bec3-ed8d-4b17-aca1-e7ff1b151cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfc12789eff1498f80fdb45d474e4078'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:48.481604 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9ac3bec3-ed8d-4b17-aca1-e7ff1b151cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfc12789eff1498f80fdb45d474e4078'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:48.496503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1170/2348] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:36:47 2022] DELETE /identity/v3/users/cfc12789eff1498f80fdb45d474e4078 => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:48.501237 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a218a7-2ce4-4a56-8882-92c867bcf8dd None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:48.501613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a218a7-2ce4-4a56-8882-92c867bcf8dd None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:48.503806 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a218a7-2ce4-4a56-8882-92c867bcf8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:48.534302 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fe9e8f24-81f1-49ad-aa14-cea58bbea304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67da7c3ef1ba4aa49bed791a6da11519', 'request_id': 'req-fe9e8f24-81f1-49ad-aa14-cea58bbea304'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:48.538300 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-16a218a7-2ce4-4a56-8882-92c867bcf8dd None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:48.545749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-16a218a7-2ce4-4a56-8882-92c867bcf8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:48.576970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fe9e8f24-81f1-49ad-aa14-cea58bbea304 admin admin] The token cache is being invalidate because project 67da7c3ef1ba4aa49bed791a6da11519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:36:48.583240 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fe9e8f24-81f1-49ad-aa14-cea58bbea304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:48.588707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fe9e8f24-81f1-49ad-aa14-cea58bbea304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:48.594508 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1179/2349] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:36:47 2022] DELETE /identity/v3/projects/67da7c3ef1ba4aa49bed791a6da11519 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:36:48.599535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd851a-6bfb-4187-8380-429606ec760d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:48.600145 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd851a-6bfb-4187-8380-429606ec760d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:48.600323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd851a-6bfb-4187-8380-429606ec760d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:48.682226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-ebfd851a-6bfb-4187-8380-429606ec760d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:48.687447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ebfd851a-6bfb-4187-8380-429606ec760d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:48.730776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1171/2350] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:48.790780 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a218a7-2ce4-4a56-8882-92c867bcf8dd None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:48.793836 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-16a218a7-2ce4-4a56-8882-92c867bcf8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:48.831458 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1180/2351] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:48.851661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75e6f2-8ff2-4ebf-aaa6-7bfca9119467 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:48.851661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75e6f2-8ff2-4ebf-aaa6-7bfca9119467 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:48.851661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75e6f2-8ff2-4ebf-aaa6-7bfca9119467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:48.911796 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-ce75e6f2-8ff2-4ebf-aaa6-7bfca9119467 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:48.913451 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ce75e6f2-8ff2-4ebf-aaa6-7bfca9119467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:48.959161 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a218a7-2ce4-4a56-8882-92c867bcf8dd None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:48.960470 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1181/2352] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:48.966850 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75e6f2-8ff2-4ebf-aaa6-7bfca9119467 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:48.974713 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b4a78-f0b0-413c-a13d-ed0d58e4584c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:48.975556 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b4a78-f0b0-413c-a13d-ed0d58e4584c service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:48.976012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b4a78-f0b0-413c-a13d-ed0d58e4584c service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:48.976557 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b4a78-f0b0-413c-a13d-ed0d58e4584c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:48.991623 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75e6f2-8ff2-4ebf-aaa6-7bfca9119467 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:48.997129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b4a78-f0b0-413c-a13d-ed0d58e4584c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:49.001034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b4a78-f0b0-413c-a13d-ed0d58e4584c service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:49.003129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b10ea-4d8d-4582-905e-647d7982035c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:49.003868 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b10ea-4d8d-4582-905e-647d7982035c admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:49.004980 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b10ea-4d8d-4582-905e-647d7982035c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:49.006765 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b10ea-4d8d-4582-905e-647d7982035c admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:49.007549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b10ea-4d8d-4582-905e-647d7982035c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:36:49.007952 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b10ea-4d8d-4582-905e-647d7982035c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:49.011472 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b10ea-4d8d-4582-905e-647d7982035c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:49.042525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1172/2353] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:49.047628 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1182/2354] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:36:49.053513 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b4a78-f0b0-413c-a13d-ed0d58e4584c service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:49.073557 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b4a78-f0b0-413c-a13d-ed0d58e4584c service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:49.091680 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b10ea-4d8d-4582-905e-647d7982035c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:49.094322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a01b10ea-4d8d-4582-905e-647d7982035c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:49.100179 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf49db-4cb4-4ff5-b2d4-e986eaf347e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:49.104706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf49db-4cb4-4ff5-b2d4-e986eaf347e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:49.104706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf49db-4cb4-4ff5-b2d4-e986eaf347e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:49.104706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf49db-4cb4-4ff5-b2d4-e986eaf347e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:49.104706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf49db-4cb4-4ff5-b2d4-e986eaf347e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:49.104706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf49db-4cb4-4ff5-b2d4-e986eaf347e2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:49.216206 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b10ea-4d8d-4582-905e-647d7982035c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:49.221208 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf507f6-be3f-4227-ac73-8c269606b8ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:49.222310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf507f6-be3f-4227-ac73-8c269606b8ca service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:49.222837 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf507f6-be3f-4227-ac73-8c269606b8ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:49.223338 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf507f6-be3f-4227-ac73-8c269606b8ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:49.225831 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0bf507f6-be3f-4227-ac73-8c269606b8ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:49.241866 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1173/2355] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:36:49 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:49.246076 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf49db-4cb4-4ff5-b2d4-e986eaf347e2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:49.365578 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf507f6-be3f-4227-ac73-8c269606b8ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:49.368408 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf507f6-be3f-4227-ac73-8c269606b8ca service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:49.399043 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1183/2356] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:36:49.422514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf49db-4cb4-4ff5-b2d4-e986eaf347e2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:49.435392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99868a1-7876-48d0-9fa0-b12dbcfdea99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:49.437228 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99868a1-7876-48d0-9fa0-b12dbcfdea99 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:49.437560 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99868a1-7876-48d0-9fa0-b12dbcfdea99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:49.439457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99868a1-7876-48d0-9fa0-b12dbcfdea99 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:49.440699 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99868a1-7876-48d0-9fa0-b12dbcfdea99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:49.456964 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99868a1-7876-48d0-9fa0-b12dbcfdea99 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:49.595657 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1174/2357] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:36:49 2022] POST /identity/v3/users => generated 289 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:36:49.596903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf507f6-be3f-4227-ac73-8c269606b8ca service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:49.613644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf507f6-be3f-4227-ac73-8c269606b8ca service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:49.619080 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b7246-936f-4913-a262-4d206cac71c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:49.619743 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b7246-936f-4913-a262-4d206cac71c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:49.620071 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b7246-936f-4913-a262-4d206cac71c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:49.626631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b7246-936f-4913-a262-4d206cac71c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:49.626631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b7246-936f-4913-a262-4d206cac71c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:49.626631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b7246-936f-4913-a262-4d206cac71c2 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:49.634056 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1184/2358] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:49.638347 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99868a1-7876-48d0-9fa0-b12dbcfdea99 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:49.650194 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99868a1-7876-48d0-9fa0-b12dbcfdea99 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:49.660550 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23423b-895d-40aa-84e0-6f8b4c777d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:49.661460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23423b-895d-40aa-84e0-6f8b4c777d15 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:49.661746 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23423b-895d-40aa-84e0-6f8b4c777d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:49.662021 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23423b-895d-40aa-84e0-6f8b4c777d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:49.663130 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23423b-895d-40aa-84e0-6f8b4c777d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:49.666467 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23423b-895d-40aa-84e0-6f8b4c777d15 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:49.679254 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1175/2359] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:36:49.684786 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b7246-936f-4913-a262-4d206cac71c2 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:49.696871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b7246-936f-4913-a262-4d206cac71c2 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:49.701628 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e71b3-536f-499e-a80a-675233d8e22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:49.702998 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e71b3-536f-499e-a80a-675233d8e22a admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:49.703593 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e71b3-536f-499e-a80a-675233d8e22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:49.703593 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e71b3-536f-499e-a80a-675233d8e22a admin admin] PATH_INFO: `/v3/projects/36cc228cab0d463ba713ef3af1be99de/users/ade96b5d87524a36ad48962e1581c656/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:49.720137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e71b3-536f-499e-a80a-675233d8e22a admin admin] RBAC: Authorizing `identity:create_grant(project_id=36cc228cab0d463ba713ef3af1be99de, user_id=ade96b5d87524a36ad48962e1581c656, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:49.722946 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e71b3-536f-499e-a80a-675233d8e22a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:49.856926 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1185/2360] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:49 2022] PUT /identity/v3/projects/36cc228cab0d463ba713ef3af1be99de/users/ade96b5d87524a36ad48962e1581c656/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:49.869764 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c5a8e-90cb-4aea-8363-bf48a98ce01f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:49.870687 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c5a8e-90cb-4aea-8363-bf48a98ce01f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:49.871891 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c5a8e-90cb-4aea-8363-bf48a98ce01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:49.912218 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a7676-7502-4c19-8a69-fcb81573658b None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:49.912497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a7676-7502-4c19-8a69-fcb81573658b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:49.912812 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a7676-7502-4c19-8a69-fcb81573658b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:49.924762 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-406c5a8e-90cb-4aea-8363-bf48a98ce01f None None] MFA Rules not processed for user `ade96b5d87524a36ad48962e1581c656`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:49.927232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-406c5a8e-90cb-4aea-8363-bf48a98ce01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:49.950929 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-ba7a7676-7502-4c19-8a69-fcb81573658b None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:49.952241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ba7a7676-7502-4c19-8a69-fcb81573658b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:50.066674 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1176/2361] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:36:50.067654 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c5a8e-90cb-4aea-8363-bf48a98ce01f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:50.070426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-406c5a8e-90cb-4aea-8363-bf48a98ce01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:50.088514 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1186/2362] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Sep 5 14:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:36:50.089499 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a7676-7502-4c19-8a69-fcb81573658b None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:50.091444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ba7a7676-7502-4c19-8a69-fcb81573658b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:50.162757 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c5a8e-90cb-4aea-8363-bf48a98ce01f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:50.170289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6a3fa-97d0-4ff0-9aff-3f3f1a3fdf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:50.172059 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6a3fa-97d0-4ff0-9aff-3f3f1a3fdf97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:50.175766 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6a3fa-97d0-4ff0-9aff-3f3f1a3fdf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:50.176752 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6a3fa-97d0-4ff0-9aff-3f3f1a3fdf97 admin admin] PATH_INFO: `/v3/projects/d55903f880ef40b082af99b4af2a1a3c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:50.178724 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6a3fa-97d0-4ff0-9aff-3f3f1a3fdf97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d55903f880ef40b082af99b4af2a1a3c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:50.179827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a7676-7502-4c19-8a69-fcb81573658b None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:50.182136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6a3fa-97d0-4ff0-9aff-3f3f1a3fdf97 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:50.189872 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4395c14-523c-4761-8aef-b61547cba3fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:50.191023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4395c14-523c-4761-8aef-b61547cba3fa service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:50.191312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4395c14-523c-4761-8aef-b61547cba3fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:50.191780 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4395c14-523c-4761-8aef-b61547cba3fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:50.213632 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4395c14-523c-4761-8aef-b61547cba3fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:50.217596 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4395c14-523c-4761-8aef-b61547cba3fa service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:50.266839 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1187/2363] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:50.268243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4395c14-523c-4761-8aef-b61547cba3fa service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:50.270311 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a4395c14-523c-4761-8aef-b61547cba3fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:50.350378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:50.383160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4395c14-523c-4761-8aef-b61547cba3fa service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:50.391390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70458ca6-0c4f-4699-8bd9-816deb7a20a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:50.393015 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70458ca6-0c4f-4699-8bd9-816deb7a20a0 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:50.393484 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70458ca6-0c4f-4699-8bd9-816deb7a20a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:50.394067 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70458ca6-0c4f-4699-8bd9-816deb7a20a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:50.408919 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70458ca6-0c4f-4699-8bd9-816deb7a20a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:50.410606 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70458ca6-0c4f-4699-8bd9-816deb7a20a0 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:50.423080 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1188/2364] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:50.425015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-abe6a3fa-97d0-4ff0-9aff-3f3f1a3fdf97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd55903f880ef40b082af99b4af2a1a3c', 'request_id': 'req-abe6a3fa-97d0-4ff0-9aff-3f3f1a3fdf97'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:50.433198 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-abe6a3fa-97d0-4ff0-9aff-3f3f1a3fdf97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd55903f880ef40b082af99b4af2a1a3c', 'request_id': 'req-abe6a3fa-97d0-4ff0-9aff-3f3f1a3fdf97'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:50.462480 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:50.574967 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-abe6a3fa-97d0-4ff0-9aff-3f3f1a3fdf97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd55903f880ef40b082af99b4af2a1a3c', 'request_id': 'req-abe6a3fa-97d0-4ff0-9aff-3f3f1a3fdf97'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:50.595792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-abe6a3fa-97d0-4ff0-9aff-3f3f1a3fdf97 admin admin] The token cache is being invalidate because project d55903f880ef40b082af99b4af2a1a3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:36:50.596284 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-abe6a3fa-97d0-4ff0-9aff-3f3f1a3fdf97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:50.596961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-abe6a3fa-97d0-4ff0-9aff-3f3f1a3fdf97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:50.600496 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1177/2365] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:36:50 2022] DELETE /identity/v3/projects/d55903f880ef40b082af99b4af2a1a3c => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:50.607119 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569c8dd-8633-42be-9cdb-5deb196d767a None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:50.607699 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569c8dd-8633-42be-9cdb-5deb196d767a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:50.608708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569c8dd-8633-42be-9cdb-5deb196d767a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:50.646557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-4569c8dd-8633-42be-9cdb-5deb196d767a None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:50.647779 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4569c8dd-8633-42be-9cdb-5deb196d767a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:50.772183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1189/2366] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:50.781246 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84276f6b-7add-43a7-bc4a-c3dc9774b673 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:50.781246 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84276f6b-7add-43a7-bc4a-c3dc9774b673 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:50.781627 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84276f6b-7add-43a7-bc4a-c3dc9774b673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:50.803126 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-84276f6b-7add-43a7-bc4a-c3dc9774b673 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:50.804341 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-84276f6b-7add-43a7-bc4a-c3dc9774b673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:50.816914 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1178/2367] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:50.817738 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569c8dd-8633-42be-9cdb-5deb196d767a None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:50.829642 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569c8dd-8633-42be-9cdb-5deb196d767a None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:50.834735 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca13c2-259a-44b9-af5d-02a4a8b9168b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:50.835374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca13c2-259a-44b9-af5d-02a4a8b9168b admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:50.836217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca13c2-259a-44b9-af5d-02a4a8b9168b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:50.836217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca13c2-259a-44b9-af5d-02a4a8b9168b admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:50.837039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca13c2-259a-44b9-af5d-02a4a8b9168b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:36:50.837643 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca13c2-259a-44b9-af5d-02a4a8b9168b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:50.840239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca13c2-259a-44b9-af5d-02a4a8b9168b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:50.854407 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1190/2368] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:36:50.859161 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84276f6b-7add-43a7-bc4a-c3dc9774b673 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:50.868811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84276f6b-7add-43a7-bc4a-c3dc9774b673 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:50.874671 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38bcfb-2cc6-483b-acb3-882f8e308e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:50.876173 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38bcfb-2cc6-483b-acb3-882f8e308e45 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:50.876635 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38bcfb-2cc6-483b-acb3-882f8e308e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:50.877178 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38bcfb-2cc6-483b-acb3-882f8e308e45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:50.878054 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a38bcfb-2cc6-483b-acb3-882f8e308e45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:50.880335 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a38bcfb-2cc6-483b-acb3-882f8e308e45 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:50.995429 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1179/2369] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:36:50 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:50.999675 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca13c2-259a-44b9-af5d-02a4a8b9168b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:51.010652 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca13c2-259a-44b9-af5d-02a4a8b9168b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:51.090321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0148a3e-5a7f-4d3f-9442-d77e42f46c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:51.090970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0148a3e-5a7f-4d3f-9442-d77e42f46c76 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:51.091238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0148a3e-5a7f-4d3f-9442-d77e42f46c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:51.091714 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0148a3e-5a7f-4d3f-9442-d77e42f46c76 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:51.092390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0148a3e-5a7f-4d3f-9442-d77e42f46c76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:51.095174 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0148a3e-5a7f-4d3f-9442-d77e42f46c76 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:51.200434 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1191/2370] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:36:50 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:51.207702 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38bcfb-2cc6-483b-acb3-882f8e308e45 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:51.242070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38bcfb-2cc6-483b-acb3-882f8e308e45 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:51.250973 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4f735-54e7-4eb7-931a-c03d147ff681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:51.252602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4f735-54e7-4eb7-931a-c03d147ff681 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:51.253040 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4f735-54e7-4eb7-931a-c03d147ff681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:51.253567 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4f735-54e7-4eb7-931a-c03d147ff681 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:51.255143 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4f735-54e7-4eb7-931a-c03d147ff681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:51.258127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4f735-54e7-4eb7-931a-c03d147ff681 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:51.278313 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1180/2371] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:51.282701 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0148a3e-5a7f-4d3f-9442-d77e42f46c76 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:51.294171 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0148a3e-5a7f-4d3f-9442-d77e42f46c76 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:51.299717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64c167-2319-4413-a330-4559520874f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:51.300421 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64c167-2319-4413-a330-4559520874f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:51.300656 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64c167-2319-4413-a330-4559520874f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:51.300930 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64c167-2319-4413-a330-4559520874f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:51.301615 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64c167-2319-4413-a330-4559520874f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:51.303255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64c167-2319-4413-a330-4559520874f3 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:51.349364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1192/2372] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:51.349708 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4f735-54e7-4eb7-931a-c03d147ff681 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:51.357039 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4f735-54e7-4eb7-931a-c03d147ff681 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:51.372513 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c7c73-9b0b-46f0-b7ae-217d2b78a749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:51.378064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c7c73-9b0b-46f0-b7ae-217d2b78a749 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:51.378064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c7c73-9b0b-46f0-b7ae-217d2b78a749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:51.378064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c7c73-9b0b-46f0-b7ae-217d2b78a749 admin admin] PATH_INFO: `/v3/projects/b7adff3966fd4e05bb5e8b7e12c2400d/users/c24ddea274ae45d8a3b2ad27675937a4/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:51.418728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c7c73-9b0b-46f0-b7ae-217d2b78a749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7adff3966fd4e05bb5e8b7e12c2400d, user_id=c24ddea274ae45d8a3b2ad27675937a4, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:51.419525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c7c73-9b0b-46f0-b7ae-217d2b78a749 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:51.551378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1181/2373] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:51 2022] PUT /identity/v3/projects/b7adff3966fd4e05bb5e8b7e12c2400d/users/c24ddea274ae45d8a3b2ad27675937a4/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:51.566226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383481e-ce01-4a28-ba1c-eac095c60ebc None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:51.566686 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383481e-ce01-4a28-ba1c-eac095c60ebc None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:51.567179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383481e-ce01-4a28-ba1c-eac095c60ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:51.643354 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-a383481e-ce01-4a28-ba1c-eac095c60ebc None None] MFA Rules not processed for user `c24ddea274ae45d8a3b2ad27675937a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:51.645851 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a383481e-ce01-4a28-ba1c-eac095c60ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:51.692039 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c7c73-9b0b-46f0-b7ae-217d2b78a749 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:51.694489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-770c7c73-9b0b-46f0-b7ae-217d2b78a749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:51.754432 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1193/2374] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:51.771665 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383481e-ce01-4a28-ba1c-eac095c60ebc None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:51.773497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c7c73-9b0b-46f0-b7ae-217d2b78a749 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:51.774625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a383481e-ce01-4a28-ba1c-eac095c60ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:51.778516 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1146c-ab8d-4937-b0c6-718db865d9a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:51.779811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1146c-ab8d-4937-b0c6-718db865d9a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:51.779811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1146c-ab8d-4937-b0c6-718db865d9a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:51.781044 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1146c-ab8d-4937-b0c6-718db865d9a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:51.783148 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-42e1146c-ab8d-4937-b0c6-718db865d9a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:51.790171 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383481e-ce01-4a28-ba1c-eac095c60ebc None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:51.796689 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6701d-ddfd-4814-95b2-be4b802d79ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:51.797433 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6701d-ddfd-4814-95b2-be4b802d79ad service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:51.797716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6701d-ddfd-4814-95b2-be4b802d79ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:51.797994 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6701d-ddfd-4814-95b2-be4b802d79ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:51.810273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6701d-ddfd-4814-95b2-be4b802d79ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:51.813226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6701d-ddfd-4814-95b2-be4b802d79ad service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:51.835409 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1194/2375] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:36:51.928898 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1146c-ab8d-4937-b0c6-718db865d9a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:51.934841 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1146c-ab8d-4937-b0c6-718db865d9a4 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:51.948103 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1182/2376] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:53.944032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab93290-6c49-4bc6-a0d9-03e468e764da None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:53.944576 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab93290-6c49-4bc6-a0d9-03e468e764da None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:53.944576 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab93290-6c49-4bc6-a0d9-03e468e764da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:53.983324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-eab93290-6c49-4bc6-a0d9-03e468e764da None None] MFA Rules not processed for user `45383671ca37408a9be6f17571025bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:53.984917 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-eab93290-6c49-4bc6-a0d9-03e468e764da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:54.060073 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1195/2377] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:54.065893 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1146c-ab8d-4937-b0c6-718db865d9a4 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:54.067327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-42e1146c-ab8d-4937-b0c6-718db865d9a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:54.136282 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1146c-ab8d-4937-b0c6-718db865d9a4 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:54.144154 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43776f-a15c-40ab-be1b-b2c7b7d857d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:54.144753 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43776f-a15c-40ab-be1b-b2c7b7d857d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:54.145028 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43776f-a15c-40ab-be1b-b2c7b7d857d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:54.146527 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43776f-a15c-40ab-be1b-b2c7b7d857d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:54.146527 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43776f-a15c-40ab-be1b-b2c7b7d857d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:54.147880 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43776f-a15c-40ab-be1b-b2c7b7d857d4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:54.306538 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1183/2378] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:36:54 2022] POST /identity/v3/projects => generated 383 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:54.311019 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab93290-6c49-4bc6-a0d9-03e468e764da None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:54.322453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab93290-6c49-4bc6-a0d9-03e468e764da None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:54.383881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1f236-b7d1-4e88-b686-96868e1d0925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:54.384499 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1f236-b7d1-4e88-b686-96868e1d0925 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:54.384780 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1f236-b7d1-4e88-b686-96868e1d0925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:54.385074 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1f236-b7d1-4e88-b686-96868e1d0925 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:54.385723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1f236-b7d1-4e88-b686-96868e1d0925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:54.387656 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1f236-b7d1-4e88-b686-96868e1d0925 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:54.477532 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:54.552904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1196/2379] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:36:54 2022] POST /identity/v3/users => generated 298 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:54.556885 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:54.557959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43776f-a15c-40ab-be1b-b2c7b7d857d4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:54.581541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43776f-a15c-40ab-be1b-b2c7b7d857d4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:54.601087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c737d-b4fd-4109-bb57-191e6ddb0e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:54.601963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c737d-b4fd-4109-bb57-191e6ddb0e1b admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:54.602081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c737d-b4fd-4109-bb57-191e6ddb0e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:54.602276 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c737d-b4fd-4109-bb57-191e6ddb0e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:54.605229 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c737d-b4fd-4109-bb57-191e6ddb0e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:54.607727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c737d-b4fd-4109-bb57-191e6ddb0e1b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:54.629860 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1184/2380] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:54.636127 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1f236-b7d1-4e88-b686-96868e1d0925 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:54.647478 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1f236-b7d1-4e88-b686-96868e1d0925 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:54.653860 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2ab77-74c3-4557-9685-ffeff30556ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:54.654539 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2ab77-74c3-4557-9685-ffeff30556ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:54.654817 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2ab77-74c3-4557-9685-ffeff30556ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:54.655643 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2ab77-74c3-4557-9685-ffeff30556ad admin admin] PATH_INFO: `/v3/projects/93eefb29fde94a62b196c92b4c6a8712/users/b3f4786d42d74013854dd012a4228930/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:54.676629 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2ab77-74c3-4557-9685-ffeff30556ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=93eefb29fde94a62b196c92b4c6a8712, user_id=b3f4786d42d74013854dd012a4228930, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:54.679538 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2ab77-74c3-4557-9685-ffeff30556ad admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:54.808029 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1197/2381] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:54 2022] PUT /identity/v3/projects/93eefb29fde94a62b196c92b4c6a8712/users/b3f4786d42d74013854dd012a4228930/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:54.809791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c737d-b4fd-4109-bb57-191e6ddb0e1b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:54.836400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c737d-b4fd-4109-bb57-191e6ddb0e1b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:54.955094 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a9d13-639b-4afe-8bda-c6e91a8448d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:54.955769 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a9d13-639b-4afe-8bda-c6e91a8448d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:54.956055 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a9d13-639b-4afe-8bda-c6e91a8448d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:54.956331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a9d13-639b-4afe-8bda-c6e91a8448d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:54.956977 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a9d13-639b-4afe-8bda-c6e91a8448d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:54.958646 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a9d13-639b-4afe-8bda-c6e91a8448d9 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:54.975651 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1185/2382] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:54.976344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2ab77-74c3-4557-9685-ffeff30556ad admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:54.989517 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2ab77-74c3-4557-9685-ffeff30556ad admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:54.994899 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291f545-3336-4f83-8d7b-7a146e251e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:54.995565 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291f545-3336-4f83-8d7b-7a146e251e11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:54.995846 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291f545-3336-4f83-8d7b-7a146e251e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:54.996142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291f545-3336-4f83-8d7b-7a146e251e11 admin admin] PATH_INFO: `/v3/projects/93eefb29fde94a62b196c92b4c6a8712/users/b3f4786d42d74013854dd012a4228930/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:54.998217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291f545-3336-4f83-8d7b-7a146e251e11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93eefb29fde94a62b196c92b4c6a8712, user_id=b3f4786d42d74013854dd012a4228930, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:55.000958 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291f545-3336-4f83-8d7b-7a146e251e11 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:55.011467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1198/2383] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:54 2022] PUT /identity/v3/projects/93eefb29fde94a62b196c92b4c6a8712/users/b3f4786d42d74013854dd012a4228930/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:36:56.090443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69220d-a3fc-40e7-af54-4c8c3f609227 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:56.091040 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69220d-a3fc-40e7-af54-4c8c3f609227 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:56.091135 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69220d-a3fc-40e7-af54-4c8c3f609227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:56.103032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291f545-3336-4f83-8d7b-7a146e251e11 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:56.139700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1d69220d-a3fc-40e7-af54-4c8c3f609227 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:56.140925 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1d69220d-a3fc-40e7-af54-4c8c3f609227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:56.247924 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291f545-3336-4f83-8d7b-7a146e251e11 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:56.260666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cbdda-734f-4120-9441-7ad6ff87ea9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:56.266485 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1186/2384] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Sep 5 14:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:56.273802 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cbdda-734f-4120-9441-7ad6ff87ea9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:56.274143 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cbdda-734f-4120-9441-7ad6ff87ea9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:56.274497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cbdda-734f-4120-9441-7ad6ff87ea9c admin admin] PATH_INFO: `/v3/users/c24ddea274ae45d8a3b2ad27675937a4` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:56.276305 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cbdda-734f-4120-9441-7ad6ff87ea9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c24ddea274ae45d8a3b2ad27675937a4)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:56.279189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cbdda-734f-4120-9441-7ad6ff87ea9c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:56.289281 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69220d-a3fc-40e7-af54-4c8c3f609227 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:56.290842 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1d69220d-a3fc-40e7-af54-4c8c3f609227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:56.411845 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69220d-a3fc-40e7-af54-4c8c3f609227 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:56.418285 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b82143-bb50-49ab-83c4-4560e089361f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:56.419042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b82143-bb50-49ab-83c4-4560e089361f service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:56.419356 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b82143-bb50-49ab-83c4-4560e089361f service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:56.419629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b82143-bb50-49ab-83c4-4560e089361f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:56.439546 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b82143-bb50-49ab-83c4-4560e089361f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:56.439546 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b82143-bb50-49ab-83c4-4560e089361f service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:56.447809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1187/2385] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:36:56.597312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-692cbdda-734f-4120-9441-7ad6ff87ea9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c24ddea274ae45d8a3b2ad27675937a4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:56.781573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-692cbdda-734f-4120-9441-7ad6ff87ea9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c24ddea274ae45d8a3b2ad27675937a4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:56.827646 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-692cbdda-734f-4120-9441-7ad6ff87ea9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c24ddea274ae45d8a3b2ad27675937a4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:56.829371 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-692cbdda-734f-4120-9441-7ad6ff87ea9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c24ddea274ae45d8a3b2ad27675937a4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:56.837456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-692cbdda-734f-4120-9441-7ad6ff87ea9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c24ddea274ae45d8a3b2ad27675937a4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:56.864736 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1199/2386] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:36:56 2022] DELETE /identity/v3/users/c24ddea274ae45d8a3b2ad27675937a4 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:36:56.870783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017f53d-49b5-4f75-a151-8fa0ea75f4c2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:56.871341 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017f53d-49b5-4f75-a151-8fa0ea75f4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:56.871869 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017f53d-49b5-4f75-a151-8fa0ea75f4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:56.932304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a017f53d-49b5-4f75-a151-8fa0ea75f4c2 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:56.934496 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a017f53d-49b5-4f75-a151-8fa0ea75f4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:57.053094 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1188/2387] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:57.083871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cbdda-734f-4120-9441-7ad6ff87ea9c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:57.085730 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-692cbdda-734f-4120-9441-7ad6ff87ea9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:57.199700 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cbdda-734f-4120-9441-7ad6ff87ea9c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:57.209398 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef451f4f-4eee-4d4d-9e67-1f2c0af0bbd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:57.216212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef451f4f-4eee-4d4d-9e67-1f2c0af0bbd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:57.216212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef451f4f-4eee-4d4d-9e67-1f2c0af0bbd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:57.216212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef451f4f-4eee-4d4d-9e67-1f2c0af0bbd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:57.225189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef451f4f-4eee-4d4d-9e67-1f2c0af0bbd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:57.226599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef451f4f-4eee-4d4d-9e67-1f2c0af0bbd6 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:57.258798 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1200/2388] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:36:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:36:57.774441 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:58.275891 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017f53d-49b5-4f75-a151-8fa0ea75f4c2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:58.277871 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a017f53d-49b5-4f75-a151-8fa0ea75f4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:58.307223 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017f53d-49b5-4f75-a151-8fa0ea75f4c2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:58.316694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1809dbe-a8be-4758-acc8-61a440dc36be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:58.317614 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1809dbe-a8be-4758-acc8-61a440dc36be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:58.318088 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1809dbe-a8be-4758-acc8-61a440dc36be admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:58.318564 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1809dbe-a8be-4758-acc8-61a440dc36be admin admin] PATH_INFO: `/v3/projects/b7adff3966fd4e05bb5e8b7e12c2400d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:58.320013 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1809dbe-a8be-4758-acc8-61a440dc36be admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7adff3966fd4e05bb5e8b7e12c2400d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:58.322228 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1809dbe-a8be-4758-acc8-61a440dc36be admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:58.600429 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f1809dbe-a8be-4758-acc8-61a440dc36be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7adff3966fd4e05bb5e8b7e12c2400d', 'request_id': 'req-f1809dbe-a8be-4758-acc8-61a440dc36be'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:58.647076 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f1809dbe-a8be-4758-acc8-61a440dc36be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7adff3966fd4e05bb5e8b7e12c2400d', 'request_id': 'req-f1809dbe-a8be-4758-acc8-61a440dc36be'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:58.735414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d969f1d-c616-48c5-ad9c-e3ddc6e76b13 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:58.735942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d969f1d-c616-48c5-ad9c-e3ddc6e76b13 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:58.736043 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d969f1d-c616-48c5-ad9c-e3ddc6e76b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:58.746644 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f1809dbe-a8be-4758-acc8-61a440dc36be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7adff3966fd4e05bb5e8b7e12c2400d', 'request_id': 'req-f1809dbe-a8be-4758-acc8-61a440dc36be'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:58.761476 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f1809dbe-a8be-4758-acc8-61a440dc36be admin admin] The token cache is being invalidate because project b7adff3966fd4e05bb5e8b7e12c2400d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:36:58.762021 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f1809dbe-a8be-4758-acc8-61a440dc36be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:58.763028 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f1809dbe-a8be-4758-acc8-61a440dc36be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:58.766845 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1189/2389] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:36:58 2022] DELETE /identity/v3/projects/b7adff3966fd4e05bb5e8b7e12c2400d => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:58.771704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b12f9-f860-475f-ab3b-b21e962bb24e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:58.772272 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-0d969f1d-c616-48c5-ad9c-e3ddc6e76b13 None None] MFA Rules not processed for user `635e47d0a5a34fdfb5c8967a96a87828`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:58.772578 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b12f9-f860-475f-ab3b-b21e962bb24e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:58.773048 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b12f9-f860-475f-ab3b-b21e962bb24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:58.773521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0d969f1d-c616-48c5-ad9c-e3ddc6e76b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:58.815682 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5e0b12f9-f860-475f-ab3b-b21e962bb24e None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:58.817233 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5e0b12f9-f860-475f-ab3b-b21e962bb24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:58.914992 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1201/2390] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 5 14:36:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:36:58.941534 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1190/2391] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:58.949503 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab0c43-9884-4270-9b73-da1a8839e055 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:58.949796 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab0c43-9884-4270-9b73-da1a8839e055 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:58.950254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab0c43-9884-4270-9b73-da1a8839e055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:58.991304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b12f9-f860-475f-ab3b-b21e962bb24e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:58.993320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5e0b12f9-f860-475f-ab3b-b21e962bb24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:59.018408 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-5dab0c43-9884-4270-9b73-da1a8839e055 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:59.021576 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5dab0c43-9884-4270-9b73-da1a8839e055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:59.039732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1202/2392] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:36:59.044901 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab0c43-9884-4270-9b73-da1a8839e055 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:59.059695 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab0c43-9884-4270-9b73-da1a8839e055 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:59.069219 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7803b4c-9a97-418c-b50f-28ba6f22392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:59.072676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7803b4c-9a97-418c-b50f-28ba6f22392a admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:59.072676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7803b4c-9a97-418c-b50f-28ba6f22392a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:59.072676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7803b4c-9a97-418c-b50f-28ba6f22392a admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:59.072676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7803b4c-9a97-418c-b50f-28ba6f22392a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:36:59.072676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7803b4c-9a97-418c-b50f-28ba6f22392a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:59.075083 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7803b4c-9a97-418c-b50f-28ba6f22392a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:59.097010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1203/2393] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:36:59.098973 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7803b4c-9a97-418c-b50f-28ba6f22392a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:59.118711 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7803b4c-9a97-418c-b50f-28ba6f22392a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:59.125575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a3092-4400-418a-82e2-2ec187142272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:59.127572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a3092-4400-418a-82e2-2ec187142272 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:59.128220 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a3092-4400-418a-82e2-2ec187142272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:59.128655 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a3092-4400-418a-82e2-2ec187142272 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:59.129797 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a3092-4400-418a-82e2-2ec187142272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:59.132424 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a3092-4400-418a-82e2-2ec187142272 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:59.158775 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:59.178865 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b12f9-f860-475f-ab3b-b21e962bb24e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:59.189953 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7cc3a3-3bb2-40ae-b706-a3235b8a44ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed60e9eecb94ef39c2f4a5e5f50d670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:59.190786 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7cc3a3-3bb2-40ae-b706-a3235b8a44ec service swift] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:59.191341 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7cc3a3-3bb2-40ae-b706-a3235b8a44ec service swift] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:59.191876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7cc3a3-3bb2-40ae-b706-a3235b8a44ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:59.230160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7cc3a3-3bb2-40ae-b706-a3235b8a44ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:59.231795 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7cc3a3-3bb2-40ae-b706-a3235b8a44ec service swift] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:59.260668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1191/2394] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 5 14:36:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 05 14:36:59.260668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7cc3a3-3bb2-40ae-b706-a3235b8a44ec service swift] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:59.260668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5e7cc3a3-3bb2-40ae-b706-a3235b8a44ec service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:59.280781 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7cc3a3-3bb2-40ae-b706-a3235b8a44ec service swift] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:59.287479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9bca3-eaf8-44fe-a20e-e92861bd7933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:59.288587 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9bca3-eaf8-44fe-a20e-e92861bd7933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:59.289852 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9bca3-eaf8-44fe-a20e-e92861bd7933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:59.300435 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9bca3-eaf8-44fe-a20e-e92861bd7933 admin admin] PATH_INFO: `/v3/users/76aaed21a9bf4226bcfd722f1e1a325d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:59.306125 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1204/2395] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:36:59 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:59.307263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a3092-4400-418a-82e2-2ec187142272 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:59.310491 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9bca3-eaf8-44fe-a20e-e92861bd7933 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76aaed21a9bf4226bcfd722f1e1a325d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:59.317462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9bca3-eaf8-44fe-a20e-e92861bd7933 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:59.456780 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a3092-4400-418a-82e2-2ec187142272 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:59.467045 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3100456-71d9-412c-b511-2fc1e7a7d2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:59.468559 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3100456-71d9-412c-b511-2fc1e7a7d2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:59.468933 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3100456-71d9-412c-b511-2fc1e7a7d2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:59.469464 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3100456-71d9-412c-b511-2fc1e7a7d2a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:59.472257 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3100456-71d9-412c-b511-2fc1e7a7d2a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:59.472416 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3100456-71d9-412c-b511-2fc1e7a7d2a6 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:59.610108 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1205/2396] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:36:59 2022] POST /identity/v3/users => generated 287 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:36:59.614460 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3100456-71d9-412c-b511-2fc1e7a7d2a6 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:59.664273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3100456-71d9-412c-b511-2fc1e7a7d2a6 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:59.677366 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-78b9bca3-eaf8-44fe-a20e-e92861bd7933 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76aaed21a9bf4226bcfd722f1e1a325d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:59.680353 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-78b9bca3-eaf8-44fe-a20e-e92861bd7933 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76aaed21a9bf4226bcfd722f1e1a325d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:59.685690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ecf92-d517-442c-99df-9ab6e69fffd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:59.689986 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ecf92-d517-442c-99df-9ab6e69fffd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:59.692791 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ecf92-d517-442c-99df-9ab6e69fffd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:59.693225 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ecf92-d517-442c-99df-9ab6e69fffd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:59.694019 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ecf92-d517-442c-99df-9ab6e69fffd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:59.698362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ecf92-d517-442c-99df-9ab6e69fffd1 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:59.742905 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1206/2397] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:59.744869 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ecf92-d517-442c-99df-9ab6e69fffd1 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:59.753406 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-bc8ecf92-d517-442c-99df-9ab6e69fffd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:36:59.802512 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-78b9bca3-eaf8-44fe-a20e-e92861bd7933 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76aaed21a9bf4226bcfd722f1e1a325d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:59.806070 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ecf92-d517-442c-99df-9ab6e69fffd1 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:59.824773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-78b9bca3-eaf8-44fe-a20e-e92861bd7933 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76aaed21a9bf4226bcfd722f1e1a325d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:59.828727 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39098999-32ef-4e95-92bd-441052c1c6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:36:59.829373 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39098999-32ef-4e95-92bd-441052c1c6fb admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:59.830230 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39098999-32ef-4e95-92bd-441052c1c6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:59.830697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39098999-32ef-4e95-92bd-441052c1c6fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:59.830818 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-78b9bca3-eaf8-44fe-a20e-e92861bd7933 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76aaed21a9bf4226bcfd722f1e1a325d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:36:59.831781 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39098999-32ef-4e95-92bd-441052c1c6fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:36:59.837113 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39098999-32ef-4e95-92bd-441052c1c6fb admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:36:59.852181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1207/2398] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:36:59.857123 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39098999-32ef-4e95-92bd-441052c1c6fb admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:36:59.866385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1192/2399] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:36:59 2022] DELETE /identity/v3/users/76aaed21a9bf4226bcfd722f1e1a325d => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:36:59.871913 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39098999-32ef-4e95-92bd-441052c1c6fb admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:36:59.872319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327abb0c-ebaf-4220-abf5-cca64654556b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:36:59.872599 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327abb0c-ebaf-4220-abf5-cca64654556b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:36:59.872887 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327abb0c-ebaf-4220-abf5-cca64654556b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:36:59.931114 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-327abb0c-ebaf-4220-abf5-cca64654556b None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:36:59.934745 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-327abb0c-ebaf-4220-abf5-cca64654556b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:00.016705 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f536e-607f-4f94-8f79-c292799e3a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:00.017535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f536e-607f-4f94-8f79-c292799e3a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:00.017991 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f536e-607f-4f94-8f79-c292799e3a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:00.018371 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f536e-607f-4f94-8f79-c292799e3a06 admin admin] PATH_INFO: `/v3/projects/bee18fb9bfeb4e61a503d48c4f0f588a/users/5823781bf0d445beb31b1b3177b09001/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:00.039926 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f536e-607f-4f94-8f79-c292799e3a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bee18fb9bfeb4e61a503d48c4f0f588a, user_id=5823781bf0d445beb31b1b3177b09001, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:00.044210 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f536e-607f-4f94-8f79-c292799e3a06 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:00.090668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1193/2400] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:37:00.192628 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1208/2401] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:36:59 2022] PUT /identity/v3/projects/bee18fb9bfeb4e61a503d48c4f0f588a/users/5823781bf0d445beb31b1b3177b09001/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:37:00.197631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d2534-e805-433d-af5b-2884c71841a6 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:00.198153 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d2534-e805-433d-af5b-2884c71841a6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:00.199049 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d2534-e805-433d-af5b-2884c71841a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:00.266049 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-295d2534-e805-433d-af5b-2884c71841a6 None None] MFA Rules not processed for user `5823781bf0d445beb31b1b3177b09001`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:00.268160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-295d2534-e805-433d-af5b-2884c71841a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:00.427365 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f536e-607f-4f94-8f79-c292799e3a06 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:00.429540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1a9f536e-607f-4f94-8f79-c292799e3a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:00.457875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1194/2402] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:37:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:37:00.461725 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d2534-e805-433d-af5b-2884c71841a6 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:00.463097 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-295d2534-e805-433d-af5b-2884c71841a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:00.579330 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d2534-e805-433d-af5b-2884c71841a6 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:00.583834 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c50ac-7670-460d-9a60-663c12e63d47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:00.584461 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c50ac-7670-460d-9a60-663c12e63d47 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:00.584744 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c50ac-7670-460d-9a60-663c12e63d47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:00.585017 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c50ac-7670-460d-9a60-663c12e63d47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:00.613005 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c50ac-7670-460d-9a60-663c12e63d47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:00.615363 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c50ac-7670-460d-9a60-663c12e63d47 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:00.647661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f536e-607f-4f94-8f79-c292799e3a06 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:00.657353 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1195/2403] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:37:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:37:00.680129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562d23a-922c-4f6b-8d51-5d00c3dab0d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:00.683276 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562d23a-922c-4f6b-8d51-5d00c3dab0d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:00.683276 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562d23a-922c-4f6b-8d51-5d00c3dab0d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:00.683276 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562d23a-922c-4f6b-8d51-5d00c3dab0d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:00.990766 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562d23a-922c-4f6b-8d51-5d00c3dab0d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:00.995658 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562d23a-922c-4f6b-8d51-5d00c3dab0d1 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:01.023217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1209/2404] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:37:01.435887 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4731f-8006-4a07-8481-eec1a0df9ed6 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:01.437248 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4731f-8006-4a07-8481-eec1a0df9ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:01.437913 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4731f-8006-4a07-8481-eec1a0df9ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:01.490720 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f3a4731f-8006-4a07-8481-eec1a0df9ed6 None None] MFA Rules not processed for user `0a11601da6724a97b4f5acc5b06b2811`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:01.497128 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f3a4731f-8006-4a07-8481-eec1a0df9ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:01.632374 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1196/2405] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:37:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:37:01.666923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fb5b3-03ce-465b-a1b8-27ec16fe2d0d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:01.667220 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fb5b3-03ce-465b-a1b8-27ec16fe2d0d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:01.667891 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fb5b3-03ce-465b-a1b8-27ec16fe2d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:01.731096 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-354fb5b3-03ce-465b-a1b8-27ec16fe2d0d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:01.737551 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-354fb5b3-03ce-465b-a1b8-27ec16fe2d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:01.755157 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1210/2406] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Sep 5 14:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:37:01.789922 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4731f-8006-4a07-8481-eec1a0df9ed6 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:01.791742 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f3a4731f-8006-4a07-8481-eec1a0df9ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:02.010978 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4731f-8006-4a07-8481-eec1a0df9ed6 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:02.027227 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd389e-85d6-46f0-b7d8-92687e358433 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:02.028240 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd389e-85d6-46f0-b7d8-92687e358433 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:02.028430 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd389e-85d6-46f0-b7d8-92687e358433 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:02.028745 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd389e-85d6-46f0-b7d8-92687e358433 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:02.036173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fb5b3-03ce-465b-a1b8-27ec16fe2d0d None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:02.037985 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-354fb5b3-03ce-465b-a1b8-27ec16fe2d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:02.103374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fb5b3-03ce-465b-a1b8-27ec16fe2d0d None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:02.115309 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd389e-85d6-46f0-b7d8-92687e358433 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:02.122584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd389e-85d6-46f0-b7d8-92687e358433 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:02.147405 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a2433-dd9e-4242-a4d5-ac112db4ebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:02.149089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a2433-dd9e-4242-a4d5-ac112db4ebd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:02.154371 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a2433-dd9e-4242-a4d5-ac112db4ebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:02.156786 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a2433-dd9e-4242-a4d5-ac112db4ebd3 admin admin] PATH_INFO: `/v3/projects/a3b4345269ca4013881a124680303254` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:02.165509 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a2433-dd9e-4242-a4d5-ac112db4ebd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3b4345269ca4013881a124680303254)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:02.167478 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a2433-dd9e-4242-a4d5-ac112db4ebd3 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:02.176639 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1197/2407] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:37:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:37:02.197469 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:02.388244 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-233a2433-dd9e-4242-a4d5-ac112db4ebd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b4345269ca4013881a124680303254', 'request_id': 'req-233a2433-dd9e-4242-a4d5-ac112db4ebd3'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:02.400238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-233a2433-dd9e-4242-a4d5-ac112db4ebd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b4345269ca4013881a124680303254', 'request_id': 'req-233a2433-dd9e-4242-a4d5-ac112db4ebd3'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:02.502575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-233a2433-dd9e-4242-a4d5-ac112db4ebd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b4345269ca4013881a124680303254', 'request_id': 'req-233a2433-dd9e-4242-a4d5-ac112db4ebd3'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:02.521813 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-233a2433-dd9e-4242-a4d5-ac112db4ebd3 admin admin] The token cache is being invalidate because project a3b4345269ca4013881a124680303254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:37:02.522544 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-233a2433-dd9e-4242-a4d5-ac112db4ebd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:02.524115 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-233a2433-dd9e-4242-a4d5-ac112db4ebd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:02.532067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd389e-85d6-46f0-b7d8-92687e358433 service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:02.533306 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1211/2408] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:37:02 2022] DELETE /identity/v3/projects/a3b4345269ca4013881a124680303254 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:37:02.548398 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd389e-85d6-46f0-b7d8-92687e358433 service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:02.718986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291912be-315a-44a2-8504-a0418b8c27ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:02.719934 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291912be-315a-44a2-8504-a0418b8c27ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:02.720372 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291912be-315a-44a2-8504-a0418b8c27ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:02.720943 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291912be-315a-44a2-8504-a0418b8c27ba admin admin] PATH_INFO: `/v3/users/f7dfe641b5454e31a43a00086e2b2ae1` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:02.722364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291912be-315a-44a2-8504-a0418b8c27ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7dfe641b5454e31a43a00086e2b2ae1)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:02.724857 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291912be-315a-44a2-8504-a0418b8c27ba admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:03.044965 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:03.091975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-291912be-315a-44a2-8504-a0418b8c27ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7dfe641b5454e31a43a00086e2b2ae1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:03.099550 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-291912be-315a-44a2-8504-a0418b8c27ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7dfe641b5454e31a43a00086e2b2ae1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:03.221262 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-291912be-315a-44a2-8504-a0418b8c27ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7dfe641b5454e31a43a00086e2b2ae1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:03.242245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-291912be-315a-44a2-8504-a0418b8c27ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7dfe641b5454e31a43a00086e2b2ae1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:03.252551 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-291912be-315a-44a2-8504-a0418b8c27ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7dfe641b5454e31a43a00086e2b2ae1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:03.265654 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1198/2409] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:37:02 2022] DELETE /identity/v3/users/f7dfe641b5454e31a43a00086e2b2ae1 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:37:04.102995 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a2433-dd9e-4242-a4d5-ac112db4ebd3 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:04.104636 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-233a2433-dd9e-4242-a4d5-ac112db4ebd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:04.207885 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a2433-dd9e-4242-a4d5-ac112db4ebd3 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:04.437979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902c33c-b643-4368-b896-ff0171845c56 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:04.437979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902c33c-b643-4368-b896-ff0171845c56 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:04.437979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902c33c-b643-4368-b896-ff0171845c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:04.456406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1902c33c-b643-4368-b896-ff0171845c56 None None] MFA Rules not processed for user `5823781bf0d445beb31b1b3177b09001`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:04.461183 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1902c33c-b643-4368-b896-ff0171845c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:04.540256 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623db6fd-92e4-46fd-8010-a7f00580f998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:04.541004 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623db6fd-92e4-46fd-8010-a7f00580f998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:04.545874 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623db6fd-92e4-46fd-8010-a7f00580f998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:04.546298 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623db6fd-92e4-46fd-8010-a7f00580f998 admin admin] PATH_INFO: `/v3/projects/09afa17bcecc427fb1c56ca57d4da25a` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:04.549838 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623db6fd-92e4-46fd-8010-a7f00580f998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09afa17bcecc427fb1c56ca57d4da25a)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:04.563057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623db6fd-92e4-46fd-8010-a7f00580f998 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:04.667329 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1199/2410] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:37:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:37:04.822723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-623db6fd-92e4-46fd-8010-a7f00580f998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09afa17bcecc427fb1c56ca57d4da25a', 'request_id': 'req-623db6fd-92e4-46fd-8010-a7f00580f998'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:04.830390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-623db6fd-92e4-46fd-8010-a7f00580f998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09afa17bcecc427fb1c56ca57d4da25a', 'request_id': 'req-623db6fd-92e4-46fd-8010-a7f00580f998'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:04.906394 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-623db6fd-92e4-46fd-8010-a7f00580f998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09afa17bcecc427fb1c56ca57d4da25a', 'request_id': 'req-623db6fd-92e4-46fd-8010-a7f00580f998'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:04.928176 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-623db6fd-92e4-46fd-8010-a7f00580f998 admin admin] The token cache is being invalidate because project 09afa17bcecc427fb1c56ca57d4da25a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:37:04.928481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-623db6fd-92e4-46fd-8010-a7f00580f998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:04.933433 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-623db6fd-92e4-46fd-8010-a7f00580f998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:04.935607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1212/2411] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:37:04 2022] DELETE /identity/v3/projects/09afa17bcecc427fb1c56ca57d4da25a => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:37:04.939391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902c33c-b643-4368-b896-ff0171845c56 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:04.942245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1902c33c-b643-4368-b896-ff0171845c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:04.968806 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902c33c-b643-4368-b896-ff0171845c56 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:05.121899 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59769053-56dc-48e1-a091-277e0235a8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:05.122585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59769053-56dc-48e1-a091-277e0235a8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:05.122873 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59769053-56dc-48e1-a091-277e0235a8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:05.123155 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59769053-56dc-48e1-a091-277e0235a8ff admin admin] PATH_INFO: `/v3/users/1dd71f1bb2e4401f93397384b1d2384e` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:05.125320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59769053-56dc-48e1-a091-277e0235a8ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dd71f1bb2e4401f93397384b1d2384e)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:05.138361 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59769053-56dc-48e1-a091-277e0235a8ff admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:05.317977 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:05.479178 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-59769053-56dc-48e1-a091-277e0235a8ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dd71f1bb2e4401f93397384b1d2384e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:05.480616 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-59769053-56dc-48e1-a091-277e0235a8ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dd71f1bb2e4401f93397384b1d2384e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:05.543459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:05.676254 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-59769053-56dc-48e1-a091-277e0235a8ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dd71f1bb2e4401f93397384b1d2384e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:05.696132 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-59769053-56dc-48e1-a091-277e0235a8ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dd71f1bb2e4401f93397384b1d2384e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:05.697295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-59769053-56dc-48e1-a091-277e0235a8ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dd71f1bb2e4401f93397384b1d2384e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:05.728985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1200/2412] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:37:04 2022] DELETE /identity/v3/users/1dd71f1bb2e4401f93397384b1d2384e => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:37:06.524516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ccc5d-21ee-4977-9a32-01c13e90ed7a None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:06.528734 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ccc5d-21ee-4977-9a32-01c13e90ed7a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:06.529094 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ccc5d-21ee-4977-9a32-01c13e90ed7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:06.582319 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-790ccc5d-21ee-4977-9a32-01c13e90ed7a None None] MFA Rules not processed for user `b3f4786d42d74013854dd012a4228930`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:06.583829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-790ccc5d-21ee-4977-9a32-01c13e90ed7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:06.692882 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1213/2413] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:37:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:37:06.708387 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59769053-56dc-48e1-a091-277e0235a8ff admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:06.714368 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-59769053-56dc-48e1-a091-277e0235a8ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:06.828568 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59769053-56dc-48e1-a091-277e0235a8ff admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:06.833661 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5377f-201a-4ff3-ab77-5bc29607a32a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a7e9f0daa1c48eca87d92ced265afdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:06.834284 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5377f-201a-4ff3-ab77-5bc29607a32a service glance] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:06.834606 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5377f-201a-4ff3-ab77-5bc29607a32a service glance] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:06.834878 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5377f-201a-4ff3-ab77-5bc29607a32a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:06.836737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a7e5377f-201a-4ff3-ab77-5bc29607a32a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:06.953282 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ccc5d-21ee-4977-9a32-01c13e90ed7a None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:06.955512 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-790ccc5d-21ee-4977-9a32-01c13e90ed7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:07.016825 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5377f-201a-4ff3-ab77-5bc29607a32a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:07.020694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5377f-201a-4ff3-ab77-5bc29607a32a service glance] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:07.045593 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1201/2414] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:37:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:37:07.111810 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ccc5d-21ee-4977-9a32-01c13e90ed7a None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:07.116952 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4437b-164b-48c9-b8e8-1e792df6edff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:07.117947 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4437b-164b-48c9-b8e8-1e792df6edff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:07.118445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4437b-164b-48c9-b8e8-1e792df6edff admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:07.118949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4437b-164b-48c9-b8e8-1e792df6edff admin admin] PATH_INFO: `/v3/projects/6226109bbc2c43eab24b18782f8afa9d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:07.120389 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4437b-164b-48c9-b8e8-1e792df6edff admin admin] RBAC: Authorizing `identity:delete_project(project_id=6226109bbc2c43eab24b18782f8afa9d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:07.122818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4437b-164b-48c9-b8e8-1e792df6edff admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:07.286441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc959b8-0f2c-4bc7-9c19-b0a33bac5e3e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:07.286441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc959b8-0f2c-4bc7-9c19-b0a33bac5e3e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:07.286441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc959b8-0f2c-4bc7-9c19-b0a33bac5e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:07.348418 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3bc959b8-0f2c-4bc7-9c19-b0a33bac5e3e None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:07.368933 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3bc959b8-0f2c-4bc7-9c19-b0a33bac5e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:07.385740 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-aca4437b-164b-48c9-b8e8-1e792df6edff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6226109bbc2c43eab24b18782f8afa9d', 'request_id': 'req-aca4437b-164b-48c9-b8e8-1e792df6edff'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:07.422638 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-aca4437b-164b-48c9-b8e8-1e792df6edff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6226109bbc2c43eab24b18782f8afa9d', 'request_id': 'req-aca4437b-164b-48c9-b8e8-1e792df6edff'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:07.557285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-aca4437b-164b-48c9-b8e8-1e792df6edff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6226109bbc2c43eab24b18782f8afa9d', 'request_id': 'req-aca4437b-164b-48c9-b8e8-1e792df6edff'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:07.580263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-aca4437b-164b-48c9-b8e8-1e792df6edff admin admin] The token cache is being invalidate because project 6226109bbc2c43eab24b18782f8afa9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:37:07.580570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-aca4437b-164b-48c9-b8e8-1e792df6edff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:07.582326 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-aca4437b-164b-48c9-b8e8-1e792df6edff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:07.585947 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1214/2415] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:37:06 2022] DELETE /identity/v3/projects/6226109bbc2c43eab24b18782f8afa9d => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:37:07.591559 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31257d7a-c188-415f-b1d8-9e3726b0d4cb None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:07.594582 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31257d7a-c188-415f-b1d8-9e3726b0d4cb None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:07.597313 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31257d7a-c188-415f-b1d8-9e3726b0d4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:07.620749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1202/2416] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Sep 5 14:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:37:07.650985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751126b-e19d-46fc-b308-3d59e52ebb82 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:07.651578 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751126b-e19d-46fc-b308-3d59e52ebb82 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:07.651936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751126b-e19d-46fc-b308-3d59e52ebb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:07.663909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-31257d7a-c188-415f-b1d8-9e3726b0d4cb None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:07.665637 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-31257d7a-c188-415f-b1d8-9e3726b0d4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:07.699111 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1215/2417] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:37:07.700335 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31257d7a-c188-415f-b1d8-9e3726b0d4cb None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:07.707934 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-31257d7a-c188-415f-b1d8-9e3726b0d4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:07.725538 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b751126b-e19d-46fc-b308-3d59e52ebb82 None None] MFA Rules not processed for user `635e47d0a5a34fdfb5c8967a96a87828`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:07.731100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b751126b-e19d-46fc-b308-3d59e52ebb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:07.906651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31257d7a-c188-415f-b1d8-9e3726b0d4cb None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:07.913438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcafe2-97b3-471b-87cc-3aa096379634 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:07.917572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcafe2-97b3-471b-87cc-3aa096379634 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:07.917922 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcafe2-97b3-471b-87cc-3aa096379634 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:07.918271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcafe2-97b3-471b-87cc-3aa096379634 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:07.942216 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1203/2418] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 5 14:37:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:37:07.944589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcafe2-97b3-471b-87cc-3aa096379634 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:07.946208 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f65b7-087d-45bb-a30c-c694a869657f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:07.946728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f65b7-087d-45bb-a30c-c694a869657f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:07.947012 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcafe2-97b3-471b-87cc-3aa096379634 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:07.947480 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f65b7-087d-45bb-a30c-c694a869657f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:07.962913 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:07.972070 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1216/2419] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:37:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:37:07.972954 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcafe2-97b3-471b-87cc-3aa096379634 service nova] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:07.976661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9efcafe2-97b3-471b-87cc-3aa096379634 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:07.996901 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ed1f65b7-087d-45bb-a30c-c694a869657f None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:07.998462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ed1f65b7-087d-45bb-a30c-c694a869657f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:08.018791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1204/2420] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:37:08.023417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f65b7-087d-45bb-a30c-c694a869657f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:08.042341 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f65b7-087d-45bb-a30c-c694a869657f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:08.069101 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e19f7-2bd7-46fc-8f5c-bdb24ac8771f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:08.070092 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e19f7-2bd7-46fc-8f5c-bdb24ac8771f admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:08.072301 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e19f7-2bd7-46fc-8f5c-bdb24ac8771f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:08.072761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e19f7-2bd7-46fc-8f5c-bdb24ac8771f admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:08.075655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e19f7-2bd7-46fc-8f5c-bdb24ac8771f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:37:08.078881 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e19f7-2bd7-46fc-8f5c-bdb24ac8771f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:08.083646 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e19f7-2bd7-46fc-8f5c-bdb24ac8771f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:08.126391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1205/2421] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:37:08.132794 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e19f7-2bd7-46fc-8f5c-bdb24ac8771f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:08.150354 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e19f7-2bd7-46fc-8f5c-bdb24ac8771f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:08.164961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bce5f9-a956-4856-ad78-72470ed99d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:08.166040 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bce5f9-a956-4856-ad78-72470ed99d89 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:08.166546 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bce5f9-a956-4856-ad78-72470ed99d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:08.167053 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bce5f9-a956-4856-ad78-72470ed99d89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:08.168507 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bce5f9-a956-4856-ad78-72470ed99d89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:08.170722 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bce5f9-a956-4856-ad78-72470ed99d89 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:08.174299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcafe2-97b3-471b-87cc-3aa096379634 service nova] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:08.188279 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a336a5a-c211-41f3-acf6-e7e144ba2f44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed60e9eecb94ef39c2f4a5e5f50d670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:08.189014 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a336a5a-c211-41f3-acf6-e7e144ba2f44 service swift] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:08.189360 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a336a5a-c211-41f3-acf6-e7e144ba2f44 service swift] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:08.189610 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a336a5a-c211-41f3-acf6-e7e144ba2f44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:08.223389 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a336a5a-c211-41f3-acf6-e7e144ba2f44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:08.225088 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a336a5a-c211-41f3-acf6-e7e144ba2f44 service swift] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:08.236948 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1217/2422] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 5 14:37:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 14:37:08.337583 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a336a5a-c211-41f3-acf6-e7e144ba2f44 service swift] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:08.352290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a336a5a-c211-41f3-acf6-e7e144ba2f44 service swift] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:08.362288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1206/2423] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:37:08 2022] POST /identity/v3/projects => generated 367 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:37:08.472823 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0058ce-8e0a-4cfc-ba97-affc7ecead8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:08.473694 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0058ce-8e0a-4cfc-ba97-affc7ecead8a admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:08.474055 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0058ce-8e0a-4cfc-ba97-affc7ecead8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:08.474400 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0058ce-8e0a-4cfc-ba97-affc7ecead8a admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:08.476053 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0058ce-8e0a-4cfc-ba97-affc7ecead8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:08.480569 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0058ce-8e0a-4cfc-ba97-affc7ecead8a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:08.759857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1218/2424] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:37:08 2022] POST /identity/v3/users => generated 284 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:37:08.763076 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bce5f9-a956-4856-ad78-72470ed99d89 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:08.776429 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bce5f9-a956-4856-ad78-72470ed99d89 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:08.806717 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ce236-2ece-4b31-ae72-1b5de4a13920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:08.807852 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ce236-2ece-4b31-ae72-1b5de4a13920 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:08.808290 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ce236-2ece-4b31-ae72-1b5de4a13920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:08.808735 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ce236-2ece-4b31-ae72-1b5de4a13920 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:08.809843 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ce236-2ece-4b31-ae72-1b5de4a13920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:08.813585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ce236-2ece-4b31-ae72-1b5de4a13920 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:08.856015 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0058ce-8e0a-4cfc-ba97-affc7ecead8a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:08.858904 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1207/2425] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:37:08.871567 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0058ce-8e0a-4cfc-ba97-affc7ecead8a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:08.901467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb8f2b-196d-4623-b7f4-0dc95824c295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:08.908173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb8f2b-196d-4623-b7f4-0dc95824c295 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:08.911083 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb8f2b-196d-4623-b7f4-0dc95824c295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:08.911483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb8f2b-196d-4623-b7f4-0dc95824c295 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:08.916258 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb8f2b-196d-4623-b7f4-0dc95824c295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:08.921982 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb8f2b-196d-4623-b7f4-0dc95824c295 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:08.948738 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1219/2426] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:37:08.955355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ce236-2ece-4b31-ae72-1b5de4a13920 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:08.967075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ce236-2ece-4b31-ae72-1b5de4a13920 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:08.994412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accc684-17b7-428a-af80-0e04c123bc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:08.995108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accc684-17b7-428a-af80-0e04c123bc4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:08.995394 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accc684-17b7-428a-af80-0e04c123bc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:09.001919 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accc684-17b7-428a-af80-0e04c123bc4f admin admin] PATH_INFO: `/v3/projects/f2a12e3a110a449491eeded5b62a10c5/users/56a86d423a34413f8cc1edbc39382c88/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:09.042598 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accc684-17b7-428a-af80-0e04c123bc4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a12e3a110a449491eeded5b62a10c5, user_id=56a86d423a34413f8cc1edbc39382c88, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:09.051593 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accc684-17b7-428a-af80-0e04c123bc4f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:09.054680 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:09.147008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1208/2427] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:37:08 2022] PUT /identity/v3/projects/f2a12e3a110a449491eeded5b62a10c5/users/56a86d423a34413f8cc1edbc39382c88/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:37:09.165173 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd20a0-b180-4c3c-81ce-ddea349528d3 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:09.165609 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd20a0-b180-4c3c-81ce-ddea349528d3 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:09.165981 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd20a0-b180-4c3c-81ce-ddea349528d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:09.240719 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c3dd20a0-b180-4c3c-81ce-ddea349528d3 None None] MFA Rules not processed for user `56a86d423a34413f8cc1edbc39382c88`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:09.244338 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c3dd20a0-b180-4c3c-81ce-ddea349528d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:09.399412 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1220/2428] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:37:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:37:10.284487 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:11.192707 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:12.670271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:13.729527 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:14.253041 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:16.511206 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accc684-17b7-428a-af80-0e04c123bc4f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:16.512947 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3accc684-17b7-428a-af80-0e04c123bc4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:16.644996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accc684-17b7-428a-af80-0e04c123bc4f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:16.650596 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b296f8-1bf0-4915-8b51-ffd0d855790f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:16.651779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b296f8-1bf0-4915-8b51-ffd0d855790f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:16.652294 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b296f8-1bf0-4915-8b51-ffd0d855790f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:16.652992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b296f8-1bf0-4915-8b51-ffd0d855790f admin admin] PATH_INFO: `/v3/users/ade96b5d87524a36ad48962e1581c656` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:16.654453 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b296f8-1bf0-4915-8b51-ffd0d855790f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ade96b5d87524a36ad48962e1581c656)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:16.657485 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b296f8-1bf0-4915-8b51-ffd0d855790f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:16.692649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:16.913999 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-48b296f8-1bf0-4915-8b51-ffd0d855790f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ade96b5d87524a36ad48962e1581c656'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:16.914864 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-48b296f8-1bf0-4915-8b51-ffd0d855790f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ade96b5d87524a36ad48962e1581c656'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:17.048720 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-48b296f8-1bf0-4915-8b51-ffd0d855790f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ade96b5d87524a36ad48962e1581c656'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:17.076602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-48b296f8-1bf0-4915-8b51-ffd0d855790f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ade96b5d87524a36ad48962e1581c656'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:17.078069 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-48b296f8-1bf0-4915-8b51-ffd0d855790f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ade96b5d87524a36ad48962e1581c656'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:17.112633 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1209/2429] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:37:16 2022] DELETE /identity/v3/users/ade96b5d87524a36ad48962e1581c656 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:37:17.116210 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423bd33-5688-402c-9808-d77c242c2ea1 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:17.116496 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423bd33-5688-402c-9808-d77c242c2ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:17.125075 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423bd33-5688-402c-9808-d77c242c2ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:17.167016 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-9423bd33-5688-402c-9808-d77c242c2ea1 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:17.169659 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9423bd33-5688-402c-9808-d77c242c2ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:17.288947 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1221/2430] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:37:17.305319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b296f8-1bf0-4915-8b51-ffd0d855790f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:17.305319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-48b296f8-1bf0-4915-8b51-ffd0d855790f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:17.438582 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b296f8-1bf0-4915-8b51-ffd0d855790f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:17.443842 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35c126-82a3-44d5-84c5-73d9139380fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:17.444797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35c126-82a3-44d5-84c5-73d9139380fa service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:17.445339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35c126-82a3-44d5-84c5-73d9139380fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:17.445847 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35c126-82a3-44d5-84c5-73d9139380fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:17.458921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35c126-82a3-44d5-84c5-73d9139380fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:17.461904 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35c126-82a3-44d5-84c5-73d9139380fa service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:17.481613 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1210/2431] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:37:17.508603 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:18.197643 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:18.433266 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423bd33-5688-402c-9808-d77c242c2ea1 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:18.435648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9423bd33-5688-402c-9808-d77c242c2ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:18.457631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423bd33-5688-402c-9808-d77c242c2ea1 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:18.494646 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f297bd5-4ddf-4f63-9416-130223c63f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:18.500251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f297bd5-4ddf-4f63-9416-130223c63f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:18.500251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f297bd5-4ddf-4f63-9416-130223c63f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:18.500251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f297bd5-4ddf-4f63-9416-130223c63f1c admin admin] PATH_INFO: `/v3/projects/36cc228cab0d463ba713ef3af1be99de` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:18.500251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f297bd5-4ddf-4f63-9416-130223c63f1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=36cc228cab0d463ba713ef3af1be99de)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:18.501622 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f297bd5-4ddf-4f63-9416-130223c63f1c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:18.705823 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6f297bd5-4ddf-4f63-9416-130223c63f1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36cc228cab0d463ba713ef3af1be99de', 'request_id': 'req-6f297bd5-4ddf-4f63-9416-130223c63f1c'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:18.719165 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6f297bd5-4ddf-4f63-9416-130223c63f1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36cc228cab0d463ba713ef3af1be99de', 'request_id': 'req-6f297bd5-4ddf-4f63-9416-130223c63f1c'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:18.831571 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6f297bd5-4ddf-4f63-9416-130223c63f1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36cc228cab0d463ba713ef3af1be99de', 'request_id': 'req-6f297bd5-4ddf-4f63-9416-130223c63f1c'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:18.865716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6f297bd5-4ddf-4f63-9416-130223c63f1c admin admin] The token cache is being invalidate because project 36cc228cab0d463ba713ef3af1be99de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:37:18.866017 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6f297bd5-4ddf-4f63-9416-130223c63f1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:18.866828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6f297bd5-4ddf-4f63-9416-130223c63f1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:18.868732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1222/2432] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:37:18 2022] DELETE /identity/v3/projects/36cc228cab0d463ba713ef3af1be99de => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:37:18.873879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111effac-f2c8-4907-873f-fed217cccc50 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:18.874713 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111effac-f2c8-4907-873f-fed217cccc50 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:18.875010 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111effac-f2c8-4907-873f-fed217cccc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:18.918312 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-111effac-f2c8-4907-873f-fed217cccc50 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:18.922406 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-111effac-f2c8-4907-873f-fed217cccc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:19.082946 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1211/2433] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:37:19.090053 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a889b-c0a5-460b-8ac9-2e169b0d0401 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:19.090778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a889b-c0a5-460b-8ac9-2e169b0d0401 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:19.091276 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a889b-c0a5-460b-8ac9-2e169b0d0401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:19.136159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-526a889b-c0a5-460b-8ac9-2e169b0d0401 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:19.137439 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-526a889b-c0a5-460b-8ac9-2e169b0d0401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:19.159472 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1223/2434] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:37:19.165185 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111effac-f2c8-4907-873f-fed217cccc50 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:19.178972 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111effac-f2c8-4907-873f-fed217cccc50 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:19.190654 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20eb16-5fc0-4654-b122-dc61562fbf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:19.191335 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20eb16-5fc0-4654-b122-dc61562fbf2e admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:19.191639 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20eb16-5fc0-4654-b122-dc61562fbf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:19.191936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20eb16-5fc0-4654-b122-dc61562fbf2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:19.198038 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20eb16-5fc0-4654-b122-dc61562fbf2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:37:19.198722 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20eb16-5fc0-4654-b122-dc61562fbf2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:19.200341 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20eb16-5fc0-4654-b122-dc61562fbf2e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:19.218761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1212/2435] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:37:19.223036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a889b-c0a5-460b-8ac9-2e169b0d0401 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:19.241856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a889b-c0a5-460b-8ac9-2e169b0d0401 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:19.257912 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee6e2a-39b7-4070-a2c4-52b2caad9d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:19.258555 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee6e2a-39b7-4070-a2c4-52b2caad9d55 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:19.258836 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee6e2a-39b7-4070-a2c4-52b2caad9d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:19.259108 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee6e2a-39b7-4070-a2c4-52b2caad9d55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:19.259766 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee6e2a-39b7-4070-a2c4-52b2caad9d55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:19.262270 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee6e2a-39b7-4070-a2c4-52b2caad9d55 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:19.306774 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:19.444982 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1224/2436] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:37:19 2022] POST /identity/v3/projects => generated 375 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:37:19.447994 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20eb16-5fc0-4654-b122-dc61562fbf2e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:19.462074 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20eb16-5fc0-4654-b122-dc61562fbf2e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:19.619743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab373a-1c8b-4069-b145-3e166ae3240a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:19.619743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab373a-1c8b-4069-b145-3e166ae3240a admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:19.619743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab373a-1c8b-4069-b145-3e166ae3240a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:19.619743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab373a-1c8b-4069-b145-3e166ae3240a admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:19.620393 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab373a-1c8b-4069-b145-3e166ae3240a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:19.622193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab373a-1c8b-4069-b145-3e166ae3240a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:20.201843 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1213/2437] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:37:19 2022] POST /identity/v3/users => generated 288 bytes in 754 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:37:20.206238 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee6e2a-39b7-4070-a2c4-52b2caad9d55 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:20.220861 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee6e2a-39b7-4070-a2c4-52b2caad9d55 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:20.234192 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db791aae-ac4c-4a87-8919-0f428c70ee39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:20.235479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db791aae-ac4c-4a87-8919-0f428c70ee39 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:20.236217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db791aae-ac4c-4a87-8919-0f428c70ee39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:20.236613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db791aae-ac4c-4a87-8919-0f428c70ee39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:20.237573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db791aae-ac4c-4a87-8919-0f428c70ee39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:20.240240 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db791aae-ac4c-4a87-8919-0f428c70ee39 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:20.266673 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1225/2438] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:37:20.269467 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab373a-1c8b-4069-b145-3e166ae3240a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:20.282003 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab373a-1c8b-4069-b145-3e166ae3240a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:20.290690 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb894526-c26f-4d06-b11c-4a62d6aaa3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:20.292058 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb894526-c26f-4d06-b11c-4a62d6aaa3bb admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:20.293436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb894526-c26f-4d06-b11c-4a62d6aaa3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:20.294553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb894526-c26f-4d06-b11c-4a62d6aaa3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:20.297457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb894526-c26f-4d06-b11c-4a62d6aaa3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:20.302792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb894526-c26f-4d06-b11c-4a62d6aaa3bb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:20.325788 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1214/2439] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:37:20.331314 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db791aae-ac4c-4a87-8919-0f428c70ee39 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:20.372011 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db791aae-ac4c-4a87-8919-0f428c70ee39 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:20.386211 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc0b5e-733e-4a3f-adb3-1f3ae638db58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:20.387226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc0b5e-733e-4a3f-adb3-1f3ae638db58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:20.387614 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc0b5e-733e-4a3f-adb3-1f3ae638db58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:20.388003 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc0b5e-733e-4a3f-adb3-1f3ae638db58 admin admin] PATH_INFO: `/v3/projects/16efae04b8cf407f8e35012d5299fcf7/users/820b70110a4a46fc9adcabb169c76b33/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:20.423332 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc0b5e-733e-4a3f-adb3-1f3ae638db58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16efae04b8cf407f8e35012d5299fcf7, user_id=820b70110a4a46fc9adcabb169c76b33, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:20.428151 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc0b5e-733e-4a3f-adb3-1f3ae638db58 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:20.541998 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1226/2440] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:37:20 2022] PUT /identity/v3/projects/16efae04b8cf407f8e35012d5299fcf7/users/820b70110a4a46fc9adcabb169c76b33/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:37:20.552666 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be15ca4-048e-4735-b4a5-8f20a8556ac2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:20.553513 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be15ca4-048e-4735-b4a5-8f20a8556ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:20.554013 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be15ca4-048e-4735-b4a5-8f20a8556ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:20.627311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6be15ca4-048e-4735-b4a5-8f20a8556ac2 None None] MFA Rules not processed for user `820b70110a4a46fc9adcabb169c76b33`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:20.628707 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6be15ca4-048e-4735-b4a5-8f20a8556ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:20.638809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:20.813945 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1215/2441] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:37:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:37:20.824339 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc0b5e-733e-4a3f-adb3-1f3ae638db58 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:20.829768 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9ecc0b5e-733e-4a3f-adb3-1f3ae638db58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:20.987557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc0b5e-733e-4a3f-adb3-1f3ae638db58 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:20.995102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db44d5-5be1-40e0-8fde-dbde4b8e31b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:20.995736 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db44d5-5be1-40e0-8fde-dbde4b8e31b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:20.996017 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db44d5-5be1-40e0-8fde-dbde4b8e31b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:20.996361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db44d5-5be1-40e0-8fde-dbde4b8e31b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:21.018022 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db44d5-5be1-40e0-8fde-dbde4b8e31b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:21.019498 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db44d5-5be1-40e0-8fde-dbde4b8e31b7 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:21.059417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1227/2442] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:37:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:37:21.166129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:22.123642 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:23.109090 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:23.529184 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:24.744116 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:26.654842 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:26.800089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:27.090563 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be15ca4-048e-4735-b4a5-8f20a8556ac2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:27.092676 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6be15ca4-048e-4735-b4a5-8f20a8556ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:27.127391 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db44d5-5be1-40e0-8fde-dbde4b8e31b7 service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:27.186379 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be15ca4-048e-4735-b4a5-8f20a8556ac2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:27.191578 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e9220-9419-4abb-87b1-a970c5d4c7f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a7e9f0daa1c48eca87d92ced265afdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:27.192283 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e9220-9419-4abb-87b1-a970c5d4c7f4 service glance] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:27.192745 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e9220-9419-4abb-87b1-a970c5d4c7f4 service glance] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:27.193145 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e9220-9419-4abb-87b1-a970c5d4c7f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:27.195132 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f75e9220-9419-4abb-87b1-a970c5d4c7f4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:27.201900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db44d5-5be1-40e0-8fde-dbde4b8e31b7 service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:27.208070 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b84801-a945-4551-a724-5982f872d693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:27.209013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b84801-a945-4551-a724-5982f872d693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:27.209550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b84801-a945-4551-a724-5982f872d693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:27.210049 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b84801-a945-4551-a724-5982f872d693 admin admin] PATH_INFO: `/v3/users/820b70110a4a46fc9adcabb169c76b33` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:27.211625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b84801-a945-4551-a724-5982f872d693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=820b70110a4a46fc9adcabb169c76b33)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:27.214447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b84801-a945-4551-a724-5982f872d693 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:27.327295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e9220-9419-4abb-87b1-a970c5d4c7f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:27.329361 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e9220-9419-4abb-87b1-a970c5d4c7f4 service glance] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:27.348411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1216/2443] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:37:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:37:27.350200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a3089-d1e9-436e-9167-bf91c1af519f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:27.350489 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a3089-d1e9-436e-9167-bf91c1af519f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:27.350751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a3089-d1e9-436e-9167-bf91c1af519f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:27.371807 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-817a3089-d1e9-436e-9167-bf91c1af519f None None] MFA Rules not processed for user `45383671ca37408a9be6f17571025bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:27.374973 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-817a3089-d1e9-436e-9167-bf91c1af519f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:27.459585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1217/2444] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:37:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:37:27.539390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-98b84801-a945-4551-a724-5982f872d693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '820b70110a4a46fc9adcabb169c76b33'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:27.654386 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-98b84801-a945-4551-a724-5982f872d693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '820b70110a4a46fc9adcabb169c76b33'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:27.686044 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-98b84801-a945-4551-a724-5982f872d693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '820b70110a4a46fc9adcabb169c76b33'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:27.687670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-98b84801-a945-4551-a724-5982f872d693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '820b70110a4a46fc9adcabb169c76b33'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:27.701823 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-98b84801-a945-4551-a724-5982f872d693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '820b70110a4a46fc9adcabb169c76b33'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:27.713388 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1228/2445] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:37:27 2022] DELETE /identity/v3/users/820b70110a4a46fc9adcabb169c76b33 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:37:27.716392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b21ab2-cbbc-455c-9340-c0274a1052b8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:27.716804 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b21ab2-cbbc-455c-9340-c0274a1052b8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:27.717540 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b21ab2-cbbc-455c-9340-c0274a1052b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:27.743307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-24b21ab2-cbbc-455c-9340-c0274a1052b8 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:27.745317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-24b21ab2-cbbc-455c-9340-c0274a1052b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:27.842851 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1218/2446] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:37:27.853692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b84801-a945-4551-a724-5982f872d693 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:27.855224 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-98b84801-a945-4551-a724-5982f872d693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:27.924951 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b84801-a945-4551-a724-5982f872d693 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:27.928755 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396f8db-5e2a-4258-a782-26afeeba1e2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:27.929475 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396f8db-5e2a-4258-a782-26afeeba1e2c service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:27.929831 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396f8db-5e2a-4258-a782-26afeeba1e2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:27.930181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396f8db-5e2a-4258-a782-26afeeba1e2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:27.940359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396f8db-5e2a-4258-a782-26afeeba1e2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:27.942761 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396f8db-5e2a-4258-a782-26afeeba1e2c service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:27.952512 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1229/2447] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:37:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:37:28.423847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:28.524784 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b21ab2-cbbc-455c-9340-c0274a1052b8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:28.534369 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-24b21ab2-cbbc-455c-9340-c0274a1052b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:28.559079 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b21ab2-cbbc-455c-9340-c0274a1052b8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:28.565821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61aa04-3ff6-4d59-b9f9-e080328e611e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:28.566725 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61aa04-3ff6-4d59-b9f9-e080328e611e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:28.567246 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61aa04-3ff6-4d59-b9f9-e080328e611e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:28.567521 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61aa04-3ff6-4d59-b9f9-e080328e611e admin admin] PATH_INFO: `/v3/projects/16efae04b8cf407f8e35012d5299fcf7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:28.568664 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61aa04-3ff6-4d59-b9f9-e080328e611e admin admin] RBAC: Authorizing `identity:delete_project(project_id=16efae04b8cf407f8e35012d5299fcf7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:28.570775 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61aa04-3ff6-4d59-b9f9-e080328e611e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:28.741426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cb61aa04-3ff6-4d59-b9f9-e080328e611e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16efae04b8cf407f8e35012d5299fcf7', 'request_id': 'req-cb61aa04-3ff6-4d59-b9f9-e080328e611e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:28.746864 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cb61aa04-3ff6-4d59-b9f9-e080328e611e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16efae04b8cf407f8e35012d5299fcf7', 'request_id': 'req-cb61aa04-3ff6-4d59-b9f9-e080328e611e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:28.877521 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cb61aa04-3ff6-4d59-b9f9-e080328e611e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16efae04b8cf407f8e35012d5299fcf7', 'request_id': 'req-cb61aa04-3ff6-4d59-b9f9-e080328e611e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:28.891981 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cb61aa04-3ff6-4d59-b9f9-e080328e611e admin admin] The token cache is being invalidate because project 16efae04b8cf407f8e35012d5299fcf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:37:28.892907 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cb61aa04-3ff6-4d59-b9f9-e080328e611e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:28.893634 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cb61aa04-3ff6-4d59-b9f9-e080328e611e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:28.895765 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1219/2448] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:37:28 2022] DELETE /identity/v3/projects/16efae04b8cf407f8e35012d5299fcf7 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:37:28.901261 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0b4dd-210b-4b6a-9486-2e8ec01880af None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:28.902113 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0b4dd-210b-4b6a-9486-2e8ec01880af None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:28.902384 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0b4dd-210b-4b6a-9486-2e8ec01880af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:28.925875 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-21e0b4dd-210b-4b6a-9486-2e8ec01880af None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:28.927085 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-21e0b4dd-210b-4b6a-9486-2e8ec01880af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:28.987838 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1230/2449] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:37:28.995696 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945d8ef-0fbd-4c07-b892-4e75266dab6a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:28.995988 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945d8ef-0fbd-4c07-b892-4e75266dab6a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:28.996269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945d8ef-0fbd-4c07-b892-4e75266dab6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:29.024873 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b945d8ef-0fbd-4c07-b892-4e75266dab6a None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:29.026136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b945d8ef-0fbd-4c07-b892-4e75266dab6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:29.036915 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1220/2450] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:37:29.048928 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0b4dd-210b-4b6a-9486-2e8ec01880af None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:29.059374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0b4dd-210b-4b6a-9486-2e8ec01880af None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:29.064391 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428e662-b6bf-4c6b-b6c6-a86411f01e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:29.065081 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428e662-b6bf-4c6b-b6c6-a86411f01e9c admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:29.065373 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428e662-b6bf-4c6b-b6c6-a86411f01e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:29.065641 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428e662-b6bf-4c6b-b6c6-a86411f01e9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:29.066283 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428e662-b6bf-4c6b-b6c6-a86411f01e9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:37:29.066583 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428e662-b6bf-4c6b-b6c6-a86411f01e9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:29.068276 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428e662-b6bf-4c6b-b6c6-a86411f01e9c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:29.082382 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1231/2451] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:37:29.086881 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945d8ef-0fbd-4c07-b892-4e75266dab6a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:29.097164 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945d8ef-0fbd-4c07-b892-4e75266dab6a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:29.101898 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccadaf5-a165-4fa6-9013-982838747975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:29.102492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccadaf5-a165-4fa6-9013-982838747975 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:29.102772 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccadaf5-a165-4fa6-9013-982838747975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:29.103046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccadaf5-a165-4fa6-9013-982838747975 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:29.103690 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccadaf5-a165-4fa6-9013-982838747975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:29.105663 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccadaf5-a165-4fa6-9013-982838747975 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:29.123078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:29.258245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1221/2452] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:37:29 2022] POST /identity/v3/projects => generated 369 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:37:29.260950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428e662-b6bf-4c6b-b6c6-a86411f01e9c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:29.272365 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428e662-b6bf-4c6b-b6c6-a86411f01e9c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:29.341937 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405c9cd-1151-4dd1-bc57-b82d4192c721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:29.342544 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405c9cd-1151-4dd1-bc57-b82d4192c721 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:29.342824 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405c9cd-1151-4dd1-bc57-b82d4192c721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:29.343131 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405c9cd-1151-4dd1-bc57-b82d4192c721 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:29.344124 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405c9cd-1151-4dd1-bc57-b82d4192c721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:29.346099 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405c9cd-1151-4dd1-bc57-b82d4192c721 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:29.412010 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e20a5c-e40e-452a-8346-3e6f3c4aedcd None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:29.412445 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e20a5c-e40e-452a-8346-3e6f3c4aedcd None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:29.418766 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e20a5c-e40e-452a-8346-3e6f3c4aedcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:29.434645 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c8e20a5c-e40e-452a-8346-3e6f3c4aedcd None None] MFA Rules not processed for user `635e47d0a5a34fdfb5c8967a96a87828`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:29.436133 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c8e20a5c-e40e-452a-8346-3e6f3c4aedcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:29.450336 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1232/2453] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:37:29 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:37:29.462288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405c9cd-1151-4dd1-bc57-b82d4192c721 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:29.476845 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405c9cd-1151-4dd1-bc57-b82d4192c721 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:29.482171 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c1ec1-f549-4ad5-80c3-f8fde8cc3a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:29.482783 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c1ec1-f549-4ad5-80c3-f8fde8cc3a65 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:29.483070 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c1ec1-f549-4ad5-80c3-f8fde8cc3a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:29.483346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c1ec1-f549-4ad5-80c3-f8fde8cc3a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:29.484699 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c1ec1-f549-4ad5-80c3-f8fde8cc3a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:29.486432 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c1ec1-f549-4ad5-80c3-f8fde8cc3a65 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:29.502921 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1233/2454] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:37:29.508293 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c1ec1-f549-4ad5-80c3-f8fde8cc3a65 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:29.519963 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c1ec1-f549-4ad5-80c3-f8fde8cc3a65 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:29.525014 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc13f34-47c8-48ee-b0cf-a59fedd02b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:29.525934 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc13f34-47c8-48ee-b0cf-a59fedd02b90 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:29.526273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc13f34-47c8-48ee-b0cf-a59fedd02b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:29.526738 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc13f34-47c8-48ee-b0cf-a59fedd02b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:29.527401 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc13f34-47c8-48ee-b0cf-a59fedd02b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:29.528990 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc13f34-47c8-48ee-b0cf-a59fedd02b90 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:29.530885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1222/2455] 10.222.0.23 () {58 vars in 967 bytes} [Mon Sep 5 14:37:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:37:29.547929 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1234/2456] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:37:29.554146 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc13f34-47c8-48ee-b0cf-a59fedd02b90 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:29.554816 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e20a5c-e40e-452a-8346-3e6f3c4aedcd None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:29.558220 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1bc13f34-47c8-48ee-b0cf-a59fedd02b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:29.569660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e20a5c-e40e-452a-8346-3e6f3c4aedcd None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:29.575909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52079a-1fc0-4f2f-9418-17f4b9b00f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:29.576703 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52079a-1fc0-4f2f-9418-17f4b9b00f23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:29.577013 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52079a-1fc0-4f2f-9418-17f4b9b00f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:29.577380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52079a-1fc0-4f2f-9418-17f4b9b00f23 admin admin] PATH_INFO: `/v3/projects/11483b7a3d574e64acbd283f349dd369/users/34f4120200ac41d5b9d90855996145a2/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:29.600780 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52079a-1fc0-4f2f-9418-17f4b9b00f23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11483b7a3d574e64acbd283f349dd369, user_id=34f4120200ac41d5b9d90855996145a2, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:29.605282 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52079a-1fc0-4f2f-9418-17f4b9b00f23 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:29.652195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc13f34-47c8-48ee-b0cf-a59fedd02b90 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:29.659308 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1cfa5-165e-4d31-b862-3761d422b3c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed60e9eecb94ef39c2f4a5e5f50d670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:29.662685 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1cfa5-165e-4d31-b862-3761d422b3c1 service swift] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:29.662685 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1cfa5-165e-4d31-b862-3761d422b3c1 service swift] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:29.662685 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1cfa5-165e-4d31-b862-3761d422b3c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:29.669660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1cfa5-165e-4d31-b862-3761d422b3c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:29.671731 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1cfa5-165e-4d31-b862-3761d422b3c1 service swift] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:29.681428 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1235/2457] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 5 14:37:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 14:37:29.707041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:29.714055 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1223/2458] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:37:29 2022] PUT /identity/v3/projects/11483b7a3d574e64acbd283f349dd369/users/34f4120200ac41d5b9d90855996145a2/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:37:29.725550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d3769-089d-4dc1-9f87-01cf70146ea7 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:29.725863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d3769-089d-4dc1-9f87-01cf70146ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:29.726143 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d3769-089d-4dc1-9f87-01cf70146ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:29.756993 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-f41d3769-089d-4dc1-9f87-01cf70146ea7 None None] MFA Rules not processed for user `34f4120200ac41d5b9d90855996145a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:29.758247 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f41d3769-089d-4dc1-9f87-01cf70146ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:29.847885 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1236/2459] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:37:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:37:30.333946 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:30.940841 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:30.992176 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:31.026339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a691fb5-c892-4bf7-a057-3766419b9633 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:31.026635 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a691fb5-c892-4bf7-a057-3766419b9633 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:31.026916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a691fb5-c892-4bf7-a057-3766419b9633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:31.055659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4a691fb5-c892-4bf7-a057-3766419b9633 None None] MFA Rules not processed for user `283b6df7aaf741b284d97004c9026cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:31.055659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4a691fb5-c892-4bf7-a057-3766419b9633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:31.102891 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d3769-089d-4dc1-9f87-01cf70146ea7 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:31.113355 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f41d3769-089d-4dc1-9f87-01cf70146ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:31.116454 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1224/2460] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:37:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:37:31.182333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d3769-089d-4dc1-9f87-01cf70146ea7 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:31.186294 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90779922-1d3b-484d-8ffd-25dbcebc7a1d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a7e9f0daa1c48eca87d92ced265afdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:31.187833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90779922-1d3b-484d-8ffd-25dbcebc7a1d service glance] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:31.187959 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90779922-1d3b-484d-8ffd-25dbcebc7a1d service glance] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:31.188179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90779922-1d3b-484d-8ffd-25dbcebc7a1d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:31.197246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90779922-1d3b-484d-8ffd-25dbcebc7a1d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:31.198689 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90779922-1d3b-484d-8ffd-25dbcebc7a1d service glance] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:31.218789 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1237/2461] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:37:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:37:32.358036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:32.493663 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f73013-5560-4199-8cb5-c8616268055f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:32.494756 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f73013-5560-4199-8cb5-c8616268055f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:32.495152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f73013-5560-4199-8cb5-c8616268055f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:32.524752 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-24f73013-5560-4199-8cb5-c8616268055f None None] MFA Rules not processed for user `635e47d0a5a34fdfb5c8967a96a87828`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:32.526193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-24f73013-5560-4199-8cb5-c8616268055f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:32.601897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1225/2462] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 5 14:37:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:37:32.616191 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90779922-1d3b-484d-8ffd-25dbcebc7a1d service glance] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:32.705902 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90779922-1d3b-484d-8ffd-25dbcebc7a1d service glance] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:32.712044 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f20308-2f38-44f1-8c94-174ab29e37f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed60e9eecb94ef39c2f4a5e5f50d670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:32.712747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f20308-2f38-44f1-8c94-174ab29e37f0 service swift] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:32.713127 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f20308-2f38-44f1-8c94-174ab29e37f0 service swift] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:32.713474 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f20308-2f38-44f1-8c94-174ab29e37f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:32.725844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f20308-2f38-44f1-8c94-174ab29e37f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:32.728049 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f20308-2f38-44f1-8c94-174ab29e37f0 service swift] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:32.737845 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1238/2463] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 5 14:37:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 14:37:33.078219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:33.814652 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:33.859801 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f73013-5560-4199-8cb5-c8616268055f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:33.862409 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-24f73013-5560-4199-8cb5-c8616268055f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:34.040475 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f73013-5560-4199-8cb5-c8616268055f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:34.047320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219d75c-2e5b-48b8-9e1e-46030f8a5fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:34.048307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219d75c-2e5b-48b8-9e1e-46030f8a5fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:34.048746 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219d75c-2e5b-48b8-9e1e-46030f8a5fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:34.049269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219d75c-2e5b-48b8-9e1e-46030f8a5fc6 admin admin] PATH_INFO: `/v3/users/38c0666fea2948c29d94e297222e2df1` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:34.050830 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219d75c-2e5b-48b8-9e1e-46030f8a5fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38c0666fea2948c29d94e297222e2df1)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:34.055162 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219d75c-2e5b-48b8-9e1e-46030f8a5fc6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:34.335817 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7219d75c-2e5b-48b8-9e1e-46030f8a5fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38c0666fea2948c29d94e297222e2df1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:34.337485 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7219d75c-2e5b-48b8-9e1e-46030f8a5fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38c0666fea2948c29d94e297222e2df1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:34.436828 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7219d75c-2e5b-48b8-9e1e-46030f8a5fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38c0666fea2948c29d94e297222e2df1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:34.466851 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7219d75c-2e5b-48b8-9e1e-46030f8a5fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38c0666fea2948c29d94e297222e2df1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:34.473113 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7219d75c-2e5b-48b8-9e1e-46030f8a5fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38c0666fea2948c29d94e297222e2df1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:34.511884 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1226/2464] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:37:33 2022] DELETE /identity/v3/users/38c0666fea2948c29d94e297222e2df1 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:37:34.523509 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:34.553168 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:34.718586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:35.473078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f20308-2f38-44f1-8c94-174ab29e37f0 service swift] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:35.490385 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f20308-2f38-44f1-8c94-174ab29e37f0 service swift] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:35.661459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fdcba-d911-48be-918e-f0bed29e94cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:35.661459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fdcba-d911-48be-918e-f0bed29e94cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:35.661666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fdcba-d911-48be-918e-f0bed29e94cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:35.661793 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fdcba-d911-48be-918e-f0bed29e94cc admin admin] PATH_INFO: `/v3/projects/e6bfd9cec0f6412fb2972968c349c463` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:35.666642 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fdcba-d911-48be-918e-f0bed29e94cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6bfd9cec0f6412fb2972968c349c463)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:35.670846 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fdcba-d911-48be-918e-f0bed29e94cc admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:35.780151 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:35.865581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-354fdcba-d911-48be-918e-f0bed29e94cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6bfd9cec0f6412fb2972968c349c463', 'request_id': 'req-354fdcba-d911-48be-918e-f0bed29e94cc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:35.871310 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-354fdcba-d911-48be-918e-f0bed29e94cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6bfd9cec0f6412fb2972968c349c463', 'request_id': 'req-354fdcba-d911-48be-918e-f0bed29e94cc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:35.997524 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-354fdcba-d911-48be-918e-f0bed29e94cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6bfd9cec0f6412fb2972968c349c463', 'request_id': 'req-354fdcba-d911-48be-918e-f0bed29e94cc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:36.020503 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-354fdcba-d911-48be-918e-f0bed29e94cc admin admin] The token cache is being invalidate because project e6bfd9cec0f6412fb2972968c349c463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:37:36.021175 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-354fdcba-d911-48be-918e-f0bed29e94cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:36.022049 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-354fdcba-d911-48be-918e-f0bed29e94cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:37:36.023599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1239/2465] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:37:35 2022] DELETE /identity/v3/projects/e6bfd9cec0f6412fb2972968c349c463 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:37:36.028598 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714daf96-49d5-448a-8059-ede683741cd9 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:36.029564 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714daf96-49d5-448a-8059-ede683741cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:36.030003 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714daf96-49d5-448a-8059-ede683741cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:36.063631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-714daf96-49d5-448a-8059-ede683741cd9 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:36.065326 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-714daf96-49d5-448a-8059-ede683741cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:36.178497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1227/2466] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:37:36.186849 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bba67b-3831-4f8d-8db6-7b3d4146f2fe None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:36.187763 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bba67b-3831-4f8d-8db6-7b3d4146f2fe None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:36.188265 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bba67b-3831-4f8d-8db6-7b3d4146f2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:36.220152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c5bba67b-3831-4f8d-8db6-7b3d4146f2fe None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:36.222872 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c5bba67b-3831-4f8d-8db6-7b3d4146f2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:36.240806 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1240/2467] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:37:36.244684 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714daf96-49d5-448a-8059-ede683741cd9 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:36.261266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714daf96-49d5-448a-8059-ede683741cd9 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:36.266859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc823263-be48-49fe-86bf-3b2e1c2e6188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:36.267622 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc823263-be48-49fe-86bf-3b2e1c2e6188 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:36.268006 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc823263-be48-49fe-86bf-3b2e1c2e6188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:36.268379 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc823263-be48-49fe-86bf-3b2e1c2e6188 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:36.269189 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc823263-be48-49fe-86bf-3b2e1c2e6188 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:37:36.269602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc823263-be48-49fe-86bf-3b2e1c2e6188 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:36.271388 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc823263-be48-49fe-86bf-3b2e1c2e6188 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:36.290837 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1228/2468] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:37:36.295705 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bba67b-3831-4f8d-8db6-7b3d4146f2fe None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:36.318059 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bba67b-3831-4f8d-8db6-7b3d4146f2fe None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:36.324000 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd3d2d-3a42-44c3-911c-0f7879f69dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:36.324632 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd3d2d-3a42-44c3-911c-0f7879f69dbc admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:36.324911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd3d2d-3a42-44c3-911c-0f7879f69dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:36.325219 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd3d2d-3a42-44c3-911c-0f7879f69dbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:36.325860 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd3d2d-3a42-44c3-911c-0f7879f69dbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:36.328492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd3d2d-3a42-44c3-911c-0f7879f69dbc admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:36.340937 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:36.444976 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1241/2469] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:37:36 2022] POST /identity/v3/projects => generated 363 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:37:36.445996 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc823263-be48-49fe-86bf-3b2e1c2e6188 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:36.457016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc823263-be48-49fe-86bf-3b2e1c2e6188 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:36.543629 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00591e-921b-434f-b38e-ba84cca17e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:36.546046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00591e-921b-434f-b38e-ba84cca17e20 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:36.546529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00591e-921b-434f-b38e-ba84cca17e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:36.547063 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00591e-921b-434f-b38e-ba84cca17e20 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:36.547904 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00591e-921b-434f-b38e-ba84cca17e20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:36.550432 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00591e-921b-434f-b38e-ba84cca17e20 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:36.641689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1229/2470] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:37:36 2022] POST /identity/v3/users => generated 282 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:37:36.649584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd3d2d-3a42-44c3-911c-0f7879f69dbc admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:36.660263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd3d2d-3a42-44c3-911c-0f7879f69dbc admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:36.679200 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454f363-0e27-434c-90f4-558bdc1c530e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:36.680118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454f363-0e27-434c-90f4-558bdc1c530e admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:36.685668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454f363-0e27-434c-90f4-558bdc1c530e admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:36.685668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454f363-0e27-434c-90f4-558bdc1c530e admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:36.686068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454f363-0e27-434c-90f4-558bdc1c530e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:36.690324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454f363-0e27-434c-90f4-558bdc1c530e admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:36.727931 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1242/2471] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:37:36.729394 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00591e-921b-434f-b38e-ba84cca17e20 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:36.741136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:36.747370 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00591e-921b-434f-b38e-ba84cca17e20 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:36.754063 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f258868-af01-4e83-b75d-156d72bf83dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:36.757302 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f258868-af01-4e83-b75d-156d72bf83dc admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:36.757791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f258868-af01-4e83-b75d-156d72bf83dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:36.758294 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f258868-af01-4e83-b75d-156d72bf83dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:36.759390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f258868-af01-4e83-b75d-156d72bf83dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:36.774136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f258868-af01-4e83-b75d-156d72bf83dc admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:36.800299 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1230/2472] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:37:36.802194 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454f363-0e27-434c-90f4-558bdc1c530e admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:36.813332 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454f363-0e27-434c-90f4-558bdc1c530e admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:36.817425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47098746-8aa1-4d74-9107-e5999752214d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:36.818176 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47098746-8aa1-4d74-9107-e5999752214d admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:36.818519 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47098746-8aa1-4d74-9107-e5999752214d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:36.818857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47098746-8aa1-4d74-9107-e5999752214d admin admin] PATH_INFO: `/v3/projects/ccbbcce7974c445290fe5216547758a0/users/b733287bd36d46d88ffce476c24d4aee/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:36.856229 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47098746-8aa1-4d74-9107-e5999752214d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccbbcce7974c445290fe5216547758a0, user_id=b733287bd36d46d88ffce476c24d4aee, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:36.860172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47098746-8aa1-4d74-9107-e5999752214d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:36.951889 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1243/2473] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:37:36 2022] PUT /identity/v3/projects/ccbbcce7974c445290fe5216547758a0/users/b733287bd36d46d88ffce476c24d4aee/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:37:36.962439 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ce6e9-a092-4cab-b4fc-f79f7df4880d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:36.962732 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ce6e9-a092-4cab-b4fc-f79f7df4880d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:36.963036 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ce6e9-a092-4cab-b4fc-f79f7df4880d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:37.010279 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ca5ce6e9-a092-4cab-b4fc-f79f7df4880d None None] MFA Rules not processed for user `b733287bd36d46d88ffce476c24d4aee`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:37:37.010767 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ca5ce6e9-a092-4cab-b4fc-f79f7df4880d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:37.077977 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:37.095275 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:37.148927 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1231/2474] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:37:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:37:37.161581 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47098746-8aa1-4d74-9107-e5999752214d admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:37.172888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-47098746-8aa1-4d74-9107-e5999752214d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:37.296520 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47098746-8aa1-4d74-9107-e5999752214d admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:37.300519 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b71a7-90ab-42e3-b1df-e4e34a5dc1cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:37.301165 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b71a7-90ab-42e3-b1df-e4e34a5dc1cc service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:37.301447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b71a7-90ab-42e3-b1df-e4e34a5dc1cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:37.301718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b71a7-90ab-42e3-b1df-e4e34a5dc1cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:37.314527 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b71a7-90ab-42e3-b1df-e4e34a5dc1cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:37.317097 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b71a7-90ab-42e3-b1df-e4e34a5dc1cc service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:37.326890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1244/2475] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:37:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:37:37.456016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:37.507004 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:38.428354 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:38.563909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:38.934290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:39.071742 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:39.598054 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:39.860835 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:40.980314 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:41.111832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:41.757770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:42.071919 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:42.586451 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:42.840205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:43.610014 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:44.597845 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:44.799925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:45.733977 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:46.054518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:46.775053 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:47.529628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:48.883400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:48.940875 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:49.821985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:50.334866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:51.923020 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:52.318622 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:52.917451 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ce6e9-a092-4cab-b4fc-f79f7df4880d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:37:52.919050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ca5ce6e9-a092-4cab-b4fc-f79f7df4880d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:52.998153 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ce6e9-a092-4cab-b4fc-f79f7df4880d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:37:53.003547 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cc588-1ec7-4419-a844-38a46323a3db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1880dab32fa424a9356b3fe940d4856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:37:53.004191 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cc588-1ec7-4419-a844-38a46323a3db service placement] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:37:53.004471 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cc588-1ec7-4419-a844-38a46323a3db service placement] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:37:53.004740 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cc588-1ec7-4419-a844-38a46323a3db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:37:53.006566 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e09cc588-1ec7-4419-a844-38a46323a3db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:37:53.019216 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cc588-1ec7-4419-a844-38a46323a3db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:37:53.020897 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cc588-1ec7-4419-a844-38a46323a3db service placement] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:37:53.035741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1232/2476] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:37:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:37:53.163835 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:53.717810 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:54.238741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:54.963849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:55.432376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:55.557571 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:56.227070 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:56.535105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:57.089080 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:57.312085 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:57.622969 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:58.038635 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:58.318025 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:59.278981 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:59.354889 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:59.894812 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:59.970598 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:00.295167 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:00.487308 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2714b-14cd-431d-95d5-2de6dae69e97 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:00.487873 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2714b-14cd-431d-95d5-2de6dae69e97 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:00.489022 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2714b-14cd-431d-95d5-2de6dae69e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:00.513615 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-85c2714b-14cd-431d-95d5-2de6dae69e97 None None] MFA Rules not processed for user `635e47d0a5a34fdfb5c8967a96a87828`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:38:00.514965 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-85c2714b-14cd-431d-95d5-2de6dae69e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:00.552777 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:00.605967 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1245/2477] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 5 14:38:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:38:00.637714 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cc588-1ec7-4419-a844-38a46323a3db service placement] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:00.639380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e09cc588-1ec7-4419-a844-38a46323a3db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:00.728393 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cc588-1ec7-4419-a844-38a46323a3db service placement] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:00.734031 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eaf49c-dc84-4436-9ab7-275ea8ed38f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed60e9eecb94ef39c2f4a5e5f50d670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:00.734189 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eaf49c-dc84-4436-9ab7-275ea8ed38f9 service swift] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:00.734450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eaf49c-dc84-4436-9ab7-275ea8ed38f9 service swift] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:00.734800 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eaf49c-dc84-4436-9ab7-275ea8ed38f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:00.744264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eaf49c-dc84-4436-9ab7-275ea8ed38f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:00.746143 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eaf49c-dc84-4436-9ab7-275ea8ed38f9 service swift] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:00.757353 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1233/2478] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 5 14:38:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 14:38:00.868141 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:01.161719 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2714b-14cd-431d-95d5-2de6dae69e97 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:01.164221 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-85c2714b-14cd-431d-95d5-2de6dae69e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:01.194464 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:01.263444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2714b-14cd-431d-95d5-2de6dae69e97 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:01.268427 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462af128-59b9-4523-8d96-a50d9920e28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:01.269119 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462af128-59b9-4523-8d96-a50d9920e28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:01.269390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462af128-59b9-4523-8d96-a50d9920e28a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:01.269685 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462af128-59b9-4523-8d96-a50d9920e28a admin admin] PATH_INFO: `/v3/users/56a86d423a34413f8cc1edbc39382c88` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:01.270969 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462af128-59b9-4523-8d96-a50d9920e28a admin admin] RBAC: Authorizing `identity:delete_user(user_id=56a86d423a34413f8cc1edbc39382c88)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:01.273351 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462af128-59b9-4523-8d96-a50d9920e28a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:01.279201 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:01.510631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-462af128-59b9-4523-8d96-a50d9920e28a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56a86d423a34413f8cc1edbc39382c88'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:01.592330 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-462af128-59b9-4523-8d96-a50d9920e28a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56a86d423a34413f8cc1edbc39382c88'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:01.606701 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-462af128-59b9-4523-8d96-a50d9920e28a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56a86d423a34413f8cc1edbc39382c88'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:01.607423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-462af128-59b9-4523-8d96-a50d9920e28a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56a86d423a34413f8cc1edbc39382c88'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:01.615847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-462af128-59b9-4523-8d96-a50d9920e28a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56a86d423a34413f8cc1edbc39382c88'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:01.622231 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1246/2479] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:38:01 2022] DELETE /identity/v3/users/56a86d423a34413f8cc1edbc39382c88 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:38:01.627351 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436cfde-9eb6-4a5a-8a25-54e4c14cb2f5 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:01.628295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436cfde-9eb6-4a5a-8a25-54e4c14cb2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:01.628760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436cfde-9eb6-4a5a-8a25-54e4c14cb2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:01.650787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7436cfde-9eb6-4a5a-8a25-54e4c14cb2f5 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:38:01.652064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7436cfde-9eb6-4a5a-8a25-54e4c14cb2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:01.728879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1234/2480] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:38:01.743538 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462af128-59b9-4523-8d96-a50d9920e28a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:01.745178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-462af128-59b9-4523-8d96-a50d9920e28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:01.834111 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462af128-59b9-4523-8d96-a50d9920e28a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:01.836266 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad56c2e-9126-45f6-95cb-e87d47579436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:01.836881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad56c2e-9126-45f6-95cb-e87d47579436 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:01.837192 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad56c2e-9126-45f6-95cb-e87d47579436 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:01.837469 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad56c2e-9126-45f6-95cb-e87d47579436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:01.847544 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad56c2e-9126-45f6-95cb-e87d47579436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:01.849191 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad56c2e-9126-45f6-95cb-e87d47579436 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:01.859147 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1247/2481] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:38:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:38:01.919239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:01.943642 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b321daa-77f5-4101-abd9-e015c4dda540 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:01.944035 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b321daa-77f5-4101-abd9-e015c4dda540 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:01.944318 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b321daa-77f5-4101-abd9-e015c4dda540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:01.967695 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6b321daa-77f5-4101-abd9-e015c4dda540 None None] MFA Rules not processed for user `635e47d0a5a34fdfb5c8967a96a87828`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:38:01.969790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6b321daa-77f5-4101-abd9-e015c4dda540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:02.029394 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1235/2482] 10.222.0.23 () {58 vars in 967 bytes} [Mon Sep 5 14:38:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:38:02.044270 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad56c2e-9126-45f6-95cb-e87d47579436 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:02.046184 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0ad56c2e-9126-45f6-95cb-e87d47579436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:02.113553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:02.132418 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad56c2e-9126-45f6-95cb-e87d47579436 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:02.137685 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778ac09-41f1-45ce-ade1-0b4a18fc8400 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed60e9eecb94ef39c2f4a5e5f50d670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:02.138299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778ac09-41f1-45ce-ade1-0b4a18fc8400 service swift] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:02.141145 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778ac09-41f1-45ce-ade1-0b4a18fc8400 service swift] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:02.142986 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778ac09-41f1-45ce-ade1-0b4a18fc8400 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:02.157438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778ac09-41f1-45ce-ade1-0b4a18fc8400 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:02.160481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778ac09-41f1-45ce-ade1-0b4a18fc8400 service swift] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:02.183057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1248/2483] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 5 14:38:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 14:38:02.334076 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b321daa-77f5-4101-abd9-e015c4dda540 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:02.335762 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6b321daa-77f5-4101-abd9-e015c4dda540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:02.355319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b321daa-77f5-4101-abd9-e015c4dda540 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:02.362742 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0578c8-129d-49ab-89b5-af25172a0943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:02.363390 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0578c8-129d-49ab-89b5-af25172a0943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:02.363664 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0578c8-129d-49ab-89b5-af25172a0943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:02.363925 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0578c8-129d-49ab-89b5-af25172a0943 admin admin] PATH_INFO: `/v3/projects/f2a12e3a110a449491eeded5b62a10c5` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:02.365087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0578c8-129d-49ab-89b5-af25172a0943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2a12e3a110a449491eeded5b62a10c5)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:02.367124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0578c8-129d-49ab-89b5-af25172a0943 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:02.497605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cf0578c8-129d-49ab-89b5-af25172a0943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2a12e3a110a449491eeded5b62a10c5', 'request_id': 'req-cf0578c8-129d-49ab-89b5-af25172a0943'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:02.504979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cf0578c8-129d-49ab-89b5-af25172a0943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2a12e3a110a449491eeded5b62a10c5', 'request_id': 'req-cf0578c8-129d-49ab-89b5-af25172a0943'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:02.668578 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cf0578c8-129d-49ab-89b5-af25172a0943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2a12e3a110a449491eeded5b62a10c5', 'request_id': 'req-cf0578c8-129d-49ab-89b5-af25172a0943'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:02.686711 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cf0578c8-129d-49ab-89b5-af25172a0943 admin admin] The token cache is being invalidate because project f2a12e3a110a449491eeded5b62a10c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:38:02.687362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cf0578c8-129d-49ab-89b5-af25172a0943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:02.688432 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cf0578c8-129d-49ab-89b5-af25172a0943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:02.690162 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1236/2484] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:38:02 2022] DELETE /identity/v3/projects/f2a12e3a110a449491eeded5b62a10c5 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:38:02.695099 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77109d89-9580-4d1c-8831-83cf2dfcb33f None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:02.695414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77109d89-9580-4d1c-8831-83cf2dfcb33f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:02.695690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77109d89-9580-4d1c-8831-83cf2dfcb33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:02.725985 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-77109d89-9580-4d1c-8831-83cf2dfcb33f None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:38:02.725985 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-77109d89-9580-4d1c-8831-83cf2dfcb33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:02.816288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1249/2485] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:38:02.893953 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a06de7-141b-4e75-baf0-57cb836f606a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:02.894231 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a06de7-141b-4e75-baf0-57cb836f606a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:02.894503 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a06de7-141b-4e75-baf0-57cb836f606a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:02.915046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c4a06de7-141b-4e75-baf0-57cb836f606a None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:38:02.916357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c4a06de7-141b-4e75-baf0-57cb836f606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:02.933758 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1237/2486] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:38:02.938550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77109d89-9580-4d1c-8831-83cf2dfcb33f None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:02.955139 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77109d89-9580-4d1c-8831-83cf2dfcb33f None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:02.973446 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c726e0d-93e6-415c-a19e-c305adcedfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:02.973446 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c726e0d-93e6-415c-a19e-c305adcedfcc admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:02.973446 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c726e0d-93e6-415c-a19e-c305adcedfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:02.973446 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c726e0d-93e6-415c-a19e-c305adcedfcc admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:02.974007 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c726e0d-93e6-415c-a19e-c305adcedfcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:38:02.974007 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c726e0d-93e6-415c-a19e-c305adcedfcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:02.974007 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c726e0d-93e6-415c-a19e-c305adcedfcc admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:02.999140 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1250/2487] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:38:03.000193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a06de7-141b-4e75-baf0-57cb836f606a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:03.011276 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a06de7-141b-4e75-baf0-57cb836f606a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:03.016240 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7191dd-8c95-4f70-bdf2-9a60ba3609df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:03.016852 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7191dd-8c95-4f70-bdf2-9a60ba3609df admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:03.017168 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7191dd-8c95-4f70-bdf2-9a60ba3609df admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:03.025412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7191dd-8c95-4f70-bdf2-9a60ba3609df admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:03.025412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7191dd-8c95-4f70-bdf2-9a60ba3609df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:03.025412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7191dd-8c95-4f70-bdf2-9a60ba3609df admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:03.118406 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:03.163179 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1238/2488] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:38:02 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:38:03.164314 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c726e0d-93e6-415c-a19e-c305adcedfcc admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:03.175787 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c726e0d-93e6-415c-a19e-c305adcedfcc admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:03.177701 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db114181-b5b6-44b8-802f-dd93bb69e04c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:03.177987 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db114181-b5b6-44b8-802f-dd93bb69e04c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:03.178261 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db114181-b5b6-44b8-802f-dd93bb69e04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:03.204453 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-db114181-b5b6-44b8-802f-dd93bb69e04c None None] MFA Rules not processed for user `635e47d0a5a34fdfb5c8967a96a87828`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:38:03.205955 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-db114181-b5b6-44b8-802f-dd93bb69e04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:03.240797 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d315f71-9d2d-436e-bd2c-7894c3ae45b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:03.242085 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d315f71-9d2d-436e-bd2c-7894c3ae45b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:03.242622 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d315f71-9d2d-436e-bd2c-7894c3ae45b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:03.243234 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d315f71-9d2d-436e-bd2c-7894c3ae45b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:03.244400 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d315f71-9d2d-436e-bd2c-7894c3ae45b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:03.246857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d315f71-9d2d-436e-bd2c-7894c3ae45b2 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:03.288129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1239/2489] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 5 14:38:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:38:03.301832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db114181-b5b6-44b8-802f-dd93bb69e04c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:03.303305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-db114181-b5b6-44b8-802f-dd93bb69e04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:03.352492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1251/2490] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:38:03 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:38:03.356444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d315f71-9d2d-436e-bd2c-7894c3ae45b2 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:03.369304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d315f71-9d2d-436e-bd2c-7894c3ae45b2 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:03.377468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790188b-96fd-4638-b819-03068af76adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:03.378694 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790188b-96fd-4638-b819-03068af76adb admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:03.379214 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790188b-96fd-4638-b819-03068af76adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:03.379697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790188b-96fd-4638-b819-03068af76adb admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:03.380887 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790188b-96fd-4638-b819-03068af76adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:03.384244 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790188b-96fd-4638-b819-03068af76adb admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:03.411273 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1252/2491] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:38:03.419346 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db114181-b5b6-44b8-802f-dd93bb69e04c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:03.420481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790188b-96fd-4638-b819-03068af76adb admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:03.427890 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4296c-0468-4995-a4ee-862c06983d41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed60e9eecb94ef39c2f4a5e5f50d670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:03.428558 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4296c-0468-4995-a4ee-862c06983d41 service swift] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:03.428842 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4296c-0468-4995-a4ee-862c06983d41 service swift] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:03.429153 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4296c-0468-4995-a4ee-862c06983d41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:03.439380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4296c-0468-4995-a4ee-862c06983d41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:03.441008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4296c-0468-4995-a4ee-862c06983d41 service swift] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:03.450127 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790188b-96fd-4638-b819-03068af76adb admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:03.454783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1240/2492] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 5 14:38:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 05 14:38:03.458522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f0e44-1869-4465-92d9-c297d4bc0f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:03.459756 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f0e44-1869-4465-92d9-c297d4bc0f22 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:03.460554 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f0e44-1869-4465-92d9-c297d4bc0f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:03.461007 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f0e44-1869-4465-92d9-c297d4bc0f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:03.462308 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f0e44-1869-4465-92d9-c297d4bc0f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:03.464863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f0e44-1869-4465-92d9-c297d4bc0f22 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:03.480175 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1253/2493] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:38:03.485279 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4296c-0468-4995-a4ee-862c06983d41 service swift] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:03.497240 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4296c-0468-4995-a4ee-862c06983d41 service swift] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:03.503257 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ce3d2-54da-4b2a-bd62-695050b1c5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:03.504079 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ce3d2-54da-4b2a-bd62-695050b1c5d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:03.504510 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ce3d2-54da-4b2a-bd62-695050b1c5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:03.504823 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ce3d2-54da-4b2a-bd62-695050b1c5d1 admin admin] PATH_INFO: `/v3/projects/419fb97aeb1848108ae9ed7a853d361a/users/8e5090aae3c848b98720fa7b5de2caea/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:03.522338 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ce3d2-54da-4b2a-bd62-695050b1c5d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=419fb97aeb1848108ae9ed7a853d361a, user_id=8e5090aae3c848b98720fa7b5de2caea, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:03.525291 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ce3d2-54da-4b2a-bd62-695050b1c5d1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:03.667120 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1241/2494] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:38:03 2022] PUT /identity/v3/projects/419fb97aeb1848108ae9ed7a853d361a/users/8e5090aae3c848b98720fa7b5de2caea/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:38:03.678393 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5793c3-bca8-4e1e-9a78-95c56a09d3d2 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:03.678679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5793c3-bca8-4e1e-9a78-95c56a09d3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:03.678971 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5793c3-bca8-4e1e-9a78-95c56a09d3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:03.738274 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-ac5793c3-bca8-4e1e-9a78-95c56a09d3d2 None None] MFA Rules not processed for user `8e5090aae3c848b98720fa7b5de2caea`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:38:03.739819 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ac5793c3-bca8-4e1e-9a78-95c56a09d3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:03.848350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1254/2495] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:38:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:38:03.907353 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ce3d2-54da-4b2a-bd62-695050b1c5d1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:03.909136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ff5ce3d2-54da-4b2a-bd62-695050b1c5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:03.983648 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ce3d2-54da-4b2a-bd62-695050b1c5d1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:03.989516 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f155e7b-96a2-4596-be6b-896cbfe46348 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:03.990570 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f155e7b-96a2-4596-be6b-896cbfe46348 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:03.991008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f155e7b-96a2-4596-be6b-896cbfe46348 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:03.991433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f155e7b-96a2-4596-be6b-896cbfe46348 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:04.002435 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f155e7b-96a2-4596-be6b-896cbfe46348 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:04.004110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f155e7b-96a2-4596-be6b-896cbfe46348 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:04.014119 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1242/2496] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:38:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:38:04.175885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:04.262129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dcf4d-90a1-42af-b3e4-1ec932c01d96 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:04.262614 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dcf4d-90a1-42af-b3e4-1ec932c01d96 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:04.262952 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dcf4d-90a1-42af-b3e4-1ec932c01d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:04.289009 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c23dcf4d-90a1-42af-b3e4-1ec932c01d96 None None] MFA Rules not processed for user `635e47d0a5a34fdfb5c8967a96a87828`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:38:04.290530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c23dcf4d-90a1-42af-b3e4-1ec932c01d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:04.373216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1255/2497] 10.222.0.23 () {58 vars in 967 bytes} [Mon Sep 5 14:38:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:38:04.389899 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f155e7b-96a2-4596-be6b-896cbfe46348 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:04.462427 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f155e7b-96a2-4596-be6b-896cbfe46348 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:04.468599 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831960c-e218-4d78-9503-960c86a59316 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed60e9eecb94ef39c2f4a5e5f50d670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:04.469771 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831960c-e218-4d78-9503-960c86a59316 service swift] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:04.470227 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831960c-e218-4d78-9503-960c86a59316 service swift] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:04.470501 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831960c-e218-4d78-9503-960c86a59316 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:04.480351 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831960c-e218-4d78-9503-960c86a59316 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:04.482439 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831960c-e218-4d78-9503-960c86a59316 service swift] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:04.492868 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1243/2498] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 5 14:38:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 05 14:38:05.015455 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:06.382392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:06.883696 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:07.781343 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:07.871979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:08.119504 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dcf4d-90a1-42af-b3e4-1ec932c01d96 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:08.121014 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c23dcf4d-90a1-42af-b3e4-1ec932c01d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:08.192121 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dcf4d-90a1-42af-b3e4-1ec932c01d96 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:08.196771 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f65e96-ef90-4897-876c-3080fd7f85f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:08.197428 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f65e96-ef90-4897-876c-3080fd7f85f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:08.197707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f65e96-ef90-4897-876c-3080fd7f85f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:08.197980 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f65e96-ef90-4897-876c-3080fd7f85f9 admin admin] PATH_INFO: `/v3/users/5823781bf0d445beb31b1b3177b09001` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:08.199116 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f65e96-ef90-4897-876c-3080fd7f85f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5823781bf0d445beb31b1b3177b09001)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:08.203232 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f65e96-ef90-4897-876c-3080fd7f85f9 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:08.406069 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d5f65e96-ef90-4897-876c-3080fd7f85f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5823781bf0d445beb31b1b3177b09001'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:08.483293 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d5f65e96-ef90-4897-876c-3080fd7f85f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5823781bf0d445beb31b1b3177b09001'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:08.498707 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d5f65e96-ef90-4897-876c-3080fd7f85f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5823781bf0d445beb31b1b3177b09001'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:08.499618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d5f65e96-ef90-4897-876c-3080fd7f85f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5823781bf0d445beb31b1b3177b09001'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:08.512034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d5f65e96-ef90-4897-876c-3080fd7f85f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5823781bf0d445beb31b1b3177b09001'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:08.519052 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1256/2499] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:38:08 2022] DELETE /identity/v3/users/5823781bf0d445beb31b1b3177b09001 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:38:08.524100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078b2fe-284c-4198-b819-1c5d303597c2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:08.524387 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078b2fe-284c-4198-b819-1c5d303597c2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:08.524666 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078b2fe-284c-4198-b819-1c5d303597c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:08.549234 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e078b2fe-284c-4198-b819-1c5d303597c2 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:38:08.552694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e078b2fe-284c-4198-b819-1c5d303597c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:08.575501 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:08.621826 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1244/2500] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:38:08.632038 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f65e96-ef90-4897-876c-3080fd7f85f9 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:08.633566 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d5f65e96-ef90-4897-876c-3080fd7f85f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:08.707902 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f65e96-ef90-4897-876c-3080fd7f85f9 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:08.719864 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdc455-f1d1-4904-86bc-3accc1819840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:08.719864 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdc455-f1d1-4904-86bc-3accc1819840 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:08.719864 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdc455-f1d1-4904-86bc-3accc1819840 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:08.719864 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdc455-f1d1-4904-86bc-3accc1819840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:08.727838 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fdc455-f1d1-4904-86bc-3accc1819840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:08.729416 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fdc455-f1d1-4904-86bc-3accc1819840 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:08.738341 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:08.744456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1257/2501] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:38:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:38:09.044909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078b2fe-284c-4198-b819-1c5d303597c2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:09.051068 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e078b2fe-284c-4198-b819-1c5d303597c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:09.066416 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078b2fe-284c-4198-b819-1c5d303597c2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:09.071413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca75b82-a29d-4dcd-8da1-8e6ea0c29ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:09.072123 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca75b82-a29d-4dcd-8da1-8e6ea0c29ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:09.072427 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca75b82-a29d-4dcd-8da1-8e6ea0c29ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:09.072726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca75b82-a29d-4dcd-8da1-8e6ea0c29ae5 admin admin] PATH_INFO: `/v3/projects/bee18fb9bfeb4e61a503d48c4f0f588a` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:09.078025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca75b82-a29d-4dcd-8da1-8e6ea0c29ae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bee18fb9bfeb4e61a503d48c4f0f588a)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:09.078025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca75b82-a29d-4dcd-8da1-8e6ea0c29ae5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:09.249178 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0ca75b82-a29d-4dcd-8da1-8e6ea0c29ae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bee18fb9bfeb4e61a503d48c4f0f588a', 'request_id': 'req-0ca75b82-a29d-4dcd-8da1-8e6ea0c29ae5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:09.257313 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0ca75b82-a29d-4dcd-8da1-8e6ea0c29ae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bee18fb9bfeb4e61a503d48c4f0f588a', 'request_id': 'req-0ca75b82-a29d-4dcd-8da1-8e6ea0c29ae5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:09.347841 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0ca75b82-a29d-4dcd-8da1-8e6ea0c29ae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bee18fb9bfeb4e61a503d48c4f0f588a', 'request_id': 'req-0ca75b82-a29d-4dcd-8da1-8e6ea0c29ae5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:09.381524 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0ca75b82-a29d-4dcd-8da1-8e6ea0c29ae5 admin admin] The token cache is being invalidate because project bee18fb9bfeb4e61a503d48c4f0f588a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:38:09.381524 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0ca75b82-a29d-4dcd-8da1-8e6ea0c29ae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:09.381524 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0ca75b82-a29d-4dcd-8da1-8e6ea0c29ae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:09.381524 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1245/2502] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:38:09 2022] DELETE /identity/v3/projects/bee18fb9bfeb4e61a503d48c4f0f588a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:38:09.387045 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c3065-e47e-456f-95df-293df02c4acc None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:09.387768 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c3065-e47e-456f-95df-293df02c4acc None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:09.388073 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c3065-e47e-456f-95df-293df02c4acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:09.413742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-2e8c3065-e47e-456f-95df-293df02c4acc None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:38:09.415379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2e8c3065-e47e-456f-95df-293df02c4acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:09.449743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:09.499640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:09.503287 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1258/2503] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:38:09.511746 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae160c-844d-4dde-8f08-127367407c29 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:09.512371 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae160c-844d-4dde-8f08-127367407c29 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:09.513097 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae160c-844d-4dde-8f08-127367407c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:09.539347 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6eae160c-844d-4dde-8f08-127367407c29 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:38:09.540747 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6eae160c-844d-4dde-8f08-127367407c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:09.560215 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1246/2504] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:38:09.561004 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c3065-e47e-456f-95df-293df02c4acc None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:09.586123 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c3065-e47e-456f-95df-293df02c4acc None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:09.588252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:09.596885 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60c101-ae62-4190-9b25-2718b1977f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:09.597591 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60c101-ae62-4190-9b25-2718b1977f15 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:09.597970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60c101-ae62-4190-9b25-2718b1977f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:09.598242 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60c101-ae62-4190-9b25-2718b1977f15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:09.599101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60c101-ae62-4190-9b25-2718b1977f15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:38:09.599660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60c101-ae62-4190-9b25-2718b1977f15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:09.601942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60c101-ae62-4190-9b25-2718b1977f15 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:09.620009 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1259/2505] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:38:09.624805 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae160c-844d-4dde-8f08-127367407c29 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:09.635506 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae160c-844d-4dde-8f08-127367407c29 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:09.641072 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c41203-916f-40b7-b6e3-984ad1bb28ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:09.641818 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c41203-916f-40b7-b6e3-984ad1bb28ba admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:09.642433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c41203-916f-40b7-b6e3-984ad1bb28ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:09.642737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c41203-916f-40b7-b6e3-984ad1bb28ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:09.643646 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c41203-916f-40b7-b6e3-984ad1bb28ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:09.645747 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c41203-916f-40b7-b6e3-984ad1bb28ba admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:09.766534 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1247/2506] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:38:09 2022] POST /identity/v3/projects => generated 391 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:38:09.771782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60c101-ae62-4190-9b25-2718b1977f15 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:09.786386 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60c101-ae62-4190-9b25-2718b1977f15 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:09.905332 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e33023-f3c8-439f-92a7-5c9aa4bcb342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:09.905989 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e33023-f3c8-439f-92a7-5c9aa4bcb342 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:09.906455 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e33023-f3c8-439f-92a7-5c9aa4bcb342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:09.906745 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e33023-f3c8-439f-92a7-5c9aa4bcb342 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:09.907409 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e33023-f3c8-439f-92a7-5c9aa4bcb342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:09.910353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e33023-f3c8-439f-92a7-5c9aa4bcb342 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:10.024152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1260/2507] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:38:09 2022] POST /identity/v3/users => generated 296 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:38:10.027594 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c41203-916f-40b7-b6e3-984ad1bb28ba admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:10.039928 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c41203-916f-40b7-b6e3-984ad1bb28ba admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:10.046421 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e36954-adc3-4d13-bff9-b1927c4632ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:10.047151 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e36954-adc3-4d13-bff9-b1927c4632ab admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:10.047751 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e36954-adc3-4d13-bff9-b1927c4632ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:10.048238 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e36954-adc3-4d13-bff9-b1927c4632ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:10.052435 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e36954-adc3-4d13-bff9-b1927c4632ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:10.052435 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e36954-adc3-4d13-bff9-b1927c4632ab admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:10.091278 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1248/2508] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:38:10.092725 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e33023-f3c8-439f-92a7-5c9aa4bcb342 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:10.106968 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e33023-f3c8-439f-92a7-5c9aa4bcb342 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:10.114077 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b70df8-e428-416c-8899-3f176ca9fb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:10.115000 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b70df8-e428-416c-8899-3f176ca9fb46 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:10.115509 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b70df8-e428-416c-8899-3f176ca9fb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:10.115968 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b70df8-e428-416c-8899-3f176ca9fb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:10.116836 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b70df8-e428-416c-8899-3f176ca9fb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:10.118979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b70df8-e428-416c-8899-3f176ca9fb46 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:10.135896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1261/2509] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:38:10.139984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e36954-adc3-4d13-bff9-b1927c4632ab admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:10.153628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e36954-adc3-4d13-bff9-b1927c4632ab admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:10.163914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:10.165554 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a9b7b-7342-4a36-9d24-495ae0d725c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:10.166705 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a9b7b-7342-4a36-9d24-495ae0d725c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:10.167169 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a9b7b-7342-4a36-9d24-495ae0d725c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:10.169488 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a9b7b-7342-4a36-9d24-495ae0d725c9 admin admin] PATH_INFO: `/v3/projects/4ce2ab7a1c6e4ff0ad0e1d40e9bb24b1/users/51336f3b3e0844ed814020ed7b91e940/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:10.212136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a9b7b-7342-4a36-9d24-495ae0d725c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce2ab7a1c6e4ff0ad0e1d40e9bb24b1, user_id=51336f3b3e0844ed814020ed7b91e940, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:10.212136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a9b7b-7342-4a36-9d24-495ae0d725c9 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:10.314518 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1249/2510] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:38:10 2022] PUT /identity/v3/projects/4ce2ab7a1c6e4ff0ad0e1d40e9bb24b1/users/51336f3b3e0844ed814020ed7b91e940/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:38:10.316505 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2b634-8abd-4092-818e-703cf7a6e964 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:10.316830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2b634-8abd-4092-818e-703cf7a6e964 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:10.317126 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2b634-8abd-4092-818e-703cf7a6e964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:10.364199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-ebb2b634-8abd-4092-818e-703cf7a6e964 None None] MFA Rules not processed for user `51336f3b3e0844ed814020ed7b91e940`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:38:10.364199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ebb2b634-8abd-4092-818e-703cf7a6e964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:10.499007 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1262/2511] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:38:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:38:10.519577 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a9b7b-7342-4a36-9d24-495ae0d725c9 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:10.524414 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e19a9b7b-7342-4a36-9d24-495ae0d725c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:10.642403 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a9b7b-7342-4a36-9d24-495ae0d725c9 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:10.647625 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75698315-6979-444d-a559-08d1ab0656ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:10.648462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75698315-6979-444d-a559-08d1ab0656ff service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:10.648849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75698315-6979-444d-a559-08d1ab0656ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:10.649251 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75698315-6979-444d-a559-08d1ab0656ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:10.661903 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75698315-6979-444d-a559-08d1ab0656ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:10.664598 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75698315-6979-444d-a559-08d1ab0656ff service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:10.691116 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1250/2512] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:38:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:38:10.841305 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2b634-8abd-4092-818e-703cf7a6e964 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:10.844589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ebb2b634-8abd-4092-818e-703cf7a6e964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:10.878497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:10.947846 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2b634-8abd-4092-818e-703cf7a6e964 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:10.951535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345cd37-5147-4bf6-90ff-f0ba6fc11f3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:10.952490 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345cd37-5147-4bf6-90ff-f0ba6fc11f3b service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:10.952490 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345cd37-5147-4bf6-90ff-f0ba6fc11f3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:10.952738 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345cd37-5147-4bf6-90ff-f0ba6fc11f3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:10.955041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5345cd37-5147-4bf6-90ff-f0ba6fc11f3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:11.042875 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345cd37-5147-4bf6-90ff-f0ba6fc11f3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:11.044381 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345cd37-5147-4bf6-90ff-f0ba6fc11f3b service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:11.058127 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1263/2513] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:38:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:38:11.195970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cdb23-b340-45ab-a413-3cca667c320a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:11.196497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cdb23-b340-45ab-a413-3cca667c320a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:11.196497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cdb23-b340-45ab-a413-3cca667c320a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:11.224624 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-160cdb23-b340-45ab-a413-3cca667c320a None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:38:11.226282 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-160cdb23-b340-45ab-a413-3cca667c320a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:11.325831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1251/2514] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Sep 5 14:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:38:11.352939 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345cd37-5147-4bf6-90ff-f0ba6fc11f3b service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:11.354442 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5345cd37-5147-4bf6-90ff-f0ba6fc11f3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:11.484815 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345cd37-5147-4bf6-90ff-f0ba6fc11f3b service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:11.507167 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc872e9-f90b-422d-898a-7324cdaee796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:11.510665 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc872e9-f90b-422d-898a-7324cdaee796 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:11.510665 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc872e9-f90b-422d-898a-7324cdaee796 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:11.510665 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc872e9-f90b-422d-898a-7324cdaee796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:11.534137 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc872e9-f90b-422d-898a-7324cdaee796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:11.551996 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc872e9-f90b-422d-898a-7324cdaee796 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:11.585380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1264/2515] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:38:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:38:12.501159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:13.231622 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cdb23-b340-45ab-a413-3cca667c320a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:13.233016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-160cdb23-b340-45ab-a413-3cca667c320a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:13.249182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cdb23-b340-45ab-a413-3cca667c320a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:13.258677 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb728326-8e0e-421f-a441-80e5542b19dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:13.260925 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb728326-8e0e-421f-a441-80e5542b19dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:13.261337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb728326-8e0e-421f-a441-80e5542b19dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:13.261972 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb728326-8e0e-421f-a441-80e5542b19dd admin admin] PATH_INFO: `/v3/users/34f4120200ac41d5b9d90855996145a2` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:13.263331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb728326-8e0e-421f-a441-80e5542b19dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=34f4120200ac41d5b9d90855996145a2)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:13.266269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb728326-8e0e-421f-a441-80e5542b19dd admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:13.312490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:13.507137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-eb728326-8e0e-421f-a441-80e5542b19dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34f4120200ac41d5b9d90855996145a2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:13.510466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-eb728326-8e0e-421f-a441-80e5542b19dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34f4120200ac41d5b9d90855996145a2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:13.621171 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-eb728326-8e0e-421f-a441-80e5542b19dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34f4120200ac41d5b9d90855996145a2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:13.652518 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-eb728326-8e0e-421f-a441-80e5542b19dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34f4120200ac41d5b9d90855996145a2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:13.654154 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-eb728326-8e0e-421f-a441-80e5542b19dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34f4120200ac41d5b9d90855996145a2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:13.685389 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1252/2516] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:38:13 2022] DELETE /identity/v3/users/34f4120200ac41d5b9d90855996145a2 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:38:13.698716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a1f1f-db15-4d66-9657-54c6932a39f2 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:13.699344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a1f1f-db15-4d66-9657-54c6932a39f2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:13.699344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a1f1f-db15-4d66-9657-54c6932a39f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:13.738358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-239a1f1f-db15-4d66-9657-54c6932a39f2 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:38:13.742711 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-239a1f1f-db15-4d66-9657-54c6932a39f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:13.905854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1265/2517] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:38:13.947952 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb728326-8e0e-421f-a441-80e5542b19dd admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:13.949619 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-eb728326-8e0e-421f-a441-80e5542b19dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:14.052994 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb728326-8e0e-421f-a441-80e5542b19dd admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:14.056614 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5d184-5188-40c5-bb96-b062c704979b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:14.058259 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5d184-5188-40c5-bb96-b062c704979b service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:14.058621 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5d184-5188-40c5-bb96-b062c704979b service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:14.058965 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5d184-5188-40c5-bb96-b062c704979b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:14.085147 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5d184-5188-40c5-bb96-b062c704979b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:14.090309 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5d184-5188-40c5-bb96-b062c704979b service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:14.124175 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1253/2518] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:38:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:38:14.358210 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:14.479201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:15.094533 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a1f1f-db15-4d66-9657-54c6932a39f2 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:15.096461 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-239a1f1f-db15-4d66-9657-54c6932a39f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:15.125940 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a1f1f-db15-4d66-9657-54c6932a39f2 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:15.169255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a53cb-894f-4ae0-b7d1-17bbeedfc9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:15.169255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a53cb-894f-4ae0-b7d1-17bbeedfc9cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:15.169255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a53cb-894f-4ae0-b7d1-17bbeedfc9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:15.169255 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a53cb-894f-4ae0-b7d1-17bbeedfc9cd admin admin] PATH_INFO: `/v3/projects/11483b7a3d574e64acbd283f349dd369` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:15.171973 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a53cb-894f-4ae0-b7d1-17bbeedfc9cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=11483b7a3d574e64acbd283f349dd369)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:15.175614 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a53cb-894f-4ae0-b7d1-17bbeedfc9cd admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:15.338699 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d20a53cb-894f-4ae0-b7d1-17bbeedfc9cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11483b7a3d574e64acbd283f349dd369', 'request_id': 'req-d20a53cb-894f-4ae0-b7d1-17bbeedfc9cd'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:15.359528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d20a53cb-894f-4ae0-b7d1-17bbeedfc9cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11483b7a3d574e64acbd283f349dd369', 'request_id': 'req-d20a53cb-894f-4ae0-b7d1-17bbeedfc9cd'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:15.449068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d20a53cb-894f-4ae0-b7d1-17bbeedfc9cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11483b7a3d574e64acbd283f349dd369', 'request_id': 'req-d20a53cb-894f-4ae0-b7d1-17bbeedfc9cd'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:15.462710 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d20a53cb-894f-4ae0-b7d1-17bbeedfc9cd admin admin] The token cache is being invalidate because project 11483b7a3d574e64acbd283f349dd369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:38:15.463068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d20a53cb-894f-4ae0-b7d1-17bbeedfc9cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:15.463886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d20a53cb-894f-4ae0-b7d1-17bbeedfc9cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:15.466170 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1266/2519] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:38:15 2022] DELETE /identity/v3/projects/11483b7a3d574e64acbd283f349dd369 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:38:15.946647 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:16.461122 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:16.569871 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:16.926018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84002b-4433-4827-a63b-e91ce8edc5ae None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:16.926312 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84002b-4433-4827-a63b-e91ce8edc5ae None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:16.926597 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84002b-4433-4827-a63b-e91ce8edc5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:16.948848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-cc84002b-4433-4827-a63b-e91ce8edc5ae None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:38:16.950261 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cc84002b-4433-4827-a63b-e91ce8edc5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:17.020647 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1254/2520] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Sep 5 14:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:38:17.055029 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a53cb-894f-4ae0-b7d1-17bbeedfc9cd admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:17.057160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d20a53cb-894f-4ae0-b7d1-17bbeedfc9cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:17.137724 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a53cb-894f-4ae0-b7d1-17bbeedfc9cd admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:17.144317 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d1185-92ba-41ce-b9ba-ae45bcf00040 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:17.144912 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d1185-92ba-41ce-b9ba-ae45bcf00040 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:17.145223 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d1185-92ba-41ce-b9ba-ae45bcf00040 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:17.145497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d1185-92ba-41ce-b9ba-ae45bcf00040 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:17.153982 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d1185-92ba-41ce-b9ba-ae45bcf00040 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:17.155627 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d1185-92ba-41ce-b9ba-ae45bcf00040 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:17.166365 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1267/2521] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:38:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:38:17.820800 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90499a2-d801-49de-9812-b4f5f9d81ad8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:17.821400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90499a2-d801-49de-9812-b4f5f9d81ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:17.821497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90499a2-d801-49de-9812-b4f5f9d81ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:17.862965 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c90499a2-d801-49de-9812-b4f5f9d81ad8 None None] MFA Rules not processed for user `c74f8acfc15647f4b3606bc46fb16992`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:38:17.864433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c90499a2-d801-49de-9812-b4f5f9d81ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:17.926232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1255/2522] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:38:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:38:18.317950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:18.842518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:18.939718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d1185-92ba-41ce-b9ba-ae45bcf00040 service nova] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:18.942072 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7e2d1185-92ba-41ce-b9ba-ae45bcf00040 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:18.975607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d1185-92ba-41ce-b9ba-ae45bcf00040 service nova] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:18.994559 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f6c1a-dfe2-4641-bfd0-3d622e4f513a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:18.995205 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f6c1a-dfe2-4641-bfd0-3d622e4f513a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:18.995481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f6c1a-dfe2-4641-bfd0-3d622e4f513a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:18.995779 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f6c1a-dfe2-4641-bfd0-3d622e4f513a admin admin] PATH_INFO: `/v3/users/8e5090aae3c848b98720fa7b5de2caea` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:18.999003 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f6c1a-dfe2-4641-bfd0-3d622e4f513a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e5090aae3c848b98720fa7b5de2caea)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:19.010693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:19.011645 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f6c1a-dfe2-4641-bfd0-3d622e4f513a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:19.247982 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-ea1f6c1a-dfe2-4641-bfd0-3d622e4f513a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e5090aae3c848b98720fa7b5de2caea'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:19.385951 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-ea1f6c1a-dfe2-4641-bfd0-3d622e4f513a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e5090aae3c848b98720fa7b5de2caea'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:19.403068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-ea1f6c1a-dfe2-4641-bfd0-3d622e4f513a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e5090aae3c848b98720fa7b5de2caea'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:19.403978 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-ea1f6c1a-dfe2-4641-bfd0-3d622e4f513a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e5090aae3c848b98720fa7b5de2caea'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:19.412339 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-ea1f6c1a-dfe2-4641-bfd0-3d622e4f513a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e5090aae3c848b98720fa7b5de2caea'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:19.419037 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1268/2523] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:38:18 2022] DELETE /identity/v3/users/8e5090aae3c848b98720fa7b5de2caea => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:38:19.424129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748af3a-b772-44be-bd48-1cddbfbafed2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:19.425483 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748af3a-b772-44be-bd48-1cddbfbafed2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:19.425928 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748af3a-b772-44be-bd48-1cddbfbafed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:19.456008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e748af3a-b772-44be-bd48-1cddbfbafed2 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:38:19.457351 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e748af3a-b772-44be-bd48-1cddbfbafed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:19.527072 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1256/2524] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:38:19.541444 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f6c1a-dfe2-4641-bfd0-3d622e4f513a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:19.543337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ea1f6c1a-dfe2-4641-bfd0-3d622e4f513a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:19.624031 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f6c1a-dfe2-4641-bfd0-3d622e4f513a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:19.628488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f67c4c-8524-4459-b577-60f41634ce8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:19.629219 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f67c4c-8524-4459-b577-60f41634ce8b service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:19.629578 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f67c4c-8524-4459-b577-60f41634ce8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:19.629923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f67c4c-8524-4459-b577-60f41634ce8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:19.639362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f67c4c-8524-4459-b577-60f41634ce8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:19.641532 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f67c4c-8524-4459-b577-60f41634ce8b service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:19.651336 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1269/2525] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:38:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:38:20.139257 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748af3a-b772-44be-bd48-1cddbfbafed2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:20.141984 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e748af3a-b772-44be-bd48-1cddbfbafed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:20.162616 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748af3a-b772-44be-bd48-1cddbfbafed2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:20.173929 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced218e-6d4c-4117-b223-aca6c1f9080e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:20.173929 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced218e-6d4c-4117-b223-aca6c1f9080e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:20.173929 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced218e-6d4c-4117-b223-aca6c1f9080e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:20.173929 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced218e-6d4c-4117-b223-aca6c1f9080e admin admin] PATH_INFO: `/v3/projects/419fb97aeb1848108ae9ed7a853d361a` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:20.174600 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced218e-6d4c-4117-b223-aca6c1f9080e admin admin] RBAC: Authorizing `identity:delete_project(project_id=419fb97aeb1848108ae9ed7a853d361a)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:20.174600 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced218e-6d4c-4117-b223-aca6c1f9080e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:20.293523 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2ced218e-6d4c-4117-b223-aca6c1f9080e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '419fb97aeb1848108ae9ed7a853d361a', 'request_id': 'req-2ced218e-6d4c-4117-b223-aca6c1f9080e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:20.299941 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2ced218e-6d4c-4117-b223-aca6c1f9080e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '419fb97aeb1848108ae9ed7a853d361a', 'request_id': 'req-2ced218e-6d4c-4117-b223-aca6c1f9080e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:20.426272 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2ced218e-6d4c-4117-b223-aca6c1f9080e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '419fb97aeb1848108ae9ed7a853d361a', 'request_id': 'req-2ced218e-6d4c-4117-b223-aca6c1f9080e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:20.439045 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2ced218e-6d4c-4117-b223-aca6c1f9080e admin admin] The token cache is being invalidate because project 419fb97aeb1848108ae9ed7a853d361a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:38:20.439357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2ced218e-6d4c-4117-b223-aca6c1f9080e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:20.439990 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2ced218e-6d4c-4117-b223-aca6c1f9080e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:20.441585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1257/2526] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:38:20 2022] DELETE /identity/v3/projects/419fb97aeb1848108ae9ed7a853d361a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:38:21.255297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:21.415343 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:21.575298 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8c5b1-0e71-4370-8edc-03642378a18f None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:21.575642 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8c5b1-0e71-4370-8edc-03642378a18f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:21.575953 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8c5b1-0e71-4370-8edc-03642378a18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:21.595811 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-aeb8c5b1-0e71-4370-8edc-03642378a18f None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:38:21.597027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-aeb8c5b1-0e71-4370-8edc-03642378a18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:21.661988 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1270/2527] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Sep 5 14:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:38:21.685979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced218e-6d4c-4117-b223-aca6c1f9080e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:21.687802 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2ced218e-6d4c-4117-b223-aca6c1f9080e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:21.766601 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced218e-6d4c-4117-b223-aca6c1f9080e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:21.772114 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320328c1-edbd-466f-9316-b8e107382a35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:21.772714 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320328c1-edbd-466f-9316-b8e107382a35 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:21.773120 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320328c1-edbd-466f-9316-b8e107382a35 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:21.773401 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320328c1-edbd-466f-9316-b8e107382a35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:21.782085 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320328c1-edbd-466f-9316-b8e107382a35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:21.783781 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320328c1-edbd-466f-9316-b8e107382a35 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:21.793540 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1258/2528] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:38:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:38:22.409757 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:22.466607 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:22.746321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:22.809738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:22.969695 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:23.275494 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:24.158779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:24.167195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8c5b1-0e71-4370-8edc-03642378a18f None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:24.168645 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-aeb8c5b1-0e71-4370-8edc-03642378a18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:24.181434 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8c5b1-0e71-4370-8edc-03642378a18f None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:24.186131 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450041d6-89d4-4077-a8c0-a8f386a5bc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:24.186744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450041d6-89d4-4077-a8c0-a8f386a5bc03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:24.187068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450041d6-89d4-4077-a8c0-a8f386a5bc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:24.187288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450041d6-89d4-4077-a8c0-a8f386a5bc03 admin admin] PATH_INFO: `/v3/users/b733287bd36d46d88ffce476c24d4aee` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:24.188973 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450041d6-89d4-4077-a8c0-a8f386a5bc03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b733287bd36d46d88ffce476c24d4aee)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:24.190994 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450041d6-89d4-4077-a8c0-a8f386a5bc03 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:24.243495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:24.503069 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:24.514576 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-450041d6-89d4-4077-a8c0-a8f386a5bc03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b733287bd36d46d88ffce476c24d4aee'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:24.591971 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-450041d6-89d4-4077-a8c0-a8f386a5bc03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b733287bd36d46d88ffce476c24d4aee'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:24.605669 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-450041d6-89d4-4077-a8c0-a8f386a5bc03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b733287bd36d46d88ffce476c24d4aee'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:24.606355 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-450041d6-89d4-4077-a8c0-a8f386a5bc03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b733287bd36d46d88ffce476c24d4aee'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:24.614071 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-450041d6-89d4-4077-a8c0-a8f386a5bc03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b733287bd36d46d88ffce476c24d4aee'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:24.622569 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1271/2529] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:38:24 2022] DELETE /identity/v3/users/b733287bd36d46d88ffce476c24d4aee => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:38:24.625572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae8fdd-2279-431a-8a53-dce1e391ee83 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:24.626136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae8fdd-2279-431a-8a53-dce1e391ee83 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:24.626506 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae8fdd-2279-431a-8a53-dce1e391ee83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:24.637724 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:24.652033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4cae8fdd-2279-431a-8a53-dce1e391ee83 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:38:24.652033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4cae8fdd-2279-431a-8a53-dce1e391ee83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:24.654715 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450041d6-89d4-4077-a8c0-a8f386a5bc03 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:24.656239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-450041d6-89d4-4077-a8c0-a8f386a5bc03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:24.717277 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1259/2530] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:38:24.727015 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450041d6-89d4-4077-a8c0-a8f386a5bc03 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:24.728713 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae8fdd-2279-431a-8a53-dce1e391ee83 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:24.730784 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4cae8fdd-2279-431a-8a53-dce1e391ee83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:24.733303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4d2d9-8fb7-4eaa-ac8c-b5ebad50b93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:24.733934 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4d2d9-8fb7-4eaa-ac8c-b5ebad50b93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:24.734215 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4d2d9-8fb7-4eaa-ac8c-b5ebad50b93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:24.734576 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4d2d9-8fb7-4eaa-ac8c-b5ebad50b93d admin admin] PATH_INFO: `/v3/users/51336f3b3e0844ed814020ed7b91e940` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:24.736375 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4d2d9-8fb7-4eaa-ac8c-b5ebad50b93d admin admin] RBAC: Authorizing `identity:delete_user(user_id=51336f3b3e0844ed814020ed7b91e940)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:24.738351 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4d2d9-8fb7-4eaa-ac8c-b5ebad50b93d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:24.787978 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae8fdd-2279-431a-8a53-dce1e391ee83 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:24.791646 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d46e6b-2a0c-49fd-9fcc-c32de52f4776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:24.792250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d46e6b-2a0c-49fd-9fcc-c32de52f4776 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:24.792532 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d46e6b-2a0c-49fd-9fcc-c32de52f4776 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:24.792802 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d46e6b-2a0c-49fd-9fcc-c32de52f4776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:24.802852 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d46e6b-2a0c-49fd-9fcc-c32de52f4776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:24.804343 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d46e6b-2a0c-49fd-9fcc-c32de52f4776 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:24.814831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1260/2531] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:38:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:38:24.931688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4af4d2d9-8fb7-4eaa-ac8c-b5ebad50b93d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51336f3b3e0844ed814020ed7b91e940'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:24.993003 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4af4d2d9-8fb7-4eaa-ac8c-b5ebad50b93d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51336f3b3e0844ed814020ed7b91e940'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:24.995376 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:25.015649 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4af4d2d9-8fb7-4eaa-ac8c-b5ebad50b93d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51336f3b3e0844ed814020ed7b91e940'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:25.016853 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4af4d2d9-8fb7-4eaa-ac8c-b5ebad50b93d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51336f3b3e0844ed814020ed7b91e940'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:25.028927 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4af4d2d9-8fb7-4eaa-ac8c-b5ebad50b93d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51336f3b3e0844ed814020ed7b91e940'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:25.042453 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1272/2532] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:38:24 2022] DELETE /identity/v3/users/51336f3b3e0844ed814020ed7b91e940 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:38:25.044833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9d775-2c8b-4459-9762-2620850cb3a2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:25.045181 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9d775-2c8b-4459-9762-2620850cb3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:25.045457 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9d775-2c8b-4459-9762-2620850cb3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:25.070559 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-20d9d775-2c8b-4459-9762-2620850cb3a2 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:38:25.071784 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-20d9d775-2c8b-4459-9762-2620850cb3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:25.132886 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1261/2533] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:38:25.142590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4d2d9-8fb7-4eaa-ac8c-b5ebad50b93d admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:25.144108 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4af4d2d9-8fb7-4eaa-ac8c-b5ebad50b93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:25.163967 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:25.204885 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4d2d9-8fb7-4eaa-ac8c-b5ebad50b93d admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:25.208688 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c0996-a2cf-4ad0-8e11-e27284d274f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:25.209333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c0996-a2cf-4ad0-8e11-e27284d274f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:25.209615 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c0996-a2cf-4ad0-8e11-e27284d274f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:25.209886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c0996-a2cf-4ad0-8e11-e27284d274f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:25.219824 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c0996-a2cf-4ad0-8e11-e27284d274f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:25.221292 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c0996-a2cf-4ad0-8e11-e27284d274f9 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:25.230678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1273/2534] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:38:25.255145 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9d775-2c8b-4459-9762-2620850cb3a2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:25.255145 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-20d9d775-2c8b-4459-9762-2620850cb3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:25.274348 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9d775-2c8b-4459-9762-2620850cb3a2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:25.281259 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce63ef-2ee6-4e33-adc1-7b928fc70bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:25.283376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce63ef-2ee6-4e33-adc1-7b928fc70bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:25.283716 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce63ef-2ee6-4e33-adc1-7b928fc70bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:25.284304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce63ef-2ee6-4e33-adc1-7b928fc70bfd admin admin] PATH_INFO: `/v3/projects/ccbbcce7974c445290fe5216547758a0` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:25.286088 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce63ef-2ee6-4e33-adc1-7b928fc70bfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccbbcce7974c445290fe5216547758a0)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:25.288475 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce63ef-2ee6-4e33-adc1-7b928fc70bfd admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:25.421142 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-01ce63ef-2ee6-4e33-adc1-7b928fc70bfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccbbcce7974c445290fe5216547758a0', 'request_id': 'req-01ce63ef-2ee6-4e33-adc1-7b928fc70bfd'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:25.427450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-01ce63ef-2ee6-4e33-adc1-7b928fc70bfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccbbcce7974c445290fe5216547758a0', 'request_id': 'req-01ce63ef-2ee6-4e33-adc1-7b928fc70bfd'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:25.564829 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-01ce63ef-2ee6-4e33-adc1-7b928fc70bfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccbbcce7974c445290fe5216547758a0', 'request_id': 'req-01ce63ef-2ee6-4e33-adc1-7b928fc70bfd'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:25.579916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-01ce63ef-2ee6-4e33-adc1-7b928fc70bfd admin admin] The token cache is being invalidate because project ccbbcce7974c445290fe5216547758a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:38:25.580350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-01ce63ef-2ee6-4e33-adc1-7b928fc70bfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:25.581166 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-01ce63ef-2ee6-4e33-adc1-7b928fc70bfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:25.582801 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1262/2535] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:38:25 2022] DELETE /identity/v3/projects/ccbbcce7974c445290fe5216547758a0 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:38:25.756221 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c0996-a2cf-4ad0-8e11-e27284d274f9 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:25.758506 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-658c0996-a2cf-4ad0-8e11-e27284d274f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:25.774327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c0996-a2cf-4ad0-8e11-e27284d274f9 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:25.871510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ca63d-fbf8-4fe2-a3ed-87ac1409784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:25.872950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ca63d-fbf8-4fe2-a3ed-87ac1409784c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:25.874813 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ca63d-fbf8-4fe2-a3ed-87ac1409784c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:25.876065 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ca63d-fbf8-4fe2-a3ed-87ac1409784c admin admin] PATH_INFO: `/v3/projects/4ce2ab7a1c6e4ff0ad0e1d40e9bb24b1` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:25.877405 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ca63d-fbf8-4fe2-a3ed-87ac1409784c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce2ab7a1c6e4ff0ad0e1d40e9bb24b1)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:25.879367 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ca63d-fbf8-4fe2-a3ed-87ac1409784c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:26.037794 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fa5ca63d-fbf8-4fe2-a3ed-87ac1409784c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce2ab7a1c6e4ff0ad0e1d40e9bb24b1', 'request_id': 'req-fa5ca63d-fbf8-4fe2-a3ed-87ac1409784c'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:26.046157 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fa5ca63d-fbf8-4fe2-a3ed-87ac1409784c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce2ab7a1c6e4ff0ad0e1d40e9bb24b1', 'request_id': 'req-fa5ca63d-fbf8-4fe2-a3ed-87ac1409784c'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:26.152131 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fa5ca63d-fbf8-4fe2-a3ed-87ac1409784c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce2ab7a1c6e4ff0ad0e1d40e9bb24b1', 'request_id': 'req-fa5ca63d-fbf8-4fe2-a3ed-87ac1409784c'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:26.165138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fa5ca63d-fbf8-4fe2-a3ed-87ac1409784c admin admin] The token cache is being invalidate because project 4ce2ab7a1c6e4ff0ad0e1d40e9bb24b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:38:26.165431 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fa5ca63d-fbf8-4fe2-a3ed-87ac1409784c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:26.166082 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fa5ca63d-fbf8-4fe2-a3ed-87ac1409784c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:38:26.167623 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1274/2536] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:38:25 2022] DELETE /identity/v3/projects/4ce2ab7a1c6e4ff0ad0e1d40e9bb24b1 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:38:26.468674 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:26.655616 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:26.895890 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c825da-f19d-47db-bec9-34a6db89018a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:26.896107 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c825da-f19d-47db-bec9-34a6db89018a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:26.896347 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c825da-f19d-47db-bec9-34a6db89018a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:26.917498 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-10c825da-f19d-47db-bec9-34a6db89018a None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:38:26.918720 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-10c825da-f19d-47db-bec9-34a6db89018a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:26.983010 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1263/2537] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Sep 5 14:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:38:27.005862 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ca63d-fbf8-4fe2-a3ed-87ac1409784c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:27.007297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fa5ca63d-fbf8-4fe2-a3ed-87ac1409784c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:27.096691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ca63d-fbf8-4fe2-a3ed-87ac1409784c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:27.102360 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ee626-1545-4a38-8f38-23f7ea138b0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:27.102975 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ee626-1545-4a38-8f38-23f7ea138b0f service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:27.103285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ee626-1545-4a38-8f38-23f7ea138b0f service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:27.103557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ee626-1545-4a38-8f38-23f7ea138b0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:27.113821 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ee626-1545-4a38-8f38-23f7ea138b0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:27.121250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ee626-1545-4a38-8f38-23f7ea138b0f service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:27.126048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1275/2538] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:38:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:38:27.186276 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:27.472157 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:31.180124 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd2cb5-f3c9-433f-b964-b6ab04b122b7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:31.180655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd2cb5-f3c9-433f-b964-b6ab04b122b7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:31.180757 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd2cb5-f3c9-433f-b964-b6ab04b122b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:31.201003 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c0dd2cb5-f3c9-433f-b964-b6ab04b122b7 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:38:31.202262 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c0dd2cb5-f3c9-433f-b964-b6ab04b122b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:38:31.210856 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1264/2539] 10.222.0.44 () {58 vars in 1016 bytes} [Mon Sep 5 14:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:38:31.252627 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ee626-1545-4a38-8f38-23f7ea138b0f service nova] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:38:31.263997 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ee626-1545-4a38-8f38-23f7ea138b0f service nova] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:38:31.270043 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7351386-973c-450b-ac03-de7178e6b51f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:38:31.270629 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7351386-973c-450b-ac03-de7178e6b51f service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:38:31.270908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7351386-973c-450b-ac03-de7178e6b51f service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:38:31.271182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7351386-973c-450b-ac03-de7178e6b51f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:38:31.279306 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7351386-973c-450b-ac03-de7178e6b51f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:38:31.280888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7351386-973c-450b-ac03-de7178e6b51f service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:38:31.290530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1276/2540] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:38:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:38:41.196269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:41.286363 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=8 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:01.785664 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a743a0-4097-4777-83e7-73063016a82e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:01.786116 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a743a0-4097-4777-83e7-73063016a82e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:01.786205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a743a0-4097-4777-83e7-73063016a82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:01.808537 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-01a743a0-4097-4777-83e7-73063016a82e None None] MFA Rules not processed for user `0a11601da6724a97b4f5acc5b06b2811`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:39:01.809789 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-01a743a0-4097-4777-83e7-73063016a82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:39:01.889190 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1265/2541] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:39:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:39:07.898570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7351386-973c-450b-ac03-de7178e6b51f service nova] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:39:07.900131 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c7351386-973c-450b-ac03-de7178e6b51f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:39:07.918683 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7351386-973c-450b-ac03-de7178e6b51f service nova] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:39:07.922903 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd522955-a0d5-4999-a4fd-236fe7d01fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:39:07.924610 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd522955-a0d5-4999-a4fd-236fe7d01fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:07.927145 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd522955-a0d5-4999-a4fd-236fe7d01fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:07.927556 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd522955-a0d5-4999-a4fd-236fe7d01fea admin admin] PATH_INFO: `/v3/users/283b6df7aaf741b284d97004c9026cb2` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:07.929501 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd522955-a0d5-4999-a4fd-236fe7d01fea admin admin] RBAC: Authorizing `identity:delete_user(user_id=283b6df7aaf741b284d97004c9026cb2)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:39:07.932907 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd522955-a0d5-4999-a4fd-236fe7d01fea admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:39:08.172234 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fd522955-a0d5-4999-a4fd-236fe7d01fea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '283b6df7aaf741b284d97004c9026cb2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:39:08.284715 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fd522955-a0d5-4999-a4fd-236fe7d01fea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '283b6df7aaf741b284d97004c9026cb2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:39:08.301435 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fd522955-a0d5-4999-a4fd-236fe7d01fea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '283b6df7aaf741b284d97004c9026cb2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:39:08.302295 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fd522955-a0d5-4999-a4fd-236fe7d01fea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '283b6df7aaf741b284d97004c9026cb2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:39:08.313083 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fd522955-a0d5-4999-a4fd-236fe7d01fea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '283b6df7aaf741b284d97004c9026cb2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:39:08.328809 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1277/2542] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:39:07 2022] DELETE /identity/v3/users/283b6df7aaf741b284d97004c9026cb2 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:39:08.589782 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a743a0-4097-4777-83e7-73063016a82e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:39:08.602533 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a743a0-4097-4777-83e7-73063016a82e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:39:08.667332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20891e9-dc53-45a2-a0e6-808d0bc3e433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:39:08.668033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20891e9-dc53-45a2-a0e6-808d0bc3e433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:08.668315 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20891e9-dc53-45a2-a0e6-808d0bc3e433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:08.668611 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20891e9-dc53-45a2-a0e6-808d0bc3e433 admin admin] PATH_INFO: `/v3/projects/282407d481ac475a973951917ef33851` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:08.669803 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20891e9-dc53-45a2-a0e6-808d0bc3e433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=282407d481ac475a973951917ef33851)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:39:08.671714 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20891e9-dc53-45a2-a0e6-808d0bc3e433 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:39:08.881039 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c20891e9-dc53-45a2-a0e6-808d0bc3e433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '282407d481ac475a973951917ef33851', 'request_id': 'req-c20891e9-dc53-45a2-a0e6-808d0bc3e433'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:39:08.886694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c20891e9-dc53-45a2-a0e6-808d0bc3e433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '282407d481ac475a973951917ef33851', 'request_id': 'req-c20891e9-dc53-45a2-a0e6-808d0bc3e433'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:39:09.061196 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c20891e9-dc53-45a2-a0e6-808d0bc3e433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '282407d481ac475a973951917ef33851', 'request_id': 'req-c20891e9-dc53-45a2-a0e6-808d0bc3e433'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:39:09.073800 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c20891e9-dc53-45a2-a0e6-808d0bc3e433 admin admin] The token cache is being invalidate because project 282407d481ac475a973951917ef33851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:39:09.074092 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c20891e9-dc53-45a2-a0e6-808d0bc3e433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:39:09.074722 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c20891e9-dc53-45a2-a0e6-808d0bc3e433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:39:09.076207 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1266/2543] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:39:08 2022] DELETE /identity/v3/projects/282407d481ac475a973951917ef33851 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:39:09.081745 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3149c9-a1d2-4c6c-a65b-4512954cd386 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:09.082272 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3149c9-a1d2-4c6c-a65b-4512954cd386 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:09.082272 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3149c9-a1d2-4c6c-a65b-4512954cd386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:09.101755 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-2d3149c9-a1d2-4c6c-a65b-4512954cd386 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:39:09.102958 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2d3149c9-a1d2-4c6c-a65b-4512954cd386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:39:09.161234 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1278/2544] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:39:09.170362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c560e3-8f7c-4a6a-8d49-796e54a2a2db None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:09.170759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c560e3-8f7c-4a6a-8d49-796e54a2a2db None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:09.171042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c560e3-8f7c-4a6a-8d49-796e54a2a2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:09.191426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-18c560e3-8f7c-4a6a-8d49-796e54a2a2db None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:39:09.195231 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-18c560e3-8f7c-4a6a-8d49-796e54a2a2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:39:09.200892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1267/2545] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:39:09.206059 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3149c9-a1d2-4c6c-a65b-4512954cd386 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:39:09.215726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3149c9-a1d2-4c6c-a65b-4512954cd386 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:39:09.220243 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc71a9b-10d0-4d4e-b3be-88f419644a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:39:09.220832 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc71a9b-10d0-4d4e-b3be-88f419644a3c admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:09.221131 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc71a9b-10d0-4d4e-b3be-88f419644a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:09.221403 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc71a9b-10d0-4d4e-b3be-88f419644a3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:09.222041 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc71a9b-10d0-4d4e-b3be-88f419644a3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:39:09.222338 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc71a9b-10d0-4d4e-b3be-88f419644a3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:39:09.223924 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc71a9b-10d0-4d4e-b3be-88f419644a3c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:39:09.235829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1279/2546] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:39:09.240672 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c560e3-8f7c-4a6a-8d49-796e54a2a2db None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:39:09.250018 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c560e3-8f7c-4a6a-8d49-796e54a2a2db None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:39:09.255545 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb17a10-a29e-403e-b9e0-fb9c6a84c4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:39:09.256139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb17a10-a29e-403e-b9e0-fb9c6a84c4ab admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:09.256419 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb17a10-a29e-403e-b9e0-fb9c6a84c4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:09.256691 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb17a10-a29e-403e-b9e0-fb9c6a84c4ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:09.257373 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb17a10-a29e-403e-b9e0-fb9c6a84c4ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:39:09.259254 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb17a10-a29e-403e-b9e0-fb9c6a84c4ab admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:39:09.383104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1268/2547] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:39:09 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:39:09.387391 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc71a9b-10d0-4d4e-b3be-88f419644a3c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:39:09.397704 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc71a9b-10d0-4d4e-b3be-88f419644a3c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:39:09.460495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e9340-9f5a-43ef-ab3e-73f7fd5446ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:39:09.461132 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e9340-9f5a-43ef-ab3e-73f7fd5446ec admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:09.461413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e9340-9f5a-43ef-ab3e-73f7fd5446ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:09.461685 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e9340-9f5a-43ef-ab3e-73f7fd5446ec admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:09.462308 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e9340-9f5a-43ef-ab3e-73f7fd5446ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:39:09.464223 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e9340-9f5a-43ef-ab3e-73f7fd5446ec admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:39:09.472210 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:09.558767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1280/2548] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:39:09 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:39:09.565258 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb17a10-a29e-403e-b9e0-fb9c6a84c4ab admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:39:09.574678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb17a10-a29e-403e-b9e0-fb9c6a84c4ab admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:39:09.579866 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390eb7cb-f449-432b-8d4d-dcc6580943e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:39:09.580707 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390eb7cb-f449-432b-8d4d-dcc6580943e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:09.580933 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390eb7cb-f449-432b-8d4d-dcc6580943e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:09.581326 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390eb7cb-f449-432b-8d4d-dcc6580943e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:09.581975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390eb7cb-f449-432b-8d4d-dcc6580943e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:39:09.583607 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390eb7cb-f449-432b-8d4d-dcc6580943e2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:39:09.585146 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:09.594559 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1269/2549] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:39:09.599882 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e9340-9f5a-43ef-ab3e-73f7fd5446ec admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:39:09.610040 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e9340-9f5a-43ef-ab3e-73f7fd5446ec admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:39:09.615219 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef49dc-d3e0-439d-8276-a4c6b31f0f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:39:09.615809 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef49dc-d3e0-439d-8276-a4c6b31f0f62 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:09.616938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef49dc-d3e0-439d-8276-a4c6b31f0f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:09.616938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef49dc-d3e0-439d-8276-a4c6b31f0f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:09.616938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef49dc-d3e0-439d-8276-a4c6b31f0f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:39:09.618660 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef49dc-d3e0-439d-8276-a4c6b31f0f62 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:39:09.630391 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1281/2550] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:39:09.634719 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390eb7cb-f449-432b-8d4d-dcc6580943e2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:39:09.645521 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390eb7cb-f449-432b-8d4d-dcc6580943e2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:39:09.652008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b429fb9-2d27-4869-af2d-72b4db5338b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:39:09.652915 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b429fb9-2d27-4869-af2d-72b4db5338b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:09.653262 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b429fb9-2d27-4869-af2d-72b4db5338b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:09.653545 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b429fb9-2d27-4869-af2d-72b4db5338b5 admin admin] PATH_INFO: `/v3/projects/bac68ec3f1a74f5784509573fb45e906/users/1e78f25687db42f891d5fccdfe2ecf4f/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:09.671235 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b429fb9-2d27-4869-af2d-72b4db5338b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bac68ec3f1a74f5784509573fb45e906, user_id=1e78f25687db42f891d5fccdfe2ecf4f, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:39:09.677441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b429fb9-2d27-4869-af2d-72b4db5338b5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:39:09.724575 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1270/2551] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:39:09 2022] PUT /identity/v3/projects/bac68ec3f1a74f5784509573fb45e906/users/1e78f25687db42f891d5fccdfe2ecf4f/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:39:09.729706 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe1cbd-e0d0-4309-a65f-2e8381d4fbf7 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:09.729997 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe1cbd-e0d0-4309-a65f-2e8381d4fbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:09.730270 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe1cbd-e0d0-4309-a65f-2e8381d4fbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:09.750481 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-79fe1cbd-e0d0-4309-a65f-2e8381d4fbf7 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:39:09.752291 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-79fe1cbd-e0d0-4309-a65f-2e8381d4fbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:39:09.812848 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1282/2552] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:39:09.823327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b429fb9-2d27-4869-af2d-72b4db5338b5 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:39:09.825217 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0b429fb9-2d27-4869-af2d-72b4db5338b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:39:09.893838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b429fb9-2d27-4869-af2d-72b4db5338b5 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:39:09.894819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baad7bc-9066-4406-96a6-a4ec1b478dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:39:09.895436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baad7bc-9066-4406-96a6-a4ec1b478dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:09.895718 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baad7bc-9066-4406-96a6-a4ec1b478dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:09.895991 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baad7bc-9066-4406-96a6-a4ec1b478dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:09.905980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baad7bc-9066-4406-96a6-a4ec1b478dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:39:09.907410 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baad7bc-9066-4406-96a6-a4ec1b478dd0 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:39:09.919813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1271/2553] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:39:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:39:15.208392 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cedf3-8d0b-418c-b457-1b3bafcb0393 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:15.208934 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cedf3-8d0b-418c-b457-1b3bafcb0393 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:15.208934 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cedf3-8d0b-418c-b457-1b3bafcb0393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:15.239355 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-963cedf3-8d0b-418c-b457-1b3bafcb0393 None None] MFA Rules not processed for user `1e78f25687db42f891d5fccdfe2ecf4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:39:15.240576 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-963cedf3-8d0b-418c-b457-1b3bafcb0393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:39:15.318172 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1283/2554] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:39:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:39:15.322806 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baad7bc-9066-4406-96a6-a4ec1b478dd0 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:39:15.333249 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baad7bc-9066-4406-96a6-a4ec1b478dd0 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:39:15.338294 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c0132-fdf5-4082-9b67-774f35a48599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:39:15.338920 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c0132-fdf5-4082-9b67-774f35a48599 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:15.339202 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c0132-fdf5-4082-9b67-774f35a48599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:15.339479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c0132-fdf5-4082-9b67-774f35a48599 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:15.340383 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c0132-fdf5-4082-9b67-774f35a48599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:39:15.342098 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c0132-fdf5-4082-9b67-774f35a48599 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:39:15.434985 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1272/2555] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:39:15 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:39:15.439642 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963cedf3-8d0b-418c-b457-1b3bafcb0393 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:39:15.453411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963cedf3-8d0b-418c-b457-1b3bafcb0393 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:39:15.517306 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d7741-150b-4613-af4e-c96df21baabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:39:15.518702 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d7741-150b-4613-af4e-c96df21baabc admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:15.518984 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d7741-150b-4613-af4e-c96df21baabc admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:15.519256 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d7741-150b-4613-af4e-c96df21baabc admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:15.519902 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d7741-150b-4613-af4e-c96df21baabc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:39:15.521856 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d7741-150b-4613-af4e-c96df21baabc admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:39:15.655952 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:15.666475 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1284/2556] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:39:15 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:39:15.670689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c0132-fdf5-4082-9b67-774f35a48599 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:39:15.682449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c0132-fdf5-4082-9b67-774f35a48599 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:39:15.687921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dca457-c2b6-4481-aebf-66074d0660c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:39:15.688527 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dca457-c2b6-4481-aebf-66074d0660c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:15.688801 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dca457-c2b6-4481-aebf-66074d0660c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:15.689089 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dca457-c2b6-4481-aebf-66074d0660c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:15.690192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dca457-c2b6-4481-aebf-66074d0660c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:39:15.691782 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dca457-c2b6-4481-aebf-66074d0660c0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:39:15.702834 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1273/2557] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:39:15.724638 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d7741-150b-4613-af4e-c96df21baabc admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:39:15.734776 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d7741-150b-4613-af4e-c96df21baabc admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:39:15.740497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce91fc-c9c9-4f21-8ade-e596762b83a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:39:15.741423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce91fc-c9c9-4f21-8ade-e596762b83a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:15.742133 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce91fc-c9c9-4f21-8ade-e596762b83a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:15.742498 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce91fc-c9c9-4f21-8ade-e596762b83a1 admin admin] PATH_INFO: `/v3/projects/341e84919d2445b8b1e182b9b9568926/users/b946124c97ac48688e1b24695cc67eb0/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:15.757252 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce91fc-c9c9-4f21-8ade-e596762b83a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=341e84919d2445b8b1e182b9b9568926, user_id=b946124c97ac48688e1b24695cc67eb0, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:39:15.759937 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce91fc-c9c9-4f21-8ade-e596762b83a1 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:39:15.873169 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1285/2558] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:39:15 2022] PUT /identity/v3/projects/341e84919d2445b8b1e182b9b9568926/users/b946124c97ac48688e1b24695cc67eb0/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:39:15.877176 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dca457-c2b6-4481-aebf-66074d0660c0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:39:15.887800 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dca457-c2b6-4481-aebf-66074d0660c0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:39:15.949509 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1008d9-3458-4499-a671-07b2e56f67d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:39:15.950846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1008d9-3458-4499-a671-07b2e56f67d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:15.950846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1008d9-3458-4499-a671-07b2e56f67d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:15.950846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1008d9-3458-4499-a671-07b2e56f67d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:15.951274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1008d9-3458-4499-a671-07b2e56f67d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:39:15.952873 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1008d9-3458-4499-a671-07b2e56f67d1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:39:15.963561 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1274/2559] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:39:15.967626 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce91fc-c9c9-4f21-8ade-e596762b83a1 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:39:15.978606 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce91fc-c9c9-4f21-8ade-e596762b83a1 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:39:15.983320 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a13bb-b057-4cae-b0b9-516720a0e398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:39:15.983969 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a13bb-b057-4cae-b0b9-516720a0e398 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:15.984249 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a13bb-b057-4cae-b0b9-516720a0e398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:15.984524 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a13bb-b057-4cae-b0b9-516720a0e398 admin admin] PATH_INFO: `/v3/projects/341e84919d2445b8b1e182b9b9568926/users/b946124c97ac48688e1b24695cc67eb0/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:15.987285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a13bb-b057-4cae-b0b9-516720a0e398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=341e84919d2445b8b1e182b9b9568926, user_id=b946124c97ac48688e1b24695cc67eb0, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:39:15.990202 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a13bb-b057-4cae-b0b9-516720a0e398 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:39:16.001128 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1286/2560] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:39:15 2022] PUT /identity/v3/projects/341e84919d2445b8b1e182b9b9568926/users/b946124c97ac48688e1b24695cc67eb0/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:39:21.627589 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f656a7-144e-406a-82b9-ea3fad86f6cd None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:21.628394 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f656a7-144e-406a-82b9-ea3fad86f6cd None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:21.628394 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f656a7-144e-406a-82b9-ea3fad86f6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:21.659876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-28f656a7-144e-406a-82b9-ea3fad86f6cd None None] MFA Rules not processed for user `b946124c97ac48688e1b24695cc67eb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:39:21.661210 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-28f656a7-144e-406a-82b9-ea3fad86f6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:39:21.690670 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:21.757183 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1275/2561] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:39:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:39:21.774307 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a13bb-b057-4cae-b0b9-516720a0e398 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:39:21.776515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-170a13bb-b057-4cae-b0b9-516720a0e398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:39:21.868120 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a13bb-b057-4cae-b0b9-516720a0e398 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:39:21.874896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bba51-465f-4b57-820b-722b3aef9729 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:39:21.876375 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bba51-465f-4b57-820b-722b3aef9729 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:21.876375 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bba51-465f-4b57-820b-722b3aef9729 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:21.876375 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bba51-465f-4b57-820b-722b3aef9729 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:21.943523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477bba51-465f-4b57-820b-722b3aef9729 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:39:21.944888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477bba51-465f-4b57-820b-722b3aef9729 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:39:21.954645 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1287/2562] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:39:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:39:24.728902 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da4994-cea2-4db7-95a3-37604f315768 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:24.729800 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da4994-cea2-4db7-95a3-37604f315768 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:24.730955 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da4994-cea2-4db7-95a3-37604f315768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:24.750606 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b5da4994-cea2-4db7-95a3-37604f315768 None None] MFA Rules not processed for user `1e78f25687db42f891d5fccdfe2ecf4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:39:24.751868 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b5da4994-cea2-4db7-95a3-37604f315768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:39:24.759462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1276/2563] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:39:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:39:31.956435 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:34.745422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=20 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:37.639724 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f015a95-c910-4af0-b3d6-94536fe1f07a None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:37.640214 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f015a95-c910-4af0-b3d6-94536fe1f07a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:37.640313 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f015a95-c910-4af0-b3d6-94536fe1f07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:37.664963 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-9f015a95-c910-4af0-b3d6-94536fe1f07a None None] MFA Rules not processed for user `c74f8acfc15647f4b3606bc46fb16992`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:39:37.666732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9f015a95-c910-4af0-b3d6-94536fe1f07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:39:37.742658 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1288/2564] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:39:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:39:41.283295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da4994-cea2-4db7-95a3-37604f315768 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:39:41.284748 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b5da4994-cea2-4db7-95a3-37604f315768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:39:41.347759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da4994-cea2-4db7-95a3-37604f315768 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:39:41.351510 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2fcb4-970a-477c-9914-34be0db1304f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:39:41.352106 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2fcb4-970a-477c-9914-34be0db1304f service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:41.352388 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2fcb4-970a-477c-9914-34be0db1304f service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:41.352657 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2fcb4-970a-477c-9914-34be0db1304f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:41.354807 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-26a2fcb4-970a-477c-9914-34be0db1304f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:39:41.369918 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2fcb4-970a-477c-9914-34be0db1304f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:39:41.371361 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2fcb4-970a-477c-9914-34be0db1304f service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:39:41.382997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1277/2565] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:39:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:39:41.859380 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f015a95-c910-4af0-b3d6-94536fe1f07a None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:39:41.860889 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9f015a95-c910-4af0-b3d6-94536fe1f07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:39:41.919957 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f015a95-c910-4af0-b3d6-94536fe1f07a None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:39:41.923515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da05a1-b15c-4019-bd2d-d99eaed72158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:39:41.924175 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da05a1-b15c-4019-bd2d-d99eaed72158 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:41.924451 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da05a1-b15c-4019-bd2d-d99eaed72158 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:41.924717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da05a1-b15c-4019-bd2d-d99eaed72158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:41.926468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-02da05a1-b15c-4019-bd2d-d99eaed72158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:39:41.941427 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da05a1-b15c-4019-bd2d-d99eaed72158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:39:41.944015 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da05a1-b15c-4019-bd2d-d99eaed72158 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:39:41.956595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1289/2566] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:39:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:39:51.377854 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=26 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:51.949292 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=51 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:53.245207 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2fcb4-970a-477c-9914-34be0db1304f service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:39:53.246769 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-26a2fcb4-970a-477c-9914-34be0db1304f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:39:53.265217 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2fcb4-970a-477c-9914-34be0db1304f service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:39:53.271531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9b11b-a901-45ec-8117-f814e04320be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:39:53.272335 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9b11b-a901-45ec-8117-f814e04320be service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:53.272782 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9b11b-a901-45ec-8117-f814e04320be service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:53.273296 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9b11b-a901-45ec-8117-f814e04320be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:53.275219 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0ed9b11b-a901-45ec-8117-f814e04320be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:39:53.288228 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9b11b-a901-45ec-8117-f814e04320be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:39:53.290932 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9b11b-a901-45ec-8117-f814e04320be service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:39:53.304220 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1278/2567] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:39:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:39:56.887145 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da05a1-b15c-4019-bd2d-d99eaed72158 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:39:56.898411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da05a1-b15c-4019-bd2d-d99eaed72158 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:39:56.903147 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e3c31-b923-4b66-aacb-c06f8bcf0630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:39:56.904666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e3c31-b923-4b66-aacb-c06f8bcf0630 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:39:56.904666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e3c31-b923-4b66-aacb-c06f8bcf0630 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:39:56.904666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e3c31-b923-4b66-aacb-c06f8bcf0630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:39:56.906830 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5b5e3c31-b923-4b66-aacb-c06f8bcf0630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:39:56.981742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e3c31-b923-4b66-aacb-c06f8bcf0630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:39:56.983335 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e3c31-b923-4b66-aacb-c06f8bcf0630 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:39:56.996445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1290/2568] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:39:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:40:01.596291 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9b11b-a901-45ec-8117-f814e04320be service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:01.606155 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9b11b-a901-45ec-8117-f814e04320be service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:01.610012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7779310-1f4c-4c2f-9fee-6563bd285226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:01.610684 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7779310-1f4c-4c2f-9fee-6563bd285226 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:01.611034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7779310-1f4c-4c2f-9fee-6563bd285226 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:01.611860 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7779310-1f4c-4c2f-9fee-6563bd285226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:01.622396 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7779310-1f4c-4c2f-9fee-6563bd285226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:01.623816 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7779310-1f4c-4c2f-9fee-6563bd285226 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:01.634111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1279/2569] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:40:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:40:05.554652 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524fe7b-a3e8-4e8b-ae04-572b99f31090 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:05.555127 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524fe7b-a3e8-4e8b-ae04-572b99f31090 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:05.555228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524fe7b-a3e8-4e8b-ae04-572b99f31090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:05.575379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-0524fe7b-a3e8-4e8b-ae04-572b99f31090 None None] MFA Rules not processed for user `635e47d0a5a34fdfb5c8967a96a87828`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:40:05.576563 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0524fe7b-a3e8-4e8b-ae04-572b99f31090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:05.632732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1291/2570] 10.222.0.23 () {58 vars in 967 bytes} [Mon Sep 5 14:40:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:40:05.786945 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7779310-1f4c-4c2f-9fee-6563bd285226 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:05.788465 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f7779310-1f4c-4c2f-9fee-6563bd285226 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:05.856517 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7779310-1f4c-4c2f-9fee-6563bd285226 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:05.862247 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db474a-783e-4f65-94c5-8b3401bf633d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed60e9eecb94ef39c2f4a5e5f50d670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:05.863055 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db474a-783e-4f65-94c5-8b3401bf633d service swift] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:05.863428 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db474a-783e-4f65-94c5-8b3401bf633d service swift] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:05.863702 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db474a-783e-4f65-94c5-8b3401bf633d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:05.871618 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db474a-783e-4f65-94c5-8b3401bf633d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:05.873213 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db474a-783e-4f65-94c5-8b3401bf633d service swift] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:05.881034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1280/2571] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 5 14:40:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 14:40:10.663639 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524fe7b-a3e8-4e8b-ae04-572b99f31090 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:10.683833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524fe7b-a3e8-4e8b-ae04-572b99f31090 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:10.689925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d7ee2-e313-444f-8bcf-5e83a3f347f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:10.690607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d7ee2-e313-444f-8bcf-5e83a3f347f1 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:10.691705 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d7ee2-e313-444f-8bcf-5e83a3f347f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:10.691970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d7ee2-e313-444f-8bcf-5e83a3f347f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:10.694815 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c88d7ee2-e313-444f-8bcf-5e83a3f347f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:10.715449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d7ee2-e313-444f-8bcf-5e83a3f347f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:10.718084 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d7ee2-e313-444f-8bcf-5e83a3f347f1 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:10.737274 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1292/2572] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:40:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:40:10.946722 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db474a-783e-4f65-94c5-8b3401bf633d service swift] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:10.953928 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-57db474a-783e-4f65-94c5-8b3401bf633d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:11.060501 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db474a-783e-4f65-94c5-8b3401bf633d service swift] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:11.068530 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56524d-3f79-49d7-9027-fe0ef118e90e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1880dab32fa424a9356b3fe940d4856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:11.068530 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56524d-3f79-49d7-9027-fe0ef118e90e service placement] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:11.068869 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56524d-3f79-49d7-9027-fe0ef118e90e service placement] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:11.069168 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56524d-3f79-49d7-9027-fe0ef118e90e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:11.071827 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3e56524d-3f79-49d7-9027-fe0ef118e90e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:11.086335 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56524d-3f79-49d7-9027-fe0ef118e90e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:11.087956 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56524d-3f79-49d7-9027-fe0ef118e90e service placement] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:11.099201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1281/2573] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:40:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:40:12.641644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d7ee2-e313-444f-8bcf-5e83a3f347f1 service nova] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:12.651697 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d7ee2-e313-444f-8bcf-5e83a3f347f1 service nova] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:12.655831 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526a7ba-3c03-4ece-815a-9104e45ea1e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:12.656564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526a7ba-3c03-4ece-815a-9104e45ea1e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:12.656989 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526a7ba-3c03-4ece-815a-9104e45ea1e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:12.657349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526a7ba-3c03-4ece-815a-9104e45ea1e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:12.659262 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b526a7ba-3c03-4ece-815a-9104e45ea1e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:12.748591 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526a7ba-3c03-4ece-815a-9104e45ea1e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:12.750564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526a7ba-3c03-4ece-815a-9104e45ea1e5 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:12.763579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1293/2574] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:40:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:40:15.609313 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56524d-3f79-49d7-9027-fe0ef118e90e service placement] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:15.610869 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3e56524d-3f79-49d7-9027-fe0ef118e90e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:15.627479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56524d-3f79-49d7-9027-fe0ef118e90e service placement] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:15.633429 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c2c28-c820-4292-8368-d08e5e0c4d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:15.634067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c2c28-c820-4292-8368-d08e5e0c4d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:15.634353 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c2c28-c820-4292-8368-d08e5e0c4d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:15.634632 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c2c28-c820-4292-8368-d08e5e0c4d5e admin admin] PATH_INFO: `/v3/users/45383671ca37408a9be6f17571025bbc` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:15.635786 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c2c28-c820-4292-8368-d08e5e0c4d5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=45383671ca37408a9be6f17571025bbc)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:15.637766 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c2c28-c820-4292-8368-d08e5e0c4d5e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:15.980916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1f5c2c28-c820-4292-8368-d08e5e0c4d5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45383671ca37408a9be6f17571025bbc'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:15.981583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1f5c2c28-c820-4292-8368-d08e5e0c4d5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45383671ca37408a9be6f17571025bbc'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:15.983480 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:16.107224 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1f5c2c28-c820-4292-8368-d08e5e0c4d5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45383671ca37408a9be6f17571025bbc'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:16.121231 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1f5c2c28-c820-4292-8368-d08e5e0c4d5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45383671ca37408a9be6f17571025bbc'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:16.121963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1f5c2c28-c820-4292-8368-d08e5e0c4d5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45383671ca37408a9be6f17571025bbc'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:16.135826 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1282/2575] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:40:15 2022] DELETE /identity/v3/users/45383671ca37408a9be6f17571025bbc => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:40:16.372839 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526a7ba-3c03-4ece-815a-9104e45ea1e5 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:16.395271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526a7ba-3c03-4ece-815a-9104e45ea1e5 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:16.428257 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:16.466852 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba2253-1c85-41f2-8f4c-3ea93b872340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:16.467545 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba2253-1c85-41f2-8f4c-3ea93b872340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:16.467824 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba2253-1c85-41f2-8f4c-3ea93b872340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:16.468094 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba2253-1c85-41f2-8f4c-3ea93b872340 admin admin] PATH_INFO: `/v3/projects/f1822c0a9c4441158992038fc41b25ba` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:16.469246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba2253-1c85-41f2-8f4c-3ea93b872340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1822c0a9c4441158992038fc41b25ba)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:16.471159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba2253-1c85-41f2-8f4c-3ea93b872340 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:16.587483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-64ba2253-1c85-41f2-8f4c-3ea93b872340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1822c0a9c4441158992038fc41b25ba', 'request_id': 'req-64ba2253-1c85-41f2-8f4c-3ea93b872340'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:16.592922 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-64ba2253-1c85-41f2-8f4c-3ea93b872340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1822c0a9c4441158992038fc41b25ba', 'request_id': 'req-64ba2253-1c85-41f2-8f4c-3ea93b872340'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:16.697388 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-64ba2253-1c85-41f2-8f4c-3ea93b872340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1822c0a9c4441158992038fc41b25ba', 'request_id': 'req-64ba2253-1c85-41f2-8f4c-3ea93b872340'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:16.713160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-64ba2253-1c85-41f2-8f4c-3ea93b872340 admin admin] The token cache is being invalidate because project f1822c0a9c4441158992038fc41b25ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:40:16.713743 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-64ba2253-1c85-41f2-8f4c-3ea93b872340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:16.714622 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-64ba2253-1c85-41f2-8f4c-3ea93b872340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:16.716572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1294/2576] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:40:16 2022] DELETE /identity/v3/projects/f1822c0a9c4441158992038fc41b25ba => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:40:16.720327 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c2c28-c820-4292-8368-d08e5e0c4d5e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:16.722505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1f5c2c28-c820-4292-8368-d08e5e0c4d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:16.741042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c2c28-c820-4292-8368-d08e5e0c4d5e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:16.812817 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19afc4-7cf5-41e0-a712-56b194fd0365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:16.813604 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19afc4-7cf5-41e0-a712-56b194fd0365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:16.814070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19afc4-7cf5-41e0-a712-56b194fd0365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:16.814414 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19afc4-7cf5-41e0-a712-56b194fd0365 admin admin] PATH_INFO: `/v3/users/b3f4786d42d74013854dd012a4228930` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:16.815782 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19afc4-7cf5-41e0-a712-56b194fd0365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f4786d42d74013854dd012a4228930)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:16.818334 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19afc4-7cf5-41e0-a712-56b194fd0365 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:17.023521 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1d19afc4-7cf5-41e0-a712-56b194fd0365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f4786d42d74013854dd012a4228930'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:17.024529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1d19afc4-7cf5-41e0-a712-56b194fd0365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f4786d42d74013854dd012a4228930'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:17.107693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1d19afc4-7cf5-41e0-a712-56b194fd0365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f4786d42d74013854dd012a4228930'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:17.124754 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1d19afc4-7cf5-41e0-a712-56b194fd0365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f4786d42d74013854dd012a4228930'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:17.125625 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1d19afc4-7cf5-41e0-a712-56b194fd0365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f4786d42d74013854dd012a4228930'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:17.145167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1283/2577] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:40:16 2022] DELETE /identity/v3/users/b3f4786d42d74013854dd012a4228930 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:40:17.387882 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba2253-1c85-41f2-8f4c-3ea93b872340 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:17.389389 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-64ba2253-1c85-41f2-8f4c-3ea93b872340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:17.405498 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba2253-1c85-41f2-8f4c-3ea93b872340 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:17.471666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6db0f-f265-44b2-9b4e-7064d5241f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:17.473225 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6db0f-f265-44b2-9b4e-7064d5241f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:17.473517 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6db0f-f265-44b2-9b4e-7064d5241f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:17.473787 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6db0f-f265-44b2-9b4e-7064d5241f64 admin admin] PATH_INFO: `/v3/users/0a11601da6724a97b4f5acc5b06b2811` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:17.474969 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6db0f-f265-44b2-9b4e-7064d5241f64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a11601da6724a97b4f5acc5b06b2811)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:17.477216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6db0f-f265-44b2-9b4e-7064d5241f64 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:17.680901 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-aff6db0f-f265-44b2-9b4e-7064d5241f64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a11601da6724a97b4f5acc5b06b2811'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:17.705383 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19afc4-7cf5-41e0-a712-56b194fd0365 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:17.707837 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1d19afc4-7cf5-41e0-a712-56b194fd0365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:17.721375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19afc4-7cf5-41e0-a712-56b194fd0365 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:17.737016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9a1d2-3b87-409c-8498-4798ee7cdfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:17.737859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9a1d2-3b87-409c-8498-4798ee7cdfbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:17.738323 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9a1d2-3b87-409c-8498-4798ee7cdfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:17.738608 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9a1d2-3b87-409c-8498-4798ee7cdfbc admin admin] PATH_INFO: `/v3/projects/93eefb29fde94a62b196c92b4c6a8712` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:17.739753 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9a1d2-3b87-409c-8498-4798ee7cdfbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=93eefb29fde94a62b196c92b4c6a8712)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:17.741731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9a1d2-3b87-409c-8498-4798ee7cdfbc admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:17.747374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-aff6db0f-f265-44b2-9b4e-7064d5241f64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a11601da6724a97b4f5acc5b06b2811'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:17.749727 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:17.761199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-aff6db0f-f265-44b2-9b4e-7064d5241f64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a11601da6724a97b4f5acc5b06b2811'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:17.761892 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-aff6db0f-f265-44b2-9b4e-7064d5241f64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a11601da6724a97b4f5acc5b06b2811'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:17.769540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-aff6db0f-f265-44b2-9b4e-7064d5241f64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a11601da6724a97b4f5acc5b06b2811'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:17.775957 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1295/2578] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:40:17 2022] DELETE /identity/v3/users/0a11601da6724a97b4f5acc5b06b2811 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:40:17.901584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:INSERT=2,keystone:DELETE=16,keystone:SELECT=82 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:17.908939 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-80c9a1d2-3b87-409c-8498-4798ee7cdfbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93eefb29fde94a62b196c92b4c6a8712', 'request_id': 'req-80c9a1d2-3b87-409c-8498-4798ee7cdfbc'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:17.914431 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-80c9a1d2-3b87-409c-8498-4798ee7cdfbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93eefb29fde94a62b196c92b4c6a8712', 'request_id': 'req-80c9a1d2-3b87-409c-8498-4798ee7cdfbc'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:18.073392 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-80c9a1d2-3b87-409c-8498-4798ee7cdfbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93eefb29fde94a62b196c92b4c6a8712', 'request_id': 'req-80c9a1d2-3b87-409c-8498-4798ee7cdfbc'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:18.086728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-80c9a1d2-3b87-409c-8498-4798ee7cdfbc admin admin] The token cache is being invalidate because project 93eefb29fde94a62b196c92b4c6a8712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:40:18.087011 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-80c9a1d2-3b87-409c-8498-4798ee7cdfbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:18.087921 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-80c9a1d2-3b87-409c-8498-4798ee7cdfbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:18.094601 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1284/2579] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:40:17 2022] DELETE /identity/v3/projects/93eefb29fde94a62b196c92b4c6a8712 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:40:18.116790 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6db0f-f265-44b2-9b4e-7064d5241f64 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:18.117993 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-aff6db0f-f265-44b2-9b4e-7064d5241f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:18.202268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6db0f-f265-44b2-9b4e-7064d5241f64 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:18.266066 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2bbbe-ac74-4d84-9dd4-c0208aaf95da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:18.266716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2bbbe-ac74-4d84-9dd4-c0208aaf95da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:18.266996 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2bbbe-ac74-4d84-9dd4-c0208aaf95da admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:18.267416 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2bbbe-ac74-4d84-9dd4-c0208aaf95da admin admin] PATH_INFO: `/v3/projects/6f2580d8a63c40a38b4292bfae0faf61` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:18.268576 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2bbbe-ac74-4d84-9dd4-c0208aaf95da admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f2580d8a63c40a38b4292bfae0faf61)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:18.271290 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2bbbe-ac74-4d84-9dd4-c0208aaf95da admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:18.392036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1fc2bbbe-ac74-4d84-9dd4-c0208aaf95da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f2580d8a63c40a38b4292bfae0faf61', 'request_id': 'req-1fc2bbbe-ac74-4d84-9dd4-c0208aaf95da'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:18.397694 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1fc2bbbe-ac74-4d84-9dd4-c0208aaf95da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f2580d8a63c40a38b4292bfae0faf61', 'request_id': 'req-1fc2bbbe-ac74-4d84-9dd4-c0208aaf95da'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:18.468746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1fc2bbbe-ac74-4d84-9dd4-c0208aaf95da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f2580d8a63c40a38b4292bfae0faf61', 'request_id': 'req-1fc2bbbe-ac74-4d84-9dd4-c0208aaf95da'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:18.485930 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1fc2bbbe-ac74-4d84-9dd4-c0208aaf95da admin admin] The token cache is being invalidate because project 6f2580d8a63c40a38b4292bfae0faf61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:40:18.486216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1fc2bbbe-ac74-4d84-9dd4-c0208aaf95da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:18.486872 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1fc2bbbe-ac74-4d84-9dd4-c0208aaf95da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:18.489480 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1296/2580] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:40:18 2022] DELETE /identity/v3/projects/6f2580d8a63c40a38b4292bfae0faf61 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:40:18.494813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777b5e7-ba1e-4264-8c31-63d7d733e4dd None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:18.495172 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777b5e7-ba1e-4264-8c31-63d7d733e4dd None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:18.495450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777b5e7-ba1e-4264-8c31-63d7d733e4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:18.515414 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e777b5e7-ba1e-4264-8c31-63d7d733e4dd None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:40:18.516602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e777b5e7-ba1e-4264-8c31-63d7d733e4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:18.584385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1285/2581] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:40:18.592356 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe3013-3c11-4bed-a7a9-eb314c01d714 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:18.592636 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe3013-3c11-4bed-a7a9-eb314c01d714 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:18.592906 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe3013-3c11-4bed-a7a9-eb314c01d714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:18.625639 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-dcbe3013-3c11-4bed-a7a9-eb314c01d714 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:40:18.627179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-dcbe3013-3c11-4bed-a7a9-eb314c01d714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:18.636378 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1297/2582] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:40:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:40:18.640727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777b5e7-ba1e-4264-8c31-63d7d733e4dd None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:18.652829 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777b5e7-ba1e-4264-8c31-63d7d733e4dd None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:18.658259 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5df396-6cec-4461-a13b-64e56c7a43f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:18.659053 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5df396-6cec-4461-a13b-64e56c7a43f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:18.660199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5df396-6cec-4461-a13b-64e56c7a43f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:18.660510 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5df396-6cec-4461-a13b-64e56c7a43f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:18.661192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5df396-6cec-4461-a13b-64e56c7a43f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:40:18.661499 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5df396-6cec-4461-a13b-64e56c7a43f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:18.663158 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5df396-6cec-4461-a13b-64e56c7a43f6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:18.676762 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1286/2583] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:40:18.681142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe3013-3c11-4bed-a7a9-eb314c01d714 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:18.686771 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:18.690972 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe3013-3c11-4bed-a7a9-eb314c01d714 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:18.698147 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eaf39a-1568-4c43-8423-042e290fc1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:18.698900 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eaf39a-1568-4c43-8423-042e290fc1d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:18.699182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eaf39a-1568-4c43-8423-042e290fc1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:18.699456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eaf39a-1568-4c43-8423-042e290fc1d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:18.700319 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eaf39a-1568-4c43-8423-042e290fc1d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:18.702353 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eaf39a-1568-4c43-8423-042e290fc1d0 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:18.795678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1298/2584] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:40:18 2022] POST /identity/v3/projects => generated 389 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:40:18.800823 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5df396-6cec-4461-a13b-64e56c7a43f6 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:18.812831 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5df396-6cec-4461-a13b-64e56c7a43f6 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:18.891627 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cae8f8-04c2-4e61-b44b-0428776ed34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:18.892235 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cae8f8-04c2-4e61-b44b-0428776ed34a admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:18.892514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cae8f8-04c2-4e61-b44b-0428776ed34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:18.892789 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cae8f8-04c2-4e61-b44b-0428776ed34a admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:18.893437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cae8f8-04c2-4e61-b44b-0428776ed34a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:18.896021 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cae8f8-04c2-4e61-b44b-0428776ed34a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:18.977599 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1287/2585] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:40:18 2022] POST /identity/v3/users => generated 295 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:40:18.981516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eaf39a-1568-4c43-8423-042e290fc1d0 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:18.992207 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eaf39a-1568-4c43-8423-042e290fc1d0 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:18.997669 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef18efb-04c8-458a-bffe-f266262fe6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:18.997669 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef18efb-04c8-458a-bffe-f266262fe6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:18.997889 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef18efb-04c8-458a-bffe-f266262fe6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:18.998003 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef18efb-04c8-458a-bffe-f266262fe6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:18.998613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef18efb-04c8-458a-bffe-f266262fe6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:19.000208 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef18efb-04c8-458a-bffe-f266262fe6a1 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:19.010744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1299/2586] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:40:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:40:19.014878 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cae8f8-04c2-4e61-b44b-0428776ed34a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:19.025935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cae8f8-04c2-4e61-b44b-0428776ed34a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:19.033150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb539e-f2e4-4f81-80d1-b1ad09fc0c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:19.033759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb539e-f2e4-4f81-80d1-b1ad09fc0c9d admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:19.034040 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb539e-f2e4-4f81-80d1-b1ad09fc0c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:19.034363 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb539e-f2e4-4f81-80d1-b1ad09fc0c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:19.035159 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb539e-f2e4-4f81-80d1-b1ad09fc0c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:19.036771 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb539e-f2e4-4f81-80d1-b1ad09fc0c9d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:19.047952 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1288/2587] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:40:19.054927 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef18efb-04c8-458a-bffe-f266262fe6a1 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:19.065202 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef18efb-04c8-458a-bffe-f266262fe6a1 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:19.070625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185bb59-4317-4aca-9be6-23c8b2c7b1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:19.071259 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185bb59-4317-4aca-9be6-23c8b2c7b1d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:19.071537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185bb59-4317-4aca-9be6-23c8b2c7b1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:19.071810 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185bb59-4317-4aca-9be6-23c8b2c7b1d1 admin admin] PATH_INFO: `/v3/projects/68e59b07ad6d42d7a201c7f14a3ffcac/users/fce888a3a8f24ee8a10e32b030bbd56b/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:19.087653 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185bb59-4317-4aca-9be6-23c8b2c7b1d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e59b07ad6d42d7a201c7f14a3ffcac, user_id=fce888a3a8f24ee8a10e32b030bbd56b, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:19.090366 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185bb59-4317-4aca-9be6-23c8b2c7b1d1 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:19.163926 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1300/2588] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:40:19 2022] PUT /identity/v3/projects/68e59b07ad6d42d7a201c7f14a3ffcac/users/fce888a3a8f24ee8a10e32b030bbd56b/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:40:19.168916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e8289-51af-4cbc-a9fe-4edf48aa0a5b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:19.169234 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e8289-51af-4cbc-a9fe-4edf48aa0a5b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:19.169509 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e8289-51af-4cbc-a9fe-4edf48aa0a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:19.187962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-122e8289-51af-4cbc-a9fe-4edf48aa0a5b None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:40:19.189170 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-122e8289-51af-4cbc-a9fe-4edf48aa0a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:19.218809 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:19.248829 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1289/2589] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:40:19.259584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185bb59-4317-4aca-9be6-23c8b2c7b1d1 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:19.261356 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2185bb59-4317-4aca-9be6-23c8b2c7b1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:19.319884 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185bb59-4317-4aca-9be6-23c8b2c7b1d1 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:19.323579 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f4cf4-afa2-481d-a436-ffbb37f2eb3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:19.324193 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f4cf4-afa2-481d-a436-ffbb37f2eb3b service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:19.324475 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f4cf4-afa2-481d-a436-ffbb37f2eb3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:19.324749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f4cf4-afa2-481d-a436-ffbb37f2eb3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:19.335459 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f4cf4-afa2-481d-a436-ffbb37f2eb3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:19.336915 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f4cf4-afa2-481d-a436-ffbb37f2eb3b service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:19.346483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1301/2590] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:40:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:40:25.261178 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938d3a1-6abe-46fd-b696-c1358089f038 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:25.261714 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938d3a1-6abe-46fd-b696-c1358089f038 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:25.261714 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938d3a1-6abe-46fd-b696-c1358089f038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:25.301230 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e938d3a1-6abe-46fd-b696-c1358089f038 None None] MFA Rules not processed for user `fce888a3a8f24ee8a10e32b030bbd56b`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:40:25.303019 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e938d3a1-6abe-46fd-b696-c1358089f038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:25.390253 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1290/2591] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:40:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:40:25.406718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f4cf4-afa2-481d-a436-ffbb37f2eb3b service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:25.408150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b14f4cf4-afa2-481d-a436-ffbb37f2eb3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:25.500979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f4cf4-afa2-481d-a436-ffbb37f2eb3b service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:25.506959 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8c3b3-287c-4aff-a332-f06cf4fac85b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:25.507575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8c3b3-287c-4aff-a332-f06cf4fac85b service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:25.508033 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8c3b3-287c-4aff-a332-f06cf4fac85b service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:25.508311 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8c3b3-287c-4aff-a332-f06cf4fac85b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:25.517297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8c3b3-287c-4aff-a332-f06cf4fac85b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:25.519569 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8c3b3-287c-4aff-a332-f06cf4fac85b service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:25.529194 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1302/2592] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:40:25 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:40:27.927704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914e8eb-d1d5-4775-b24f-7aec254dfecf None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:27.928260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914e8eb-d1d5-4775-b24f-7aec254dfecf None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:27.928361 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914e8eb-d1d5-4775-b24f-7aec254dfecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:27.950240 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3914e8eb-d1d5-4775-b24f-7aec254dfecf None None] MFA Rules not processed for user `fce888a3a8f24ee8a10e32b030bbd56b`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:40:27.951464 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3914e8eb-d1d5-4775-b24f-7aec254dfecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:27.959021 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1291/2593] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:40:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:40:28.365676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8c3b3-287c-4aff-a332-f06cf4fac85b service nova] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:28.367150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-44d8c3b3-287c-4aff-a332-f06cf4fac85b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:28.380064 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8c3b3-287c-4aff-a332-f06cf4fac85b service nova] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:28.386550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d54c0b-039b-4db4-b17d-55efb49732d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:28.386550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d54c0b-039b-4db4-b17d-55efb49732d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:28.386550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d54c0b-039b-4db4-b17d-55efb49732d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:28.386550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d54c0b-039b-4db4-b17d-55efb49732d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:28.386966 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f7d54c0b-039b-4db4-b17d-55efb49732d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:28.399561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d54c0b-039b-4db4-b17d-55efb49732d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:28.401033 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d54c0b-039b-4db4-b17d-55efb49732d9 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:28.410737 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1303/2594] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:40:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:40:28.864059 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914e8eb-d1d5-4775-b24f-7aec254dfecf None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:28.866444 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3914e8eb-d1d5-4775-b24f-7aec254dfecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:28.977738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914e8eb-d1d5-4775-b24f-7aec254dfecf None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:28.984357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150aba6-3f9f-4bfd-aa4b-1d3070f3596d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1880dab32fa424a9356b3fe940d4856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:28.985832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150aba6-3f9f-4bfd-aa4b-1d3070f3596d service placement] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:28.986605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150aba6-3f9f-4bfd-aa4b-1d3070f3596d service placement] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:28.987311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150aba6-3f9f-4bfd-aa4b-1d3070f3596d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:28.990845 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3150aba6-3f9f-4bfd-aa4b-1d3070f3596d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:29.007317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150aba6-3f9f-4bfd-aa4b-1d3070f3596d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:29.008179 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150aba6-3f9f-4bfd-aa4b-1d3070f3596d service placement] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:29.022961 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1292/2595] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:40:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:40:33.063044 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d54c0b-039b-4db4-b17d-55efb49732d9 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:33.072752 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d54c0b-039b-4db4-b17d-55efb49732d9 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:33.076511 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed92d52-77f6-4579-9710-8e4cbfe6e7ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:33.077182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed92d52-77f6-4579-9710-8e4cbfe6e7ad service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:33.077465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed92d52-77f6-4579-9710-8e4cbfe6e7ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:33.077732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed92d52-77f6-4579-9710-8e4cbfe6e7ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:33.079597 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9ed92d52-77f6-4579-9710-8e4cbfe6e7ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:33.089712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed92d52-77f6-4579-9710-8e4cbfe6e7ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:33.091144 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed92d52-77f6-4579-9710-8e4cbfe6e7ad service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:33.100157 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1304/2596] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:40:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:40:39.018429 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=79 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:39.124620 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150aba6-3f9f-4bfd-aa4b-1d3070f3596d service placement] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:39.137706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150aba6-3f9f-4bfd-aa4b-1d3070f3596d service placement] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:39.143209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442e9d5-bb78-4994-ac5f-4f24922de663 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:39.144365 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442e9d5-bb78-4994-ac5f-4f24922de663 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:39.144865 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442e9d5-bb78-4994-ac5f-4f24922de663 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:39.145367 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442e9d5-bb78-4994-ac5f-4f24922de663 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:39.147441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6442e9d5-bb78-4994-ac5f-4f24922de663 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:39.161097 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442e9d5-bb78-4994-ac5f-4f24922de663 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:39.162748 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442e9d5-bb78-4994-ac5f-4f24922de663 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:39.173714 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1293/2597] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:40:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:40:43.095796 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=94,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:44.671048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed92d52-77f6-4579-9710-8e4cbfe6e7ad service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:44.673482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9ed92d52-77f6-4579-9710-8e4cbfe6e7ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:44.691988 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed92d52-77f6-4579-9710-8e4cbfe6e7ad service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:44.702587 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b4430-d5e4-48b6-8027-13818a142b8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:44.708449 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b4430-d5e4-48b6-8027-13818a142b8d service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:44.708849 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b4430-d5e4-48b6-8027-13818a142b8d service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:44.709160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b4430-d5e4-48b6-8027-13818a142b8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:44.711279 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d51b4430-d5e4-48b6-8027-13818a142b8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:44.725616 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b4430-d5e4-48b6-8027-13818a142b8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:44.727287 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b4430-d5e4-48b6-8027-13818a142b8d service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:44.742983 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1305/2598] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:40:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:40:49.169086 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=6 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:51.558111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442e9d5-bb78-4994-ac5f-4f24922de663 service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:51.569662 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442e9d5-bb78-4994-ac5f-4f24922de663 service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:51.573818 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108f805-cfd7-49f5-89a9-2e07d4f83d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:51.574415 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108f805-cfd7-49f5-89a9-2e07d4f83d7f service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:51.574718 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108f805-cfd7-49f5-89a9-2e07d4f83d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:51.575010 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108f805-cfd7-49f5-89a9-2e07d4f83d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:51.576803 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9108f805-cfd7-49f5-89a9-2e07d4f83d7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:51.591795 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108f805-cfd7-49f5-89a9-2e07d4f83d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:51.593276 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108f805-cfd7-49f5-89a9-2e07d4f83d7f service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:51.605545 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1294/2599] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:40:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:40:54.735737 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=6 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:55.250555 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b4430-d5e4-48b6-8027-13818a142b8d service nova] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:55.252166 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d51b4430-d5e4-48b6-8027-13818a142b8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:55.272382 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b4430-d5e4-48b6-8027-13818a142b8d service nova] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:55.277573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f675ae-e987-4248-a307-3a5ad66137d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1880dab32fa424a9356b3fe940d4856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:55.278393 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f675ae-e987-4248-a307-3a5ad66137d9 service placement] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:55.278972 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f675ae-e987-4248-a307-3a5ad66137d9 service placement] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:55.279102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f675ae-e987-4248-a307-3a5ad66137d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:55.281338 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-90f675ae-e987-4248-a307-3a5ad66137d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:55.295482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f675ae-e987-4248-a307-3a5ad66137d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:55.297114 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f675ae-e987-4248-a307-3a5ad66137d9 service placement] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:55.307377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1306/2600] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:40:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:40:55.411983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108f805-cfd7-49f5-89a9-2e07d4f83d7f service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:55.415615 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9108f805-cfd7-49f5-89a9-2e07d4f83d7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:55.426060 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108f805-cfd7-49f5-89a9-2e07d4f83d7f service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:55.430814 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6bcbc-d114-4b2a-9ea4-c0e4ae3ed403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:55.431437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6bcbc-d114-4b2a-9ea4-c0e4ae3ed403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:55.431714 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6bcbc-d114-4b2a-9ea4-c0e4ae3ed403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:55.431987 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6bcbc-d114-4b2a-9ea4-c0e4ae3ed403 admin admin] PATH_INFO: `/v3/users/c74f8acfc15647f4b3606bc46fb16992` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:55.433128 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6bcbc-d114-4b2a-9ea4-c0e4ae3ed403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c74f8acfc15647f4b3606bc46fb16992)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:55.435046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6bcbc-d114-4b2a-9ea4-c0e4ae3ed403 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:55.630988 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-74d6bcbc-d114-4b2a-9ea4-c0e4ae3ed403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c74f8acfc15647f4b3606bc46fb16992'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:55.631805 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-74d6bcbc-d114-4b2a-9ea4-c0e4ae3ed403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c74f8acfc15647f4b3606bc46fb16992'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:55.706230 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-74d6bcbc-d114-4b2a-9ea4-c0e4ae3ed403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c74f8acfc15647f4b3606bc46fb16992'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:55.719093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-74d6bcbc-d114-4b2a-9ea4-c0e4ae3ed403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c74f8acfc15647f4b3606bc46fb16992'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:55.725317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-74d6bcbc-d114-4b2a-9ea4-c0e4ae3ed403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c74f8acfc15647f4b3606bc46fb16992'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:55.732746 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1295/2601] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:40:55 2022] DELETE /identity/v3/users/c74f8acfc15647f4b3606bc46fb16992 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:40:55.978251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f675ae-e987-4248-a307-3a5ad66137d9 service placement] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:55.990509 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f675ae-e987-4248-a307-3a5ad66137d9 service placement] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:56.049246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e9d2b-0b43-4c72-afee-0ade82a75100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:56.051282 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e9d2b-0b43-4c72-afee-0ade82a75100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:56.051282 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e9d2b-0b43-4c72-afee-0ade82a75100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:56.051282 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e9d2b-0b43-4c72-afee-0ade82a75100 admin admin] PATH_INFO: `/v3/projects/6490692b9e024e09ad2e5ffb0bc0707a` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:56.052160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e9d2b-0b43-4c72-afee-0ade82a75100 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6490692b9e024e09ad2e5ffb0bc0707a)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:56.054112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e9d2b-0b43-4c72-afee-0ade82a75100 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:56.174223 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-ec2e9d2b-0b43-4c72-afee-0ade82a75100 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6490692b9e024e09ad2e5ffb0bc0707a', 'request_id': 'req-ec2e9d2b-0b43-4c72-afee-0ade82a75100'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:56.180044 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-ec2e9d2b-0b43-4c72-afee-0ade82a75100 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6490692b9e024e09ad2e5ffb0bc0707a', 'request_id': 'req-ec2e9d2b-0b43-4c72-afee-0ade82a75100'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:56.273352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-ec2e9d2b-0b43-4c72-afee-0ade82a75100 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6490692b9e024e09ad2e5ffb0bc0707a', 'request_id': 'req-ec2e9d2b-0b43-4c72-afee-0ade82a75100'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:56.292202 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-ec2e9d2b-0b43-4c72-afee-0ade82a75100 admin admin] The token cache is being invalidate because project 6490692b9e024e09ad2e5ffb0bc0707a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:40:56.292202 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-ec2e9d2b-0b43-4c72-afee-0ade82a75100 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:56.292677 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-ec2e9d2b-0b43-4c72-afee-0ade82a75100 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:40:56.294580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1307/2602] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:40:55 2022] DELETE /identity/v3/projects/6490692b9e024e09ad2e5ffb0bc0707a => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:40:56.299564 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5635f45-ed2f-49f9-93a2-d5854d007b2b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:56.300796 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5635f45-ed2f-49f9-93a2-d5854d007b2b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:56.301247 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5635f45-ed2f-49f9-93a2-d5854d007b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:56.329759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f5635f45-ed2f-49f9-93a2-d5854d007b2b None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:40:56.331341 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f5635f45-ed2f-49f9-93a2-d5854d007b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:56.401231 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1296/2603] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:40:56.409205 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32157d5-6ae8-4bca-ad37-20d38c40de20 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:56.409492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32157d5-6ae8-4bca-ad37-20d38c40de20 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:56.409764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32157d5-6ae8-4bca-ad37-20d38c40de20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:56.432265 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d32157d5-6ae8-4bca-ad37-20d38c40de20 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:40:56.433551 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d32157d5-6ae8-4bca-ad37-20d38c40de20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:56.441966 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1308/2604] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:40:56.448310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5635f45-ed2f-49f9-93a2-d5854d007b2b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:56.459887 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5635f45-ed2f-49f9-93a2-d5854d007b2b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:56.464877 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4898f-431e-4ffa-ab91-c4b4f01acb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:56.465519 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4898f-431e-4ffa-ab91-c4b4f01acb93 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:56.465800 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4898f-431e-4ffa-ab91-c4b4f01acb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:56.466070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4898f-431e-4ffa-ab91-c4b4f01acb93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:56.466714 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4898f-431e-4ffa-ab91-c4b4f01acb93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:40:56.467014 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4898f-431e-4ffa-ab91-c4b4f01acb93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:56.468611 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4898f-431e-4ffa-ab91-c4b4f01acb93 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:56.481497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1297/2605] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:40:56.486303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32157d5-6ae8-4bca-ad37-20d38c40de20 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:56.496151 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32157d5-6ae8-4bca-ad37-20d38c40de20 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:56.500946 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32167a1c-9b5f-4bc4-a002-3475cf335017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:56.501573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32167a1c-9b5f-4bc4-a002-3475cf335017 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:56.501852 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32167a1c-9b5f-4bc4-a002-3475cf335017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:56.502127 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32167a1c-9b5f-4bc4-a002-3475cf335017 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:56.502822 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32167a1c-9b5f-4bc4-a002-3475cf335017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:56.506085 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32167a1c-9b5f-4bc4-a002-3475cf335017 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:56.622442 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1309/2606] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:40:56 2022] POST /identity/v3/projects => generated 363 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:40:56.626913 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4898f-431e-4ffa-ab91-c4b4f01acb93 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:56.637756 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4898f-431e-4ffa-ab91-c4b4f01acb93 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:56.685782 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:56.701543 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fea17c-cba7-471d-9731-9a7ae527e99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:56.702155 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fea17c-cba7-471d-9731-9a7ae527e99f admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:56.702439 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fea17c-cba7-471d-9731-9a7ae527e99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:56.702715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fea17c-cba7-471d-9731-9a7ae527e99f admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:56.703366 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fea17c-cba7-471d-9731-9a7ae527e99f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:56.705380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fea17c-cba7-471d-9731-9a7ae527e99f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:56.844910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1298/2607] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:40:56 2022] POST /identity/v3/users => generated 282 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:40:56.849004 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32167a1c-9b5f-4bc4-a002-3475cf335017 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:56.859547 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32167a1c-9b5f-4bc4-a002-3475cf335017 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:56.865728 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef01dac-14b7-46ed-9504-284dbcd25f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:56.866385 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef01dac-14b7-46ed-9504-284dbcd25f81 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:56.866663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef01dac-14b7-46ed-9504-284dbcd25f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:56.866934 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef01dac-14b7-46ed-9504-284dbcd25f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:56.867583 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef01dac-14b7-46ed-9504-284dbcd25f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:56.869271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef01dac-14b7-46ed-9504-284dbcd25f81 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:56.881269 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1310/2608] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:40:56.885350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fea17c-cba7-471d-9731-9a7ae527e99f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:56.895302 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fea17c-cba7-471d-9731-9a7ae527e99f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:56.900054 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b26210-9d6e-40b5-b4e0-1bb4291a6d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:56.900655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b26210-9d6e-40b5-b4e0-1bb4291a6d0c admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:56.900934 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b26210-9d6e-40b5-b4e0-1bb4291a6d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:56.901246 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b26210-9d6e-40b5-b4e0-1bb4291a6d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:56.903155 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b26210-9d6e-40b5-b4e0-1bb4291a6d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:56.905042 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b26210-9d6e-40b5-b4e0-1bb4291a6d0c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:56.919282 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1299/2609] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:40:56.927312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef01dac-14b7-46ed-9504-284dbcd25f81 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:56.937762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef01dac-14b7-46ed-9504-284dbcd25f81 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:56.948599 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687db73c-a5a2-4e0f-9bab-765629676160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:56.949306 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687db73c-a5a2-4e0f-9bab-765629676160 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:56.949586 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687db73c-a5a2-4e0f-9bab-765629676160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:56.949857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687db73c-a5a2-4e0f-9bab-765629676160 admin admin] PATH_INFO: `/v3/projects/3c77f9c983cb4429b6662d79bd0963d7/users/7dc1c4731d39492bb7c55b5652e7f39d/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:56.966829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687db73c-a5a2-4e0f-9bab-765629676160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c77f9c983cb4429b6662d79bd0963d7, user_id=7dc1c4731d39492bb7c55b5652e7f39d, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:56.969748 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687db73c-a5a2-4e0f-9bab-765629676160 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:57.062479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1311/2610] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:40:56 2022] PUT /identity/v3/projects/3c77f9c983cb4429b6662d79bd0963d7/users/7dc1c4731d39492bb7c55b5652e7f39d/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:40:57.074075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034888a-581f-4888-853b-2a7257f0c51f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:57.074362 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034888a-581f-4888-853b-2a7257f0c51f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:57.074643 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034888a-581f-4888-853b-2a7257f0c51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:57.102815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7034888a-581f-4888-853b-2a7257f0c51f None None] MFA Rules not processed for user `7dc1c4731d39492bb7c55b5652e7f39d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:40:57.104030 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7034888a-581f-4888-853b-2a7257f0c51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:57.170173 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1300/2611] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:40:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:40:57.174654 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687db73c-a5a2-4e0f-9bab-765629676160 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:57.194013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:57.241896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687db73c-a5a2-4e0f-9bab-765629676160 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:57.246989 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46089a-6545-4aad-8520-61f89f569f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:57.247601 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46089a-6545-4aad-8520-61f89f569f97 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:57.247885 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46089a-6545-4aad-8520-61f89f569f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:57.248158 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46089a-6545-4aad-8520-61f89f569f97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:57.248797 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46089a-6545-4aad-8520-61f89f569f97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:57.250807 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46089a-6545-4aad-8520-61f89f569f97 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:57.344314 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1312/2612] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:40:57 2022] POST /identity/v3/projects => generated 363 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:40:57.348152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034888a-581f-4888-853b-2a7257f0c51f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:57.359632 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034888a-581f-4888-853b-2a7257f0c51f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:57.419417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5dc4b-727f-4610-b9ea-c92219fb8ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:57.420050 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5dc4b-727f-4610-b9ea-c92219fb8ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:57.420326 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5dc4b-727f-4610-b9ea-c92219fb8ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:57.420594 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5dc4b-727f-4610-b9ea-c92219fb8ad9 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:57.421260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5dc4b-727f-4610-b9ea-c92219fb8ad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:57.423218 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5dc4b-727f-4610-b9ea-c92219fb8ad9 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:57.519802 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1301/2613] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:40:57 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:40:57.524911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46089a-6545-4aad-8520-61f89f569f97 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:57.541327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46089a-6545-4aad-8520-61f89f569f97 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:57.546108 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137a8d2-ed7b-4589-93dc-39da4c29df16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:57.546712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137a8d2-ed7b-4589-93dc-39da4c29df16 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:57.547095 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137a8d2-ed7b-4589-93dc-39da4c29df16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:57.547272 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137a8d2-ed7b-4589-93dc-39da4c29df16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:57.547886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137a8d2-ed7b-4589-93dc-39da4c29df16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:57.549542 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3137a8d2-ed7b-4589-93dc-39da4c29df16 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:57.561026 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1313/2614] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:40:57.565364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5dc4b-727f-4610-b9ea-c92219fb8ad9 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:57.576713 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5dc4b-727f-4610-b9ea-c92219fb8ad9 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:57.581541 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04746c1-bfd2-4363-b167-63b9193723f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:57.582212 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04746c1-bfd2-4363-b167-63b9193723f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:57.582524 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04746c1-bfd2-4363-b167-63b9193723f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:57.582792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04746c1-bfd2-4363-b167-63b9193723f6 admin admin] PATH_INFO: `/v3/projects/22d79cb7d57c495c94f97751dc3d7a8d/users/3d61823247544a269c262a057654eabf/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:57.600451 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04746c1-bfd2-4363-b167-63b9193723f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22d79cb7d57c495c94f97751dc3d7a8d, user_id=3d61823247544a269c262a057654eabf, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:57.603037 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04746c1-bfd2-4363-b167-63b9193723f6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:57.697140 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1302/2615] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:40:57 2022] PUT /identity/v3/projects/22d79cb7d57c495c94f97751dc3d7a8d/users/3d61823247544a269c262a057654eabf/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:40:57.701435 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137a8d2-ed7b-4589-93dc-39da4c29df16 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:57.712873 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137a8d2-ed7b-4589-93dc-39da4c29df16 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:57.771260 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb69e4-1106-4eca-8ee0-ff1d1b310a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:57.772474 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb69e4-1106-4eca-8ee0-ff1d1b310a65 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:57.772961 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb69e4-1106-4eca-8ee0-ff1d1b310a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:57.773422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb69e4-1106-4eca-8ee0-ff1d1b310a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:57.774068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb69e4-1106-4eca-8ee0-ff1d1b310a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:57.775662 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb69e4-1106-4eca-8ee0-ff1d1b310a65 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:57.787012 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1314/2616] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:40:57.791865 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04746c1-bfd2-4363-b167-63b9193723f6 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:57.802357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04746c1-bfd2-4363-b167-63b9193723f6 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:57.807022 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06611b5-0df9-45c2-8260-1721715308c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:57.807678 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06611b5-0df9-45c2-8260-1721715308c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:57.807957 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06611b5-0df9-45c2-8260-1721715308c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:57.808232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06611b5-0df9-45c2-8260-1721715308c8 admin admin] PATH_INFO: `/v3/projects/22d79cb7d57c495c94f97751dc3d7a8d/users/3d61823247544a269c262a057654eabf/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:57.810223 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06611b5-0df9-45c2-8260-1721715308c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22d79cb7d57c495c94f97751dc3d7a8d, user_id=3d61823247544a269c262a057654eabf, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:57.812911 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06611b5-0df9-45c2-8260-1721715308c8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:57.824055 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1303/2617] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:40:57 2022] PUT /identity/v3/projects/22d79cb7d57c495c94f97751dc3d7a8d/users/3d61823247544a269c262a057654eabf/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:40:57.836391 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f661b0-77c4-4200-a3c9-3f51a8234fa1 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:57.836742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f661b0-77c4-4200-a3c9-3f51a8234fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:57.839833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f661b0-77c4-4200-a3c9-3f51a8234fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:57.872043 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-84f661b0-77c4-4200-a3c9-3f51a8234fa1 None None] MFA Rules not processed for user `3d61823247544a269c262a057654eabf`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:40:57.872043 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-84f661b0-77c4-4200-a3c9-3f51a8234fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:57.941891 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1315/2618] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:40:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:40:57.954258 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06611b5-0df9-45c2-8260-1721715308c8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:57.955972 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b06611b5-0df9-45c2-8260-1721715308c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:40:57.966505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:58.017689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06611b5-0df9-45c2-8260-1721715308c8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:58.022110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96480327-5bf0-478e-b321-355cb0d3f682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:58.023027 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96480327-5bf0-478e-b321-355cb0d3f682 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:58.023313 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96480327-5bf0-478e-b321-355cb0d3f682 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:58.023594 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96480327-5bf0-478e-b321-355cb0d3f682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:58.034294 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96480327-5bf0-478e-b321-355cb0d3f682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:58.035775 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96480327-5bf0-478e-b321-355cb0d3f682 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:58.046019 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1304/2619] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:40:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:40:58.252381 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f661b0-77c4-4200-a3c9-3f51a8234fa1 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:40:58.262877 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f661b0-77c4-4200-a3c9-3f51a8234fa1 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:40:58.266806 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13f7e3-9eb0-4b7b-9bfd-209ec0d0300d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:40:58.267424 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13f7e3-9eb0-4b7b-9bfd-209ec0d0300d service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:40:58.267698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13f7e3-9eb0-4b7b-9bfd-209ec0d0300d service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:40:58.267966 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13f7e3-9eb0-4b7b-9bfd-209ec0d0300d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:40:58.274285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:58.331612 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13f7e3-9eb0-4b7b-9bfd-209ec0d0300d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:40:58.333080 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13f7e3-9eb0-4b7b-9bfd-209ec0d0300d service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:40:58.342735 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1316/2620] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:40:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:41:07.289404 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96480327-5bf0-478e-b321-355cb0d3f682 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:07.360970 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96480327-5bf0-478e-b321-355cb0d3f682 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:07.372149 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd83a3e-f8bf-4a3c-a3a9-39d0fe5923cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:07.372149 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd83a3e-f8bf-4a3c-a3a9-39d0fe5923cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:07.372149 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd83a3e-f8bf-4a3c-a3a9-39d0fe5923cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:07.372149 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd83a3e-f8bf-4a3c-a3a9-39d0fe5923cc admin admin] PATH_INFO: `/v3/users/7dc1c4731d39492bb7c55b5652e7f39d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:07.372601 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd83a3e-f8bf-4a3c-a3a9-39d0fe5923cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc1c4731d39492bb7c55b5652e7f39d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:07.372601 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd83a3e-f8bf-4a3c-a3a9-39d0fe5923cc admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:07.555734 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3bd83a3e-f8bf-4a3c-a3a9-39d0fe5923cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc1c4731d39492bb7c55b5652e7f39d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:07.556468 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3bd83a3e-f8bf-4a3c-a3a9-39d0fe5923cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc1c4731d39492bb7c55b5652e7f39d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:07.627700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3bd83a3e-f8bf-4a3c-a3a9-39d0fe5923cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc1c4731d39492bb7c55b5652e7f39d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:07.641312 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3bd83a3e-f8bf-4a3c-a3a9-39d0fe5923cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc1c4731d39492bb7c55b5652e7f39d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:07.641981 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3bd83a3e-f8bf-4a3c-a3a9-39d0fe5923cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc1c4731d39492bb7c55b5652e7f39d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:07.658441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1305/2621] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:41:07 2022] DELETE /identity/v3/users/7dc1c4731d39492bb7c55b5652e7f39d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:07.663549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3762731-b804-4435-8158-6c42202623df None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:07.664039 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3762731-b804-4435-8158-6c42202623df None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:07.664189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3762731-b804-4435-8158-6c42202623df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:07.684308 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d3762731-b804-4435-8158-6c42202623df None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:41:07.685541 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d3762731-b804-4435-8158-6c42202623df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:07.748947 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1317/2622] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:41:07.761046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd83a3e-f8bf-4a3c-a3a9-39d0fe5923cc admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:07.762510 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3bd83a3e-f8bf-4a3c-a3a9-39d0fe5923cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:07.797117 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:07.824324 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd83a3e-f8bf-4a3c-a3a9-39d0fe5923cc admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:07.828491 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab03de-1662-4773-8978-f4c4322ccfb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:07.829182 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab03de-1662-4773-8978-f4c4322ccfb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:07.829467 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab03de-1662-4773-8978-f4c4322ccfb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:07.829738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab03de-1662-4773-8978-f4c4322ccfb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:07.840179 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab03de-1662-4773-8978-f4c4322ccfb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:07.841681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab03de-1662-4773-8978-f4c4322ccfb3 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:07.851326 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1306/2623] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:41:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:41:08.310390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3762731-b804-4435-8158-6c42202623df None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:08.312070 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d3762731-b804-4435-8158-6c42202623df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:08.326323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3762731-b804-4435-8158-6c42202623df None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:08.334179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4e2db-b1f5-47a3-82f4-a13382ec0b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:08.334782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4e2db-b1f5-47a3-82f4-a13382ec0b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:08.335063 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4e2db-b1f5-47a3-82f4-a13382ec0b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:08.335336 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4e2db-b1f5-47a3-82f4-a13382ec0b63 admin admin] PATH_INFO: `/v3/projects/3c77f9c983cb4429b6662d79bd0963d7` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:08.336618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4e2db-b1f5-47a3-82f4-a13382ec0b63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c77f9c983cb4429b6662d79bd0963d7)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:08.342364 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4e2db-b1f5-47a3-82f4-a13382ec0b63 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:08.465898 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-eaa4e2db-b1f5-47a3-82f4-a13382ec0b63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c77f9c983cb4429b6662d79bd0963d7', 'request_id': 'req-eaa4e2db-b1f5-47a3-82f4-a13382ec0b63'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:08.471805 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-eaa4e2db-b1f5-47a3-82f4-a13382ec0b63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c77f9c983cb4429b6662d79bd0963d7', 'request_id': 'req-eaa4e2db-b1f5-47a3-82f4-a13382ec0b63'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:08.615350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-eaa4e2db-b1f5-47a3-82f4-a13382ec0b63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c77f9c983cb4429b6662d79bd0963d7', 'request_id': 'req-eaa4e2db-b1f5-47a3-82f4-a13382ec0b63'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:08.629004 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-eaa4e2db-b1f5-47a3-82f4-a13382ec0b63 admin admin] The token cache is being invalidate because project 3c77f9c983cb4429b6662d79bd0963d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:41:08.629323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-eaa4e2db-b1f5-47a3-82f4-a13382ec0b63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:08.630005 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-eaa4e2db-b1f5-47a3-82f4-a13382ec0b63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:08.631525 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1318/2624] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:41:08 2022] DELETE /identity/v3/projects/3c77f9c983cb4429b6662d79bd0963d7 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:08.636040 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab03de-1662-4773-8978-f4c4322ccfb3 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:08.646053 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab03de-1662-4773-8978-f4c4322ccfb3 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:08.704313 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2522f-dde3-45c2-b719-25a7bf94949a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:08.704938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2522f-dde3-45c2-b719-25a7bf94949a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:08.705246 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2522f-dde3-45c2-b719-25a7bf94949a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:08.705518 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2522f-dde3-45c2-b719-25a7bf94949a admin admin] PATH_INFO: `/v3/users/3d61823247544a269c262a057654eabf` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:08.706675 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2522f-dde3-45c2-b719-25a7bf94949a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d61823247544a269c262a057654eabf)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:08.708574 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2522f-dde3-45c2-b719-25a7bf94949a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:08.982447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-39e2522f-dde3-45c2-b719-25a7bf94949a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d61823247544a269c262a057654eabf'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:08.983007 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-39e2522f-dde3-45c2-b719-25a7bf94949a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d61823247544a269c262a057654eabf'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:09.123399 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-39e2522f-dde3-45c2-b719-25a7bf94949a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d61823247544a269c262a057654eabf'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:09.139376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-39e2522f-dde3-45c2-b719-25a7bf94949a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d61823247544a269c262a057654eabf'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:09.140144 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-39e2522f-dde3-45c2-b719-25a7bf94949a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d61823247544a269c262a057654eabf'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:09.156173 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1307/2625] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:41:08 2022] DELETE /identity/v3/users/3d61823247544a269c262a057654eabf => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:09.643386 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4e2db-b1f5-47a3-82f4-a13382ec0b63 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:09.644958 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-eaa4e2db-b1f5-47a3-82f4-a13382ec0b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:09.659853 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4e2db-b1f5-47a3-82f4-a13382ec0b63 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:09.702012 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:09.737197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d15731-fa33-42b2-a72f-c19581b95467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:09.737841 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d15731-fa33-42b2-a72f-c19581b95467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:09.738197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d15731-fa33-42b2-a72f-c19581b95467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:09.738467 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d15731-fa33-42b2-a72f-c19581b95467 admin admin] PATH_INFO: `/v3/projects/22d79cb7d57c495c94f97751dc3d7a8d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:09.739744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d15731-fa33-42b2-a72f-c19581b95467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22d79cb7d57c495c94f97751dc3d7a8d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:09.742051 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d15731-fa33-42b2-a72f-c19581b95467 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:09.888906 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d1d15731-fa33-42b2-a72f-c19581b95467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22d79cb7d57c495c94f97751dc3d7a8d', 'request_id': 'req-d1d15731-fa33-42b2-a72f-c19581b95467'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:09.895094 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d1d15731-fa33-42b2-a72f-c19581b95467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22d79cb7d57c495c94f97751dc3d7a8d', 'request_id': 'req-d1d15731-fa33-42b2-a72f-c19581b95467'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:09.998058 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d1d15731-fa33-42b2-a72f-c19581b95467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22d79cb7d57c495c94f97751dc3d7a8d', 'request_id': 'req-d1d15731-fa33-42b2-a72f-c19581b95467'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:10.014120 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d1d15731-fa33-42b2-a72f-c19581b95467 admin admin] The token cache is being invalidate because project 22d79cb7d57c495c94f97751dc3d7a8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:41:10.014463 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d1d15731-fa33-42b2-a72f-c19581b95467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:10.015277 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d1d15731-fa33-42b2-a72f-c19581b95467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:10.016989 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1319/2626] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:41:09 2022] DELETE /identity/v3/projects/22d79cb7d57c495c94f97751dc3d7a8d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:10.026307 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495be1e-b68c-4789-ade7-aef05b39e502 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:10.031131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495be1e-b68c-4789-ade7-aef05b39e502 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:10.031131 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495be1e-b68c-4789-ade7-aef05b39e502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:10.048855 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9495be1e-b68c-4789-ade7-aef05b39e502 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:41:10.051071 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9495be1e-b68c-4789-ade7-aef05b39e502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:10.111570 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:10.132455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1308/2627] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:41:10.141300 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0be505-5258-4aff-9834-66136232154e None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:10.142012 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0be505-5258-4aff-9834-66136232154e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:10.142592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0be505-5258-4aff-9834-66136232154e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:10.163113 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-6f0be505-5258-4aff-9834-66136232154e None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:41:10.165187 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6f0be505-5258-4aff-9834-66136232154e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:10.173311 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1320/2628] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:41:10.178246 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495be1e-b68c-4789-ade7-aef05b39e502 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:10.189236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495be1e-b68c-4789-ade7-aef05b39e502 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:10.197227 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec432593-bd59-4749-95e2-f56572b678c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:10.197227 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec432593-bd59-4749-95e2-f56572b678c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:10.197227 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec432593-bd59-4749-95e2-f56572b678c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:10.197227 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec432593-bd59-4749-95e2-f56572b678c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:10.197694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec432593-bd59-4749-95e2-f56572b678c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:41:10.197694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec432593-bd59-4749-95e2-f56572b678c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:10.198191 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec432593-bd59-4749-95e2-f56572b678c7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:10.212142 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1309/2629] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:41:10.216867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0be505-5258-4aff-9834-66136232154e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:10.228177 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0be505-5258-4aff-9834-66136232154e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:10.233775 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5232a4b-e67c-4bf2-80be-bc8aaf9f6f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:10.234819 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5232a4b-e67c-4bf2-80be-bc8aaf9f6f1e admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:10.234819 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5232a4b-e67c-4bf2-80be-bc8aaf9f6f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:10.235021 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5232a4b-e67c-4bf2-80be-bc8aaf9f6f1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:10.235557 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5232a4b-e67c-4bf2-80be-bc8aaf9f6f1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:10.237733 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5232a4b-e67c-4bf2-80be-bc8aaf9f6f1e admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:10.373704 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1321/2630] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:41:10 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:41:10.377958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec432593-bd59-4749-95e2-f56572b678c7 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:10.390123 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec432593-bd59-4749-95e2-f56572b678c7 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:10.458031 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603e5e6-2361-4457-96f4-236a9b9e79b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:10.458647 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603e5e6-2361-4457-96f4-236a9b9e79b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:10.458930 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603e5e6-2361-4457-96f4-236a9b9e79b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:10.459201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603e5e6-2361-4457-96f4-236a9b9e79b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:10.459858 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603e5e6-2361-4457-96f4-236a9b9e79b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:10.462962 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603e5e6-2361-4457-96f4-236a9b9e79b5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:10.606913 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1310/2631] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:41:10 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:41:10.613483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5232a4b-e67c-4bf2-80be-bc8aaf9f6f1e admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:10.625379 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5232a4b-e67c-4bf2-80be-bc8aaf9f6f1e admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:10.630888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0863e-feee-45f7-8c34-86509cf07203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:10.631489 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0863e-feee-45f7-8c34-86509cf07203 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:10.631770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0863e-feee-45f7-8c34-86509cf07203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:10.632068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0863e-feee-45f7-8c34-86509cf07203 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:10.633321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0863e-feee-45f7-8c34-86509cf07203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:10.634996 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0863e-feee-45f7-8c34-86509cf07203 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:10.645932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1322/2632] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:41:10.653211 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603e5e6-2361-4457-96f4-236a9b9e79b5 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:10.663442 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603e5e6-2361-4457-96f4-236a9b9e79b5 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:10.668636 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0913f-41ca-457a-84da-6b8fc0ee8ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:10.669273 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0913f-41ca-457a-84da-6b8fc0ee8ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:10.669557 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0913f-41ca-457a-84da-6b8fc0ee8ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:10.669830 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0913f-41ca-457a-84da-6b8fc0ee8ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:10.670474 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0913f-41ca-457a-84da-6b8fc0ee8ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:10.672145 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0913f-41ca-457a-84da-6b8fc0ee8ff4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:10.684874 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1311/2633] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:41:10.689991 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0863e-feee-45f7-8c34-86509cf07203 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:10.702566 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0863e-feee-45f7-8c34-86509cf07203 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:10.715908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6de9a-3637-4807-9317-33ae048c62ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:10.715908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6de9a-3637-4807-9317-33ae048c62ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:10.715908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6de9a-3637-4807-9317-33ae048c62ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:10.715908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6de9a-3637-4807-9317-33ae048c62ef admin admin] PATH_INFO: `/v3/projects/8c75405020b543cb828e292df07cb4e2/users/62a93781313f4467be69498b3ce695a4/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:10.734287 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6de9a-3637-4807-9317-33ae048c62ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c75405020b543cb828e292df07cb4e2, user_id=62a93781313f4467be69498b3ce695a4, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:10.737627 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6de9a-3637-4807-9317-33ae048c62ef admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:10.887297 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1323/2634] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:41:10 2022] PUT /identity/v3/projects/8c75405020b543cb828e292df07cb4e2/users/62a93781313f4467be69498b3ce695a4/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:41:10.903082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7bdcd-f5cd-4005-90c6-ef4081190aa8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:10.903467 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7bdcd-f5cd-4005-90c6-ef4081190aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:10.903927 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7bdcd-f5cd-4005-90c6-ef4081190aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:10.938711 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8fb7bdcd-f5cd-4005-90c6-ef4081190aa8 None None] MFA Rules not processed for user `62a93781313f4467be69498b3ce695a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:41:10.940027 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8fb7bdcd-f5cd-4005-90c6-ef4081190aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:11.007626 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1312/2635] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:41:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:41:11.013460 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6de9a-3637-4807-9317-33ae048c62ef admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:11.078578 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:11.082382 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6de9a-3637-4807-9317-33ae048c62ef admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:11.087577 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87857516-b43f-40c5-b360-cfa5ed9ba875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:11.088178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87857516-b43f-40c5-b360-cfa5ed9ba875 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:11.088457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87857516-b43f-40c5-b360-cfa5ed9ba875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:11.093510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87857516-b43f-40c5-b360-cfa5ed9ba875 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:11.093510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87857516-b43f-40c5-b360-cfa5ed9ba875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:11.093510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87857516-b43f-40c5-b360-cfa5ed9ba875 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:11.252439 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1324/2636] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:41:11 2022] POST /identity/v3/projects => generated 377 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:41:11.257632 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7bdcd-f5cd-4005-90c6-ef4081190aa8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:11.268641 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7bdcd-f5cd-4005-90c6-ef4081190aa8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:11.315171 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:11.329703 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cda10d-e20f-4a70-8f7d-edabc79c560c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:11.330389 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cda10d-e20f-4a70-8f7d-edabc79c560c admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:11.330667 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cda10d-e20f-4a70-8f7d-edabc79c560c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:11.330937 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cda10d-e20f-4a70-8f7d-edabc79c560c admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:11.331734 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cda10d-e20f-4a70-8f7d-edabc79c560c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:11.333665 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cda10d-e20f-4a70-8f7d-edabc79c560c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:11.478955 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1313/2637] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:41:11 2022] POST /identity/v3/users => generated 295 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:41:11.483002 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87857516-b43f-40c5-b360-cfa5ed9ba875 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:11.494205 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87857516-b43f-40c5-b360-cfa5ed9ba875 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:11.498698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107c9a8-43ec-4d74-9583-ac9c9a11898b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:11.499292 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107c9a8-43ec-4d74-9583-ac9c9a11898b admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:11.499570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107c9a8-43ec-4d74-9583-ac9c9a11898b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:11.499895 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107c9a8-43ec-4d74-9583-ac9c9a11898b admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:11.500536 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107c9a8-43ec-4d74-9583-ac9c9a11898b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:11.502167 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107c9a8-43ec-4d74-9583-ac9c9a11898b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:11.513627 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1325/2638] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:41:11.518089 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cda10d-e20f-4a70-8f7d-edabc79c560c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:11.529228 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cda10d-e20f-4a70-8f7d-edabc79c560c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:11.534845 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47c0f9-84d1-490c-9006-4a841f3e7a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:11.534845 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47c0f9-84d1-490c-9006-4a841f3e7a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:11.535097 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47c0f9-84d1-490c-9006-4a841f3e7a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:11.535397 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47c0f9-84d1-490c-9006-4a841f3e7a0a admin admin] PATH_INFO: `/v3/projects/f14701f39dda4aaf82381da08f52ab2c/users/f2b3b514127d43858e24c8749692affc/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:11.552143 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47c0f9-84d1-490c-9006-4a841f3e7a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14701f39dda4aaf82381da08f52ab2c, user_id=f2b3b514127d43858e24c8749692affc, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:11.555441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47c0f9-84d1-490c-9006-4a841f3e7a0a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:11.702068 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1314/2639] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:41:11 2022] PUT /identity/v3/projects/f14701f39dda4aaf82381da08f52ab2c/users/f2b3b514127d43858e24c8749692affc/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:11.706148 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107c9a8-43ec-4d74-9583-ac9c9a11898b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:11.722082 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107c9a8-43ec-4d74-9583-ac9c9a11898b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:11.788878 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eca15e-d22a-4a94-bd7a-bc7101eb5c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:11.790300 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eca15e-d22a-4a94-bd7a-bc7101eb5c85 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:11.790577 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eca15e-d22a-4a94-bd7a-bc7101eb5c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:11.790847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eca15e-d22a-4a94-bd7a-bc7101eb5c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:11.791568 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eca15e-d22a-4a94-bd7a-bc7101eb5c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:11.793282 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eca15e-d22a-4a94-bd7a-bc7101eb5c85 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:11.805528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1326/2640] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:41:11.810032 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47c0f9-84d1-490c-9006-4a841f3e7a0a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:11.821528 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47c0f9-84d1-490c-9006-4a841f3e7a0a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:11.826148 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c23a12-97e1-4b01-b8da-f1ec88fe6305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:11.826799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c23a12-97e1-4b01-b8da-f1ec88fe6305 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:11.827075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c23a12-97e1-4b01-b8da-f1ec88fe6305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:11.827345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c23a12-97e1-4b01-b8da-f1ec88fe6305 admin admin] PATH_INFO: `/v3/projects/f14701f39dda4aaf82381da08f52ab2c/users/f2b3b514127d43858e24c8749692affc/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:11.829317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c23a12-97e1-4b01-b8da-f1ec88fe6305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14701f39dda4aaf82381da08f52ab2c, user_id=f2b3b514127d43858e24c8749692affc, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:11.832051 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c23a12-97e1-4b01-b8da-f1ec88fe6305 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:11.843531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1315/2641] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:41:11 2022] PUT /identity/v3/projects/f14701f39dda4aaf82381da08f52ab2c/users/f2b3b514127d43858e24c8749692affc/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:11.856518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b28bd-2014-42eb-8f97-df5fb74cd99f None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:11.856860 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b28bd-2014-42eb-8f97-df5fb74cd99f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:11.857219 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b28bd-2014-42eb-8f97-df5fb74cd99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:11.886878 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-f67b28bd-2014-42eb-8f97-df5fb74cd99f None None] MFA Rules not processed for user `f2b3b514127d43858e24c8749692affc`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:41:11.888162 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f67b28bd-2014-42eb-8f97-df5fb74cd99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:11.963117 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1327/2642] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:41:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:41:11.974467 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c23a12-97e1-4b01-b8da-f1ec88fe6305 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:11.976252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-88c23a12-97e1-4b01-b8da-f1ec88fe6305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:12.036716 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c23a12-97e1-4b01-b8da-f1ec88fe6305 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:12.040999 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ced60-3e88-49b5-9940-7c2938a40381 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:12.041572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ced60-3e88-49b5-9940-7c2938a40381 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:12.041846 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ced60-3e88-49b5-9940-7c2938a40381 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:12.042137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ced60-3e88-49b5-9940-7c2938a40381 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:12.097449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ced60-3e88-49b5-9940-7c2938a40381 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:12.098885 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ced60-3e88-49b5-9940-7c2938a40381 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:12.108478 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1316/2643] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:41:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:41:15.565890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b28bd-2014-42eb-8f97-df5fb74cd99f None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:15.577717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b28bd-2014-42eb-8f97-df5fb74cd99f None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:15.581317 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be60c01-de7f-4dbd-bbd8-34802d348743 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:15.581932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be60c01-de7f-4dbd-bbd8-34802d348743 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:15.582203 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be60c01-de7f-4dbd-bbd8-34802d348743 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:15.582471 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be60c01-de7f-4dbd-bbd8-34802d348743 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:15.592610 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be60c01-de7f-4dbd-bbd8-34802d348743 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:15.594100 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be60c01-de7f-4dbd-bbd8-34802d348743 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:15.604537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1328/2644] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:41:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:41:22.105030 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=71,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:25.599566 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=81,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:31.880507 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ced60-3e88-49b5-9940-7c2938a40381 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:31.947637 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ced60-3e88-49b5-9940-7c2938a40381 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:31.953097 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49e2f8-77ef-4bd4-97b0-8f1b2fba3da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:31.953789 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49e2f8-77ef-4bd4-97b0-8f1b2fba3da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:31.954110 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49e2f8-77ef-4bd4-97b0-8f1b2fba3da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:31.954379 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49e2f8-77ef-4bd4-97b0-8f1b2fba3da1 admin admin] PATH_INFO: `/v3/users/62a93781313f4467be69498b3ce695a4` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:31.955567 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49e2f8-77ef-4bd4-97b0-8f1b2fba3da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62a93781313f4467be69498b3ce695a4)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:31.957743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49e2f8-77ef-4bd4-97b0-8f1b2fba3da1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:32.194848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7d49e2f8-77ef-4bd4-97b0-8f1b2fba3da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62a93781313f4467be69498b3ce695a4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:32.195579 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7d49e2f8-77ef-4bd4-97b0-8f1b2fba3da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62a93781313f4467be69498b3ce695a4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:32.262945 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7d49e2f8-77ef-4bd4-97b0-8f1b2fba3da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62a93781313f4467be69498b3ce695a4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:32.276570 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7d49e2f8-77ef-4bd4-97b0-8f1b2fba3da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62a93781313f4467be69498b3ce695a4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:32.277387 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7d49e2f8-77ef-4bd4-97b0-8f1b2fba3da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62a93781313f4467be69498b3ce695a4'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:32.289909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1317/2645] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:41:31 2022] DELETE /identity/v3/users/62a93781313f4467be69498b3ce695a4 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:32.294989 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97206cdc-8168-41b5-8afe-297f96697fec None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:32.295522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97206cdc-8168-41b5-8afe-297f96697fec None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:32.295522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97206cdc-8168-41b5-8afe-297f96697fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:32.315812 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-97206cdc-8168-41b5-8afe-297f96697fec None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:41:32.317047 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-97206cdc-8168-41b5-8afe-297f96697fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:32.381955 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1329/2646] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:41:32.392117 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49e2f8-77ef-4bd4-97b0-8f1b2fba3da1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:32.393572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7d49e2f8-77ef-4bd4-97b0-8f1b2fba3da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:32.454507 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49e2f8-77ef-4bd4-97b0-8f1b2fba3da1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:32.458171 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470c5b9-cc7a-4c15-af1d-13ad57b91ce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:32.458792 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470c5b9-cc7a-4c15-af1d-13ad57b91ce5 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:32.459065 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470c5b9-cc7a-4c15-af1d-13ad57b91ce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:32.459346 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470c5b9-cc7a-4c15-af1d-13ad57b91ce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:32.469285 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470c5b9-cc7a-4c15-af1d-13ad57b91ce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:32.470722 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470c5b9-cc7a-4c15-af1d-13ad57b91ce5 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:32.481374 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1318/2647] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:41:32.987727 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97206cdc-8168-41b5-8afe-297f96697fec None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:32.989351 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-97206cdc-8168-41b5-8afe-297f96697fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:33.002951 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97206cdc-8168-41b5-8afe-297f96697fec None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:33.008120 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2c029-81d0-4ff1-874a-5bbc44485b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:33.008770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2c029-81d0-4ff1-874a-5bbc44485b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:33.009073 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2c029-81d0-4ff1-874a-5bbc44485b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:33.009378 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2c029-81d0-4ff1-874a-5bbc44485b69 admin admin] PATH_INFO: `/v3/projects/8c75405020b543cb828e292df07cb4e2` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:33.010536 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2c029-81d0-4ff1-874a-5bbc44485b69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c75405020b543cb828e292df07cb4e2)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:33.013222 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2c029-81d0-4ff1-874a-5bbc44485b69 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:33.156229 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-82c2c029-81d0-4ff1-874a-5bbc44485b69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c75405020b543cb828e292df07cb4e2', 'request_id': 'req-82c2c029-81d0-4ff1-874a-5bbc44485b69'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:33.162850 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-82c2c029-81d0-4ff1-874a-5bbc44485b69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c75405020b543cb828e292df07cb4e2', 'request_id': 'req-82c2c029-81d0-4ff1-874a-5bbc44485b69'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:33.256291 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-82c2c029-81d0-4ff1-874a-5bbc44485b69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c75405020b543cb828e292df07cb4e2', 'request_id': 'req-82c2c029-81d0-4ff1-874a-5bbc44485b69'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:33.273200 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-82c2c029-81d0-4ff1-874a-5bbc44485b69 admin admin] The token cache is being invalidate because project 8c75405020b543cb828e292df07cb4e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:41:33.273200 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-82c2c029-81d0-4ff1-874a-5bbc44485b69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:33.273200 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-82c2c029-81d0-4ff1-874a-5bbc44485b69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:33.273200 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1330/2648] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:41:32 2022] DELETE /identity/v3/projects/8c75405020b543cb828e292df07cb4e2 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:33.279137 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470c5b9-cc7a-4c15-af1d-13ad57b91ce5 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:33.289938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470c5b9-cc7a-4c15-af1d-13ad57b91ce5 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:33.309854 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:33.355259 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6501a-ab4b-4f16-b075-88a0202fc904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:33.355900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6501a-ab4b-4f16-b075-88a0202fc904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:33.356190 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6501a-ab4b-4f16-b075-88a0202fc904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:33.356466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6501a-ab4b-4f16-b075-88a0202fc904 admin admin] PATH_INFO: `/v3/users/f2b3b514127d43858e24c8749692affc` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:33.357721 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6501a-ab4b-4f16-b075-88a0202fc904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b3b514127d43858e24c8749692affc)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:33.359729 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6501a-ab4b-4f16-b075-88a0202fc904 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:33.658710 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-55d6501a-ab4b-4f16-b075-88a0202fc904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b3b514127d43858e24c8749692affc'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:33.659365 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-55d6501a-ab4b-4f16-b075-88a0202fc904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b3b514127d43858e24c8749692affc'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:33.874254 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-55d6501a-ab4b-4f16-b075-88a0202fc904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b3b514127d43858e24c8749692affc'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:33.887649 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-55d6501a-ab4b-4f16-b075-88a0202fc904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b3b514127d43858e24c8749692affc'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:33.888215 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-55d6501a-ab4b-4f16-b075-88a0202fc904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b3b514127d43858e24c8749692affc'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:33.901106 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1319/2649] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:41:33 2022] DELETE /identity/v3/users/f2b3b514127d43858e24c8749692affc => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:34.464265 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2c029-81d0-4ff1-874a-5bbc44485b69 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:34.466092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-82c2c029-81d0-4ff1-874a-5bbc44485b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:34.489716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2c029-81d0-4ff1-874a-5bbc44485b69 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:34.557139 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90885be2-1a9b-42dd-b14b-b0b463019d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:34.558057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90885be2-1a9b-42dd-b14b-b0b463019d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:34.558334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90885be2-1a9b-42dd-b14b-b0b463019d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:34.558606 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90885be2-1a9b-42dd-b14b-b0b463019d9a admin admin] PATH_INFO: `/v3/projects/f14701f39dda4aaf82381da08f52ab2c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:34.560967 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90885be2-1a9b-42dd-b14b-b0b463019d9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f14701f39dda4aaf82381da08f52ab2c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:34.562954 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90885be2-1a9b-42dd-b14b-b0b463019d9a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:34.731167 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:34.748326 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-90885be2-1a9b-42dd-b14b-b0b463019d9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f14701f39dda4aaf82381da08f52ab2c', 'request_id': 'req-90885be2-1a9b-42dd-b14b-b0b463019d9a'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:34.756356 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-90885be2-1a9b-42dd-b14b-b0b463019d9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f14701f39dda4aaf82381da08f52ab2c', 'request_id': 'req-90885be2-1a9b-42dd-b14b-b0b463019d9a'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:34.867862 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-90885be2-1a9b-42dd-b14b-b0b463019d9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f14701f39dda4aaf82381da08f52ab2c', 'request_id': 'req-90885be2-1a9b-42dd-b14b-b0b463019d9a'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:34.880803 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-90885be2-1a9b-42dd-b14b-b0b463019d9a admin admin] The token cache is being invalidate because project f14701f39dda4aaf82381da08f52ab2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:41:34.881127 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-90885be2-1a9b-42dd-b14b-b0b463019d9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:34.881778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-90885be2-1a9b-42dd-b14b-b0b463019d9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:34.883246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1331/2650] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:41:34 2022] DELETE /identity/v3/projects/f14701f39dda4aaf82381da08f52ab2c => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:34.889241 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46be5d-aa48-4a11-96cc-26d2a6836306 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:34.889723 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46be5d-aa48-4a11-96cc-26d2a6836306 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:34.889825 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46be5d-aa48-4a11-96cc-26d2a6836306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:34.911005 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-bd46be5d-aa48-4a11-96cc-26d2a6836306 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:41:34.912234 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bd46be5d-aa48-4a11-96cc-26d2a6836306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:34.975292 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1320/2651] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:41:34.983720 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cada81-76f3-48d6-8a02-4c15cc802c31 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:34.983933 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cada81-76f3-48d6-8a02-4c15cc802c31 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:34.984187 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cada81-76f3-48d6-8a02-4c15cc802c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:35.007227 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-49cada81-76f3-48d6-8a02-4c15cc802c31 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:41:35.008427 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-49cada81-76f3-48d6-8a02-4c15cc802c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:35.017917 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1332/2652] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:41:35.023087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46be5d-aa48-4a11-96cc-26d2a6836306 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:35.033623 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46be5d-aa48-4a11-96cc-26d2a6836306 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:35.038677 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ec1f7-7bf5-45e7-9b3c-e85e6b38f344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:35.039262 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ec1f7-7bf5-45e7-9b3c-e85e6b38f344 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:35.039546 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ec1f7-7bf5-45e7-9b3c-e85e6b38f344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:35.039822 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ec1f7-7bf5-45e7-9b3c-e85e6b38f344 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:35.040471 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ec1f7-7bf5-45e7-9b3c-e85e6b38f344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:41:35.040779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ec1f7-7bf5-45e7-9b3c-e85e6b38f344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:35.042421 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ec1f7-7bf5-45e7-9b3c-e85e6b38f344 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:35.054398 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1321/2653] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:41:35.058743 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cada81-76f3-48d6-8a02-4c15cc802c31 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:35.068789 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cada81-76f3-48d6-8a02-4c15cc802c31 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:35.073969 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fc2a3-8e69-46c7-b917-8799762b6f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:35.074562 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fc2a3-8e69-46c7-b917-8799762b6f72 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:35.075403 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fc2a3-8e69-46c7-b917-8799762b6f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:35.075679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fc2a3-8e69-46c7-b917-8799762b6f72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:35.076318 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fc2a3-8e69-46c7-b917-8799762b6f72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:35.078289 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fc2a3-8e69-46c7-b917-8799762b6f72 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:35.190541 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1333/2654] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:41:35 2022] POST /identity/v3/projects => generated 393 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:41:35.195208 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ec1f7-7bf5-45e7-9b3c-e85e6b38f344 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:35.207164 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ec1f7-7bf5-45e7-9b3c-e85e6b38f344 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:35.235304 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:35.266386 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16591d3a-a060-4dcf-8319-a28da6f62645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:35.267032 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16591d3a-a060-4dcf-8319-a28da6f62645 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:35.267311 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16591d3a-a060-4dcf-8319-a28da6f62645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:35.267609 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16591d3a-a060-4dcf-8319-a28da6f62645 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:35.268229 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16591d3a-a060-4dcf-8319-a28da6f62645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:35.270212 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16591d3a-a060-4dcf-8319-a28da6f62645 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:35.406509 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1322/2655] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:41:35 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:41:35.411117 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fc2a3-8e69-46c7-b917-8799762b6f72 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:35.421815 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fc2a3-8e69-46c7-b917-8799762b6f72 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:35.426640 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f0f21-645c-4d7d-8547-1a5ead95602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:35.427229 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f0f21-645c-4d7d-8547-1a5ead95602f admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:35.427510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f0f21-645c-4d7d-8547-1a5ead95602f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:35.427783 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f0f21-645c-4d7d-8547-1a5ead95602f admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:35.428428 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f0f21-645c-4d7d-8547-1a5ead95602f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:35.430082 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f0f21-645c-4d7d-8547-1a5ead95602f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:35.440418 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1334/2656] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:41:35.444734 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16591d3a-a060-4dcf-8319-a28da6f62645 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:35.456019 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16591d3a-a060-4dcf-8319-a28da6f62645 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:35.460888 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c1c61-ea42-475c-b852-c406706e1074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:35.461518 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c1c61-ea42-475c-b852-c406706e1074 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:35.461799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c1c61-ea42-475c-b852-c406706e1074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:35.462073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c1c61-ea42-475c-b852-c406706e1074 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:35.462716 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c1c61-ea42-475c-b852-c406706e1074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:35.464381 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c1c61-ea42-475c-b852-c406706e1074 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:35.475299 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1323/2657] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:41:35.479483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f0f21-645c-4d7d-8547-1a5ead95602f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:35.494881 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f0f21-645c-4d7d-8547-1a5ead95602f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:35.499994 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d5c07-e722-41bf-b26f-20a5f9626150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:35.500721 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d5c07-e722-41bf-b26f-20a5f9626150 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:35.500997 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d5c07-e722-41bf-b26f-20a5f9626150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:35.501306 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d5c07-e722-41bf-b26f-20a5f9626150 admin admin] PATH_INFO: `/v3/projects/3430d91e615f4243bfc7d5246cb8c523/users/174a79276f8f4cb48d296c36422eb979/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:35.518887 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d5c07-e722-41bf-b26f-20a5f9626150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3430d91e615f4243bfc7d5246cb8c523, user_id=174a79276f8f4cb48d296c36422eb979, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:35.521988 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d5c07-e722-41bf-b26f-20a5f9626150 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:35.605588 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1335/2658] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:41:35 2022] PUT /identity/v3/projects/3430d91e615f4243bfc7d5246cb8c523/users/174a79276f8f4cb48d296c36422eb979/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:35.617437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3c292-d504-4696-a237-1b7c23232639 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:35.617755 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3c292-d504-4696-a237-1b7c23232639 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:35.618036 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3c292-d504-4696-a237-1b7c23232639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:35.650146 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-cde3c292-d504-4696-a237-1b7c23232639 None None] MFA Rules not processed for user `174a79276f8f4cb48d296c36422eb979`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:41:35.651329 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cde3c292-d504-4696-a237-1b7c23232639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:35.726737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1324/2659] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:41:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:41:35.734540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d5c07-e722-41bf-b26f-20a5f9626150 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:35.810446 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d5c07-e722-41bf-b26f-20a5f9626150 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:35.815204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c41b7-a185-4ed4-98a2-d0df0c1f0097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:35.819824 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c41b7-a185-4ed4-98a2-d0df0c1f0097 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:35.819824 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c41b7-a185-4ed4-98a2-d0df0c1f0097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:35.819824 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c41b7-a185-4ed4-98a2-d0df0c1f0097 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:35.819824 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c41b7-a185-4ed4-98a2-d0df0c1f0097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:35.819824 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c41b7-a185-4ed4-98a2-d0df0c1f0097 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:35.928093 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1336/2660] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:41:35 2022] POST /identity/v3/projects => generated 391 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:41:35.932298 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3c292-d504-4696-a237-1b7c23232639 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:35.943871 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3c292-d504-4696-a237-1b7c23232639 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:36.003774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f1a88-8cb2-42f8-a3ef-9c57c49d2382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:36.004294 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f1a88-8cb2-42f8-a3ef-9c57c49d2382 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:36.004572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f1a88-8cb2-42f8-a3ef-9c57c49d2382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:36.004851 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f1a88-8cb2-42f8-a3ef-9c57c49d2382 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:36.005522 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f1a88-8cb2-42f8-a3ef-9c57c49d2382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:36.007424 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f1a88-8cb2-42f8-a3ef-9c57c49d2382 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:36.114972 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1325/2661] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:41:35 2022] POST /identity/v3/users => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:41:36.119163 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c41b7-a185-4ed4-98a2-d0df0c1f0097 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:36.130677 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c41b7-a185-4ed4-98a2-d0df0c1f0097 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:36.136004 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1fab83-f98d-47e2-b4c2-a902c417732b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:36.136619 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fab83-f98d-47e2-b4c2-a902c417732b admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:36.136924 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fab83-f98d-47e2-b4c2-a902c417732b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:36.138215 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fab83-f98d-47e2-b4c2-a902c417732b admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:36.139224 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1fab83-f98d-47e2-b4c2-a902c417732b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:36.140912 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1fab83-f98d-47e2-b4c2-a902c417732b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:36.152687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1337/2662] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:41:36.159356 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f1a88-8cb2-42f8-a3ef-9c57c49d2382 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:36.170704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f1a88-8cb2-42f8-a3ef-9c57c49d2382 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:36.175618 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b88620-aac9-450e-8889-2b5b209fa811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:36.176281 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b88620-aac9-450e-8889-2b5b209fa811 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:36.176559 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b88620-aac9-450e-8889-2b5b209fa811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:36.176830 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b88620-aac9-450e-8889-2b5b209fa811 admin admin] PATH_INFO: `/v3/projects/313ce88515534a3fbdbbd5116632cad2/users/7c2a6b11bc104260922e392454593311/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:36.198087 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b88620-aac9-450e-8889-2b5b209fa811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=313ce88515534a3fbdbbd5116632cad2, user_id=7c2a6b11bc104260922e392454593311, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:36.201350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b88620-aac9-450e-8889-2b5b209fa811 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:36.325498 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1326/2663] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:41:36 2022] PUT /identity/v3/projects/313ce88515534a3fbdbbd5116632cad2/users/7c2a6b11bc104260922e392454593311/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:36.329545 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1fab83-f98d-47e2-b4c2-a902c417732b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:36.341628 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1fab83-f98d-47e2-b4c2-a902c417732b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:36.362239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:36.400079 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f789f-0aa3-483f-806c-6e9cfd43d530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:36.402436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f789f-0aa3-483f-806c-6e9cfd43d530 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:36.402436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f789f-0aa3-483f-806c-6e9cfd43d530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:36.402436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f789f-0aa3-483f-806c-6e9cfd43d530 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:36.402436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f789f-0aa3-483f-806c-6e9cfd43d530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:36.403561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f789f-0aa3-483f-806c-6e9cfd43d530 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:36.413677 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1338/2664] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:41:36.418324 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b88620-aac9-450e-8889-2b5b209fa811 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:36.424320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:36.430012 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b88620-aac9-450e-8889-2b5b209fa811 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:36.435789 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075850d-2bef-4770-a8f8-634483673330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:36.448605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075850d-2bef-4770-a8f8-634483673330 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:36.448605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075850d-2bef-4770-a8f8-634483673330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:36.448605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a075850d-2bef-4770-a8f8-634483673330 admin admin] PATH_INFO: `/v3/projects/313ce88515534a3fbdbbd5116632cad2/users/7c2a6b11bc104260922e392454593311/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:36.448605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075850d-2bef-4770-a8f8-634483673330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=313ce88515534a3fbdbbd5116632cad2, user_id=7c2a6b11bc104260922e392454593311, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:36.448605 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a075850d-2bef-4770-a8f8-634483673330 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:36.459245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1327/2665] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:41:36 2022] PUT /identity/v3/projects/313ce88515534a3fbdbbd5116632cad2/users/7c2a6b11bc104260922e392454593311/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:36.473232 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45713e7-ea4d-417b-accd-5d9638abcbec None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:36.473526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45713e7-ea4d-417b-accd-5d9638abcbec None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:36.473858 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45713e7-ea4d-417b-accd-5d9638abcbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:36.505147 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d45713e7-ea4d-417b-accd-5d9638abcbec None None] MFA Rules not processed for user `7c2a6b11bc104260922e392454593311`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:41:36.506365 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d45713e7-ea4d-417b-accd-5d9638abcbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:36.597974 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1339/2666] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:41:36 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:41:36.610430 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075850d-2bef-4770-a8f8-634483673330 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:36.612138 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a075850d-2bef-4770-a8f8-634483673330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:36.675466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a075850d-2bef-4770-a8f8-634483673330 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:36.680287 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd008f-098a-4662-a77c-71268e0de3c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:36.680903 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd008f-098a-4662-a77c-71268e0de3c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:36.681218 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd008f-098a-4662-a77c-71268e0de3c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:36.681494 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd008f-098a-4662-a77c-71268e0de3c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:36.692411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd008f-098a-4662-a77c-71268e0de3c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:36.694863 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd008f-098a-4662-a77c-71268e0de3c9 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:36.706236 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1328/2667] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:41:36 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:41:36.760385 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45713e7-ea4d-417b-accd-5d9638abcbec None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:36.761853 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d45713e7-ea4d-417b-accd-5d9638abcbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:36.776930 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45713e7-ea4d-417b-accd-5d9638abcbec None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:36.781790 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b3c6a-01e6-4994-ac45-fddc6ab19417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:36.782414 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b3c6a-01e6-4994-ac45-fddc6ab19417 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:36.782694 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b3c6a-01e6-4994-ac45-fddc6ab19417 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:36.782965 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b3c6a-01e6-4994-ac45-fddc6ab19417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:36.858266 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b3c6a-01e6-4994-ac45-fddc6ab19417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:36.859725 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b3c6a-01e6-4994-ac45-fddc6ab19417 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:36.870264 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1340/2668] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:41:36 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:41:37.035941 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fe704-8a5e-4c2d-bca2-d8e2548526eb None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:37.036458 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fe704-8a5e-4c2d-bca2-d8e2548526eb None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:37.036616 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fe704-8a5e-4c2d-bca2-d8e2548526eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:37.064976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-be4fe704-8a5e-4c2d-bca2-d8e2548526eb None None] MFA Rules not processed for user `635e47d0a5a34fdfb5c8967a96a87828`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:41:37.066352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-be4fe704-8a5e-4c2d-bca2-d8e2548526eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:37.126053 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1329/2669] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 5 14:41:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:41:37.302902 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b3c6a-01e6-4994-ac45-fddc6ab19417 service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:37.304328 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-678b3c6a-01e6-4994-ac45-fddc6ab19417 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:37.371293 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:37.402610 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b3c6a-01e6-4994-ac45-fddc6ab19417 service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:37.409542 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36812c8a-826e-437b-80c1-9d947e8891cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed60e9eecb94ef39c2f4a5e5f50d670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:37.410286 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36812c8a-826e-437b-80c1-9d947e8891cb service swift] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:37.410629 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36812c8a-826e-437b-80c1-9d947e8891cb service swift] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:37.410968 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36812c8a-826e-437b-80c1-9d947e8891cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:37.421375 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36812c8a-826e-437b-80c1-9d947e8891cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:37.423436 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36812c8a-826e-437b-80c1-9d947e8891cb service swift] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:37.433187 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1341/2670] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 5 14:41:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 14:41:43.029357 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fe704-8a5e-4c2d-bca2-d8e2548526eb None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:43.113585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fe704-8a5e-4c2d-bca2-d8e2548526eb None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:43.125142 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e29f1-003b-45c4-ab66-b00264463b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:43.126162 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e29f1-003b-45c4-ab66-b00264463b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:43.126515 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e29f1-003b-45c4-ab66-b00264463b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:43.126835 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e29f1-003b-45c4-ab66-b00264463b49 admin admin] PATH_INFO: `/v3/users/174a79276f8f4cb48d296c36422eb979` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:43.128712 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e29f1-003b-45c4-ab66-b00264463b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=174a79276f8f4cb48d296c36422eb979)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:43.131186 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e29f1-003b-45c4-ab66-b00264463b49 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:43.400006 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:43.402452 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0c7e29f1-003b-45c4-ab66-b00264463b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '174a79276f8f4cb48d296c36422eb979'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:43.403776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0c7e29f1-003b-45c4-ab66-b00264463b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '174a79276f8f4cb48d296c36422eb979'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:43.480349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0c7e29f1-003b-45c4-ab66-b00264463b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '174a79276f8f4cb48d296c36422eb979'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:43.495763 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0c7e29f1-003b-45c4-ab66-b00264463b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '174a79276f8f4cb48d296c36422eb979'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:43.497143 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0c7e29f1-003b-45c4-ab66-b00264463b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '174a79276f8f4cb48d296c36422eb979'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:43.510323 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1330/2671] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:41:43 2022] DELETE /identity/v3/users/174a79276f8f4cb48d296c36422eb979 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:43.515838 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d06dc-92f3-4a2d-bebb-dce2ec4fc151 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:43.516387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d06dc-92f3-4a2d-bebb-dce2ec4fc151 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:43.516387 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d06dc-92f3-4a2d-bebb-dce2ec4fc151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:43.535789 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-845d06dc-92f3-4a2d-bebb-dce2ec4fc151 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:41:43.537084 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-845d06dc-92f3-4a2d-bebb-dce2ec4fc151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:43.600706 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1342/2672] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:41:43.612359 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e29f1-003b-45c4-ab66-b00264463b49 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:43.614250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0c7e29f1-003b-45c4-ab66-b00264463b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:43.677797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e29f1-003b-45c4-ab66-b00264463b49 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:43.681539 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df590c-b85c-4817-b324-9086f95aa3c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:43.682145 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df590c-b85c-4817-b324-9086f95aa3c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:43.682436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df590c-b85c-4817-b324-9086f95aa3c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:43.682689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df590c-b85c-4817-b324-9086f95aa3c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:43.694864 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df590c-b85c-4817-b324-9086f95aa3c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:43.696822 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df590c-b85c-4817-b324-9086f95aa3c6 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:43.712992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1331/2673] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:41:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:41:44.316679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d06dc-92f3-4a2d-bebb-dce2ec4fc151 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:44.319574 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-845d06dc-92f3-4a2d-bebb-dce2ec4fc151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:44.374534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d06dc-92f3-4a2d-bebb-dce2ec4fc151 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:44.398401 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b8a66-90af-437b-a9c7-7eb9a0580ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:44.400296 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b8a66-90af-437b-a9c7-7eb9a0580ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:44.401625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b8a66-90af-437b-a9c7-7eb9a0580ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:44.403462 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b8a66-90af-437b-a9c7-7eb9a0580ca6 admin admin] PATH_INFO: `/v3/projects/3430d91e615f4243bfc7d5246cb8c523` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:44.407607 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b8a66-90af-437b-a9c7-7eb9a0580ca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3430d91e615f4243bfc7d5246cb8c523)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:44.415332 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b8a66-90af-437b-a9c7-7eb9a0580ca6 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:44.695977 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5d7b8a66-90af-437b-a9c7-7eb9a0580ca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3430d91e615f4243bfc7d5246cb8c523', 'request_id': 'req-5d7b8a66-90af-437b-a9c7-7eb9a0580ca6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:44.708495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5d7b8a66-90af-437b-a9c7-7eb9a0580ca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3430d91e615f4243bfc7d5246cb8c523', 'request_id': 'req-5d7b8a66-90af-437b-a9c7-7eb9a0580ca6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:44.839369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5d7b8a66-90af-437b-a9c7-7eb9a0580ca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3430d91e615f4243bfc7d5246cb8c523', 'request_id': 'req-5d7b8a66-90af-437b-a9c7-7eb9a0580ca6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:44.862717 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5d7b8a66-90af-437b-a9c7-7eb9a0580ca6 admin admin] The token cache is being invalidate because project 3430d91e615f4243bfc7d5246cb8c523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:41:44.863375 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5d7b8a66-90af-437b-a9c7-7eb9a0580ca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:44.865123 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5d7b8a66-90af-437b-a9c7-7eb9a0580ca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:44.868031 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1343/2674] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:41:44 2022] DELETE /identity/v3/projects/3430d91e615f4243bfc7d5246cb8c523 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:44.872550 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df590c-b85c-4817-b324-9086f95aa3c6 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:44.888630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df590c-b85c-4817-b324-9086f95aa3c6 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:44.982536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a447778-2f3d-42d7-833b-7b8abc7f2db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:44.983303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a447778-2f3d-42d7-833b-7b8abc7f2db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:44.983648 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a447778-2f3d-42d7-833b-7b8abc7f2db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:44.984010 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a447778-2f3d-42d7-833b-7b8abc7f2db4 admin admin] PATH_INFO: `/v3/users/7c2a6b11bc104260922e392454593311` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:44.985293 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a447778-2f3d-42d7-833b-7b8abc7f2db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c2a6b11bc104260922e392454593311)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:44.987459 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a447778-2f3d-42d7-833b-7b8abc7f2db4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:45.243321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1a447778-2f3d-42d7-833b-7b8abc7f2db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c2a6b11bc104260922e392454593311'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:45.243974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1a447778-2f3d-42d7-833b-7b8abc7f2db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c2a6b11bc104260922e392454593311'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:45.308494 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1a447778-2f3d-42d7-833b-7b8abc7f2db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c2a6b11bc104260922e392454593311'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:45.317402 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:45.330692 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1a447778-2f3d-42d7-833b-7b8abc7f2db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c2a6b11bc104260922e392454593311'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:45.331603 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1a447778-2f3d-42d7-833b-7b8abc7f2db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c2a6b11bc104260922e392454593311'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:45.346894 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1332/2675] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:41:44 2022] DELETE /identity/v3/users/7c2a6b11bc104260922e392454593311 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:45.959499 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b8a66-90af-437b-a9c7-7eb9a0580ca6 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:45.962970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5d7b8a66-90af-437b-a9c7-7eb9a0580ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:45.989417 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b8a66-90af-437b-a9c7-7eb9a0580ca6 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:46.081476 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:46.092553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677edbbc-8f1f-4a87-b9e9-6bc36fe00b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:46.096694 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677edbbc-8f1f-4a87-b9e9-6bc36fe00b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:46.097249 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677edbbc-8f1f-4a87-b9e9-6bc36fe00b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:46.097529 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677edbbc-8f1f-4a87-b9e9-6bc36fe00b71 admin admin] PATH_INFO: `/v3/projects/313ce88515534a3fbdbbd5116632cad2` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:46.099106 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677edbbc-8f1f-4a87-b9e9-6bc36fe00b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=313ce88515534a3fbdbbd5116632cad2)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:46.102007 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677edbbc-8f1f-4a87-b9e9-6bc36fe00b71 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:46.336452 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-677edbbc-8f1f-4a87-b9e9-6bc36fe00b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '313ce88515534a3fbdbbd5116632cad2', 'request_id': 'req-677edbbc-8f1f-4a87-b9e9-6bc36fe00b71'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:46.344644 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-677edbbc-8f1f-4a87-b9e9-6bc36fe00b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '313ce88515534a3fbdbbd5116632cad2', 'request_id': 'req-677edbbc-8f1f-4a87-b9e9-6bc36fe00b71'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:46.439670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-677edbbc-8f1f-4a87-b9e9-6bc36fe00b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '313ce88515534a3fbdbbd5116632cad2', 'request_id': 'req-677edbbc-8f1f-4a87-b9e9-6bc36fe00b71'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:46.454794 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-677edbbc-8f1f-4a87-b9e9-6bc36fe00b71 admin admin] The token cache is being invalidate because project 313ce88515534a3fbdbbd5116632cad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:41:46.455073 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-677edbbc-8f1f-4a87-b9e9-6bc36fe00b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:46.455901 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-677edbbc-8f1f-4a87-b9e9-6bc36fe00b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:46.463926 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66953929-5279-49ff-9ca5-1ac4a8dfe9cf None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:46.464477 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66953929-5279-49ff-9ca5-1ac4a8dfe9cf None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:46.464477 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66953929-5279-49ff-9ca5-1ac4a8dfe9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:46.468886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1344/2676] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:41:45 2022] DELETE /identity/v3/projects/313ce88515534a3fbdbbd5116632cad2 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:46.492217 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-66953929-5279-49ff-9ca5-1ac4a8dfe9cf None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:41:46.493484 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-66953929-5279-49ff-9ca5-1ac4a8dfe9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:46.593109 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697e2fe-7998-4557-bdec-7c99a2a916f7 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:46.593631 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697e2fe-7998-4557-bdec-7c99a2a916f7 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:46.593910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697e2fe-7998-4557-bdec-7c99a2a916f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:46.597957 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1333/2677] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:41:46.620734 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-f697e2fe-7998-4557-bdec-7c99a2a916f7 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:41:46.622363 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f697e2fe-7998-4557-bdec-7c99a2a916f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:46.631450 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1345/2678] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:41:46.638604 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66953929-5279-49ff-9ca5-1ac4a8dfe9cf None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:46.650719 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66953929-5279-49ff-9ca5-1ac4a8dfe9cf None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:46.657797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491a8fb-25b7-42f8-999e-67d8f61231a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:46.658677 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491a8fb-25b7-42f8-999e-67d8f61231a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:46.659090 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491a8fb-25b7-42f8-999e-67d8f61231a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:46.659387 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491a8fb-25b7-42f8-999e-67d8f61231a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:46.660128 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491a8fb-25b7-42f8-999e-67d8f61231a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:41:46.660840 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491a8fb-25b7-42f8-999e-67d8f61231a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:46.662622 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491a8fb-25b7-42f8-999e-67d8f61231a9 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:46.681175 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1334/2679] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:41:46.685089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697e2fe-7998-4557-bdec-7c99a2a916f7 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:46.701342 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697e2fe-7998-4557-bdec-7c99a2a916f7 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:46.710911 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607e4e1-f3ee-40ad-bf16-fa637f475715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:46.711241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607e4e1-f3ee-40ad-bf16-fa637f475715 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:46.711606 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607e4e1-f3ee-40ad-bf16-fa637f475715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:46.711977 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607e4e1-f3ee-40ad-bf16-fa637f475715 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:46.712986 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607e4e1-f3ee-40ad-bf16-fa637f475715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:46.716415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607e4e1-f3ee-40ad-bf16-fa637f475715 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:46.855378 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1346/2680] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:41:46 2022] POST /identity/v3/projects => generated 401 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:41:46.859667 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491a8fb-25b7-42f8-999e-67d8f61231a9 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:46.870177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491a8fb-25b7-42f8-999e-67d8f61231a9 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:46.937536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d67f9-7209-41f1-b07f-ffc219eb86ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:46.938156 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d67f9-7209-41f1-b07f-ffc219eb86ab admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:46.938433 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d67f9-7209-41f1-b07f-ffc219eb86ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:46.938706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d67f9-7209-41f1-b07f-ffc219eb86ab admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:46.941134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d67f9-7209-41f1-b07f-ffc219eb86ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:46.941385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d67f9-7209-41f1-b07f-ffc219eb86ab admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:47.292920 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1335/2681] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:41:46 2022] POST /identity/v3/users => generated 301 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:41:47.297006 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607e4e1-f3ee-40ad-bf16-fa637f475715 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:47.308315 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607e4e1-f3ee-40ad-bf16-fa637f475715 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:47.315015 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c32f6e-a72d-45f8-85a2-8f4aeaffde90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:47.315797 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c32f6e-a72d-45f8-85a2-8f4aeaffde90 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:47.316142 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c32f6e-a72d-45f8-85a2-8f4aeaffde90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:47.316488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c32f6e-a72d-45f8-85a2-8f4aeaffde90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:47.317249 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c32f6e-a72d-45f8-85a2-8f4aeaffde90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:47.319155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c32f6e-a72d-45f8-85a2-8f4aeaffde90 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:47.332538 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1347/2682] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:41:47.336661 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d67f9-7209-41f1-b07f-ffc219eb86ab admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:47.347928 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d67f9-7209-41f1-b07f-ffc219eb86ab admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:47.352482 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f9bc2-a418-4e23-a727-4e54dfd4d752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:47.353105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f9bc2-a418-4e23-a727-4e54dfd4d752 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:47.353389 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f9bc2-a418-4e23-a727-4e54dfd4d752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:47.353659 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f9bc2-a418-4e23-a727-4e54dfd4d752 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:47.354316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f9bc2-a418-4e23-a727-4e54dfd4d752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:47.356215 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f9bc2-a418-4e23-a727-4e54dfd4d752 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:47.370264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1336/2683] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:41:47.376099 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c32f6e-a72d-45f8-85a2-8f4aeaffde90 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:47.388217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c32f6e-a72d-45f8-85a2-8f4aeaffde90 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:47.393765 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35c497-5896-4f4e-bf47-1c97bd3aadf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:47.405418 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35c497-5896-4f4e-bf47-1c97bd3aadf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:47.405418 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35c497-5896-4f4e-bf47-1c97bd3aadf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:47.405418 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35c497-5896-4f4e-bf47-1c97bd3aadf4 admin admin] PATH_INFO: `/v3/projects/e54e1898d5574316a1c1ccceca045776/users/3696c4d752b74e8f8be770c2ed0f0286/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:47.411535 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35c497-5896-4f4e-bf47-1c97bd3aadf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e54e1898d5574316a1c1ccceca045776, user_id=3696c4d752b74e8f8be770c2ed0f0286, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:47.414791 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35c497-5896-4f4e-bf47-1c97bd3aadf4 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:47.641338 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1348/2684] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:41:47 2022] PUT /identity/v3/projects/e54e1898d5574316a1c1ccceca045776/users/3696c4d752b74e8f8be770c2ed0f0286/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:47.651590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e8f5d-4a2c-449e-a65a-07a1630b2589 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:47.652078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e8f5d-4a2c-449e-a65a-07a1630b2589 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:47.652206 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e8f5d-4a2c-449e-a65a-07a1630b2589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:47.691782 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1e6e8f5d-4a2c-449e-a65a-07a1630b2589 None None] MFA Rules not processed for user `3696c4d752b74e8f8be770c2ed0f0286`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:41:47.691782 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1e6e8f5d-4a2c-449e-a65a-07a1630b2589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:47.717321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:47.750324 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1337/2685] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:41:47 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:41:47.754886 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35c497-5896-4f4e-bf47-1c97bd3aadf4 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:47.821362 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35c497-5896-4f4e-bf47-1c97bd3aadf4 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:47.827333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ee8dd-872c-4a0b-8832-2225a67d1b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:47.827936 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ee8dd-872c-4a0b-8832-2225a67d1b50 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:47.828220 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ee8dd-872c-4a0b-8832-2225a67d1b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:47.828490 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ee8dd-872c-4a0b-8832-2225a67d1b50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:47.829163 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ee8dd-872c-4a0b-8832-2225a67d1b50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:47.831223 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ee8dd-872c-4a0b-8832-2225a67d1b50 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:47.962187 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1349/2686] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:41:47 2022] POST /identity/v3/projects => generated 401 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:41:47.966816 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e8f5d-4a2c-449e-a65a-07a1630b2589 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:47.980039 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e8f5d-4a2c-449e-a65a-07a1630b2589 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:48.044894 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc39c7-f06e-4d8d-81f3-0143ea339957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:48.045548 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc39c7-f06e-4d8d-81f3-0143ea339957 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:48.045835 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc39c7-f06e-4d8d-81f3-0143ea339957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:48.046102 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc39c7-f06e-4d8d-81f3-0143ea339957 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:48.046750 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc39c7-f06e-4d8d-81f3-0143ea339957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:48.048699 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc39c7-f06e-4d8d-81f3-0143ea339957 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:48.112606 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1338/2687] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:41:47 2022] POST /identity/v3/users => generated 307 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:41:48.116656 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ee8dd-872c-4a0b-8832-2225a67d1b50 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:48.136427 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ee8dd-872c-4a0b-8832-2225a67d1b50 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:48.148174 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a5bfe-78e9-4bb7-a9b8-959135f923f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:48.149095 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a5bfe-78e9-4bb7-a9b8-959135f923f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:48.149509 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a5bfe-78e9-4bb7-a9b8-959135f923f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:48.149909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a5bfe-78e9-4bb7-a9b8-959135f923f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:48.150870 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a5bfe-78e9-4bb7-a9b8-959135f923f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:48.154583 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a5bfe-78e9-4bb7-a9b8-959135f923f3 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:48.159074 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:48.181542 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1350/2688] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:41:48.181753 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc39c7-f06e-4d8d-81f3-0143ea339957 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:48.198610 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc39c7-f06e-4d8d-81f3-0143ea339957 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:48.211198 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6469730-0035-4406-842d-cab77a9cb823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:48.213193 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6469730-0035-4406-842d-cab77a9cb823 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:48.213834 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6469730-0035-4406-842d-cab77a9cb823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:48.214303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6469730-0035-4406-842d-cab77a9cb823 admin admin] PATH_INFO: `/v3/projects/3d7f506a138a4e2c9883ae6ab6e222bb/users/496223a2b29649afb2d6536e0e6326b7/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:48.246001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6469730-0035-4406-842d-cab77a9cb823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7f506a138a4e2c9883ae6ab6e222bb, user_id=496223a2b29649afb2d6536e0e6326b7, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:48.249487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6469730-0035-4406-842d-cab77a9cb823 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:48.346144 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1339/2689] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:41:48 2022] PUT /identity/v3/projects/3d7f506a138a4e2c9883ae6ab6e222bb/users/496223a2b29649afb2d6536e0e6326b7/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:48.349871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a5bfe-78e9-4bb7-a9b8-959135f923f3 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:48.364497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a5bfe-78e9-4bb7-a9b8-959135f923f3 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:48.486796 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865c1f0-5477-4a43-96d4-3e3e01a9cfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:48.487340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865c1f0-5477-4a43-96d4-3e3e01a9cfb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:48.487641 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865c1f0-5477-4a43-96d4-3e3e01a9cfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:48.487950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865c1f0-5477-4a43-96d4-3e3e01a9cfb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:48.488611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865c1f0-5477-4a43-96d4-3e3e01a9cfb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:48.490615 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865c1f0-5477-4a43-96d4-3e3e01a9cfb5 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:48.507401 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1351/2690] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:41:48.513744 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6469730-0035-4406-842d-cab77a9cb823 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:48.526537 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6469730-0035-4406-842d-cab77a9cb823 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:48.532128 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459032ab-d356-433a-9e44-d33d2e7999b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:48.536909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459032ab-d356-433a-9e44-d33d2e7999b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:48.536909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459032ab-d356-433a-9e44-d33d2e7999b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:48.536909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459032ab-d356-433a-9e44-d33d2e7999b0 admin admin] PATH_INFO: `/v3/projects/3d7f506a138a4e2c9883ae6ab6e222bb/users/496223a2b29649afb2d6536e0e6326b7/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:48.536909 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459032ab-d356-433a-9e44-d33d2e7999b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7f506a138a4e2c9883ae6ab6e222bb, user_id=496223a2b29649afb2d6536e0e6326b7, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:48.538718 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459032ab-d356-433a-9e44-d33d2e7999b0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:48.563692 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1340/2691] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:41:48 2022] PUT /identity/v3/projects/3d7f506a138a4e2c9883ae6ab6e222bb/users/496223a2b29649afb2d6536e0e6326b7/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:48.565926 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5199eaa-bb02-4da6-a30e-cf2ceaa73024 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:48.566564 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5199eaa-bb02-4da6-a30e-cf2ceaa73024 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:48.566892 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5199eaa-bb02-4da6-a30e-cf2ceaa73024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:48.607835 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-a5199eaa-bb02-4da6-a30e-cf2ceaa73024 None None] MFA Rules not processed for user `496223a2b29649afb2d6536e0e6326b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:41:48.609505 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a5199eaa-bb02-4da6-a30e-cf2ceaa73024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:48.827796 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1352/2692] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:41:48 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:41:48.839014 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459032ab-d356-433a-9e44-d33d2e7999b0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:48.841951 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-459032ab-d356-433a-9e44-d33d2e7999b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:48.909227 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459032ab-d356-433a-9e44-d33d2e7999b0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:48.912856 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e917d9-8975-4ab1-92a9-d3b4330a0bd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:48.913485 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e917d9-8975-4ab1-92a9-d3b4330a0bd4 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:48.913762 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e917d9-8975-4ab1-92a9-d3b4330a0bd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:48.914033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e917d9-8975-4ab1-92a9-d3b4330a0bd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:48.924364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e917d9-8975-4ab1-92a9-d3b4330a0bd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:48.925814 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e917d9-8975-4ab1-92a9-d3b4330a0bd4 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:48.936874 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1341/2693] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:41:48 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:41:49.268855 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5199eaa-bb02-4da6-a30e-cf2ceaa73024 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:49.279339 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5199eaa-bb02-4da6-a30e-cf2ceaa73024 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:49.283092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f22b0-9eb2-4a01-8dbd-28c7c8150f58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:49.283725 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f22b0-9eb2-4a01-8dbd-28c7c8150f58 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:49.284050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f22b0-9eb2-4a01-8dbd-28c7c8150f58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:49.284643 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f22b0-9eb2-4a01-8dbd-28c7c8150f58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:49.351419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f22b0-9eb2-4a01-8dbd-28c7c8150f58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:49.353305 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f22b0-9eb2-4a01-8dbd-28c7c8150f58 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:49.365767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1353/2694] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:41:49 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:41:55.401441 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f554b-7705-4686-88c6-f7339810be62 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:55.402099 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f554b-7705-4686-88c6-f7339810be62 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:55.402099 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f554b-7705-4686-88c6-f7339810be62 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:55.403408 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1342/2695] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 5 14:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:41:55.410995 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ee99d-4ccf-441c-a37d-7535818fd15e None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:55.411619 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ee99d-4ccf-441c-a37d-7535818fd15e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:55.411619 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ee99d-4ccf-441c-a37d-7535818fd15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:55.433703 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-3c9ee99d-4ccf-441c-a37d-7535818fd15e None None] MFA Rules not processed for user `d5515accf3b64006bc41422265a641bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:41:55.435425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3c9ee99d-4ccf-441c-a37d-7535818fd15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:55.451179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:55.515080 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1354/2696] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 5 14:41:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:41:55.536835 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f554b-7705-4686-88c6-f7339810be62 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:55.538982 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9e0f554b-7705-4686-88c6-f7339810be62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:55.581810 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:55.612980 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f554b-7705-4686-88c6-f7339810be62 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:55.616883 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84a570-2b10-47be-88fd-108e785658f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a7e9f0daa1c48eca87d92ced265afdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:55.617524 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84a570-2b10-47be-88fd-108e785658f1 service glance] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:55.617806 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84a570-2b10-47be-88fd-108e785658f1 service glance] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:55.618078 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84a570-2b10-47be-88fd-108e785658f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:55.630181 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84a570-2b10-47be-88fd-108e785658f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:55.631660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84a570-2b10-47be-88fd-108e785658f1 service glance] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:55.648935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1343/2697] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:41:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:41:55.906370 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ee99d-4ccf-441c-a37d-7535818fd15e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:55.972219 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ee99d-4ccf-441c-a37d-7535818fd15e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:55.976598 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e9b85-8ebe-494a-9d6d-f5cdc890ca62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:55.977251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e9b85-8ebe-494a-9d6d-f5cdc890ca62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:55.977531 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e9b85-8ebe-494a-9d6d-f5cdc890ca62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:55.977803 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e9b85-8ebe-494a-9d6d-f5cdc890ca62 admin admin] PATH_INFO: `/v3/users/3696c4d752b74e8f8be770c2ed0f0286` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:55.978910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e9b85-8ebe-494a-9d6d-f5cdc890ca62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3696c4d752b74e8f8be770c2ed0f0286)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:55.980849 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e9b85-8ebe-494a-9d6d-f5cdc890ca62 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:56.007936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304f306-c33f-4da2-8448-2f1761b962e9 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:56.008209 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304f306-c33f-4da2-8448-2f1761b962e9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:56.008472 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304f306-c33f-4da2-8448-2f1761b962e9 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:56.009839 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1344/2698] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 5 14:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:41:56.015438 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fa70c-8227-4f84-aec0-3afcef7b25ba None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:56.015723 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fa70c-8227-4f84-aec0-3afcef7b25ba None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:56.016004 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fa70c-8227-4f84-aec0-3afcef7b25ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:56.036162 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ae3fa70c-8227-4f84-aec0-3afcef7b25ba None None] MFA Rules not processed for user `b0ec118e5a114429b3e1c91041f7caf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:41:56.037816 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ae3fa70c-8227-4f84-aec0-3afcef7b25ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:56.094632 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1345/2699] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 5 14:41:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:41:56.107223 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fa70c-8227-4f84-aec0-3afcef7b25ba None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:56.108834 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ae3fa70c-8227-4f84-aec0-3afcef7b25ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:56.119991 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fa70c-8227-4f84-aec0-3afcef7b25ba None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:56.124606 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa452e9-3b2d-4c95-b12f-12eb603e0c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:56.125250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa452e9-3b2d-4c95-b12f-12eb603e0c38 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:56.125533 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa452e9-3b2d-4c95-b12f-12eb603e0c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:56.125808 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa452e9-3b2d-4c95-b12f-12eb603e0c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:56.133875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa452e9-3b2d-4c95-b12f-12eb603e0c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:56.135298 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa452e9-3b2d-4c95-b12f-12eb603e0c38 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:56.146128 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1346/2700] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:41:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:41:56.234069 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1ddcd-40c0-4441-93ad-7575f6b998f8 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:56.238153 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1ddcd-40c0-4441-93ad-7575f6b998f8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:56.238153 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1ddcd-40c0-4441-93ad-7575f6b998f8 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:56.238153 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1347/2701] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 5 14:41:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 14:41:56.241784 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec28e7b-953d-4d21-baff-6f3af9590369 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:56.242069 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec28e7b-953d-4d21-baff-6f3af9590369 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:56.242345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec28e7b-953d-4d21-baff-6f3af9590369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:56.263744 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4ec28e7b-953d-4d21-baff-6f3af9590369 None None] MFA Rules not processed for user `d5515accf3b64006bc41422265a641bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:41:56.264979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4ec28e7b-953d-4d21-baff-6f3af9590369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:56.274640 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1348/2702] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 5 14:41:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:41:56.283745 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e21e9b85-8ebe-494a-9d6d-f5cdc890ca62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3696c4d752b74e8f8be770c2ed0f0286'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:56.285741 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec28e7b-953d-4d21-baff-6f3af9590369 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:56.288127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4ec28e7b-953d-4d21-baff-6f3af9590369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:56.300865 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec28e7b-953d-4d21-baff-6f3af9590369 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:56.304611 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f838e4d-ce53-47cc-a8bf-40cac37c1faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:56.305260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f838e4d-ce53-47cc-a8bf-40cac37c1faf service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:56.305543 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f838e4d-ce53-47cc-a8bf-40cac37c1faf service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:56.305813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f838e4d-ce53-47cc-a8bf-40cac37c1faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:56.317557 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f838e4d-ce53-47cc-a8bf-40cac37c1faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:56.320295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f838e4d-ce53-47cc-a8bf-40cac37c1faf service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:56.331082 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1349/2703] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:41:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:41:56.358530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e21e9b85-8ebe-494a-9d6d-f5cdc890ca62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3696c4d752b74e8f8be770c2ed0f0286'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:56.372269 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e21e9b85-8ebe-494a-9d6d-f5cdc890ca62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3696c4d752b74e8f8be770c2ed0f0286'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:56.374839 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e21e9b85-8ebe-494a-9d6d-f5cdc890ca62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3696c4d752b74e8f8be770c2ed0f0286'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:56.385538 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e21e9b85-8ebe-494a-9d6d-f5cdc890ca62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3696c4d752b74e8f8be770c2ed0f0286'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:56.393078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1355/2704] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:41:55 2022] DELETE /identity/v3/users/3696c4d752b74e8f8be770c2ed0f0286 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:41:56.397681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c22a77-758a-4a89-afef-76664496decb None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:56.397972 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c22a77-758a-4a89-afef-76664496decb None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:56.398250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c22a77-758a-4a89-afef-76664496decb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:56.418572 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b6c22a77-758a-4a89-afef-76664496decb None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:41:56.420496 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b6c22a77-758a-4a89-afef-76664496decb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:56.487640 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1350/2705] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:41:56.499300 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e9b85-8ebe-494a-9d6d-f5cdc890ca62 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:56.504716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e21e9b85-8ebe-494a-9d6d-f5cdc890ca62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:56.548118 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:56.598002 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e9b85-8ebe-494a-9d6d-f5cdc890ca62 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:56.601833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b5f1f-4a87-4a0c-af52-16985164057a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:56.602492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b5f1f-4a87-4a0c-af52-16985164057a service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:56.602771 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b5f1f-4a87-4a0c-af52-16985164057a service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:56.603074 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b5f1f-4a87-4a0c-af52-16985164057a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:56.613908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b5f1f-4a87-4a0c-af52-16985164057a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:56.625121 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b5f1f-4a87-4a0c-af52-16985164057a service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:56.627010 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1356/2706] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:41:57.064916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c22a77-758a-4a89-afef-76664496decb None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:57.066469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b6c22a77-758a-4a89-afef-76664496decb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:57.083772 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c22a77-758a-4a89-afef-76664496decb None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:57.084107 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cd908-57f3-4c6b-93f5-be1631f5fb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:57.084781 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cd908-57f3-4c6b-93f5-be1631f5fb1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:57.085084 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cd908-57f3-4c6b-93f5-be1631f5fb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:57.085399 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cd908-57f3-4c6b-93f5-be1631f5fb1b admin admin] PATH_INFO: `/v3/projects/e54e1898d5574316a1c1ccceca045776` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:57.086598 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cd908-57f3-4c6b-93f5-be1631f5fb1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e54e1898d5574316a1c1ccceca045776)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:57.088573 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cd908-57f3-4c6b-93f5-be1631f5fb1b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:57.254462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:57.259368 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c41cd908-57f3-4c6b-93f5-be1631f5fb1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e54e1898d5574316a1c1ccceca045776', 'request_id': 'req-c41cd908-57f3-4c6b-93f5-be1631f5fb1b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:57.266005 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c41cd908-57f3-4c6b-93f5-be1631f5fb1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e54e1898d5574316a1c1ccceca045776', 'request_id': 'req-c41cd908-57f3-4c6b-93f5-be1631f5fb1b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:57.360404 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c41cd908-57f3-4c6b-93f5-be1631f5fb1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e54e1898d5574316a1c1ccceca045776', 'request_id': 'req-c41cd908-57f3-4c6b-93f5-be1631f5fb1b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:57.374170 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c41cd908-57f3-4c6b-93f5-be1631f5fb1b admin admin] The token cache is being invalidate because project e54e1898d5574316a1c1ccceca045776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:41:57.375492 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c41cd908-57f3-4c6b-93f5-be1631f5fb1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:57.375717 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c41cd908-57f3-4c6b-93f5-be1631f5fb1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:57.377519 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1351/2707] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:41:57 2022] DELETE /identity/v3/projects/e54e1898d5574316a1c1ccceca045776 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:57.382078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b5f1f-4a87-4a0c-af52-16985164057a service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:57.392511 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b5f1f-4a87-4a0c-af52-16985164057a service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:57.469763 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452fb46-41b7-464c-b34c-1699e175d43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:57.470415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452fb46-41b7-464c-b34c-1699e175d43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:57.470699 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452fb46-41b7-464c-b34c-1699e175d43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:57.471111 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452fb46-41b7-464c-b34c-1699e175d43d admin admin] PATH_INFO: `/v3/users/496223a2b29649afb2d6536e0e6326b7` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:57.472287 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452fb46-41b7-464c-b34c-1699e175d43d admin admin] RBAC: Authorizing `identity:delete_user(user_id=496223a2b29649afb2d6536e0e6326b7)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:57.474382 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452fb46-41b7-464c-b34c-1699e175d43d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:57.777203 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4452fb46-41b7-464c-b34c-1699e175d43d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '496223a2b29649afb2d6536e0e6326b7'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:57.900594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4452fb46-41b7-464c-b34c-1699e175d43d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '496223a2b29649afb2d6536e0e6326b7'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:57.918651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4452fb46-41b7-464c-b34c-1699e175d43d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '496223a2b29649afb2d6536e0e6326b7'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:57.920016 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4452fb46-41b7-464c-b34c-1699e175d43d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '496223a2b29649afb2d6536e0e6326b7'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:57.928839 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4452fb46-41b7-464c-b34c-1699e175d43d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '496223a2b29649afb2d6536e0e6326b7'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:57.943503 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1357/2708] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:41:57 2022] DELETE /identity/v3/users/496223a2b29649afb2d6536e0e6326b7 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:58.430176 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cd908-57f3-4c6b-93f5-be1631f5fb1b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:58.432002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c41cd908-57f3-4c6b-93f5-be1631f5fb1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:58.447687 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cd908-57f3-4c6b-93f5-be1631f5fb1b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:58.523258 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03c743-a696-48c2-8bfa-c862651a9f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:58.523989 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03c743-a696-48c2-8bfa-c862651a9f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:58.524266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03c743-a696-48c2-8bfa-c862651a9f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:58.524536 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03c743-a696-48c2-8bfa-c862651a9f92 admin admin] PATH_INFO: `/v3/projects/3d7f506a138a4e2c9883ae6ab6e222bb` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:58.525770 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03c743-a696-48c2-8bfa-c862651a9f92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7f506a138a4e2c9883ae6ab6e222bb)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:58.527805 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03c743-a696-48c2-8bfa-c862651a9f92 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:58.654505 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5a03c743-a696-48c2-8bfa-c862651a9f92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7f506a138a4e2c9883ae6ab6e222bb', 'request_id': 'req-5a03c743-a696-48c2-8bfa-c862651a9f92'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:58.660412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5a03c743-a696-48c2-8bfa-c862651a9f92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7f506a138a4e2c9883ae6ab6e222bb', 'request_id': 'req-5a03c743-a696-48c2-8bfa-c862651a9f92'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:58.742714 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5a03c743-a696-48c2-8bfa-c862651a9f92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7f506a138a4e2c9883ae6ab6e222bb', 'request_id': 'req-5a03c743-a696-48c2-8bfa-c862651a9f92'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:58.758064 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5a03c743-a696-48c2-8bfa-c862651a9f92 admin admin] The token cache is being invalidate because project 3d7f506a138a4e2c9883ae6ab6e222bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:41:58.758363 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5a03c743-a696-48c2-8bfa-c862651a9f92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:58.759291 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5a03c743-a696-48c2-8bfa-c862651a9f92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:41:58.761638 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1352/2709] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:41:58 2022] DELETE /identity/v3/projects/3d7f506a138a4e2c9883ae6ab6e222bb => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:58.767553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bdd19-4e3e-4ae2-846b-1149746c800e None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:58.767879 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bdd19-4e3e-4ae2-846b-1149746c800e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:58.768157 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bdd19-4e3e-4ae2-846b-1149746c800e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:58.796254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-3d8bdd19-4e3e-4ae2-846b-1149746c800e None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:41:58.796254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3d8bdd19-4e3e-4ae2-846b-1149746c800e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:58.853992 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:58.868602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1358/2710] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:41:58.878650 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76955349-cc5b-4d4b-a931-bb5cb8799cca None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:58.878856 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76955349-cc5b-4d4b-a931-bb5cb8799cca None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:58.879113 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76955349-cc5b-4d4b-a931-bb5cb8799cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:58.901567 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-76955349-cc5b-4d4b-a931-bb5cb8799cca None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:41:58.903466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-76955349-cc5b-4d4b-a931-bb5cb8799cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:58.913847 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1353/2711] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:41:58.918395 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bdd19-4e3e-4ae2-846b-1149746c800e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:58.928936 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bdd19-4e3e-4ae2-846b-1149746c800e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:58.933664 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130cc3c-6241-4d35-b30b-f1ba7b822d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:58.937887 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130cc3c-6241-4d35-b30b-f1ba7b822d06 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:58.937887 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130cc3c-6241-4d35-b30b-f1ba7b822d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:58.937887 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130cc3c-6241-4d35-b30b-f1ba7b822d06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:58.937887 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130cc3c-6241-4d35-b30b-f1ba7b822d06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:41:58.937887 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130cc3c-6241-4d35-b30b-f1ba7b822d06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:58.938399 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130cc3c-6241-4d35-b30b-f1ba7b822d06 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:58.950576 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1359/2712] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:41:58.956027 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76955349-cc5b-4d4b-a931-bb5cb8799cca None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:58.966266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76955349-cc5b-4d4b-a931-bb5cb8799cca None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:58.972435 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30995d01-47d4-41f8-a618-d826a9c499dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:58.972782 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30995d01-47d4-41f8-a618-d826a9c499dd admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:58.973268 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30995d01-47d4-41f8-a618-d826a9c499dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:58.973487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30995d01-47d4-41f8-a618-d826a9c499dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:58.974240 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30995d01-47d4-41f8-a618-d826a9c499dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:58.976184 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30995d01-47d4-41f8-a618-d826a9c499dd admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:59.181403 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1354/2713] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:41:58 2022] POST /identity/v3/projects => generated 381 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:41:59.183470 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130cc3c-6241-4d35-b30b-f1ba7b822d06 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:59.194445 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130cc3c-6241-4d35-b30b-f1ba7b822d06 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:59.259101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2207c-89fe-4d3c-8f7b-595bfa9ecc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:59.259801 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2207c-89fe-4d3c-8f7b-595bfa9ecc98 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:59.260078 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2207c-89fe-4d3c-8f7b-595bfa9ecc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:59.260347 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2207c-89fe-4d3c-8f7b-595bfa9ecc98 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:59.261014 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2207c-89fe-4d3c-8f7b-595bfa9ecc98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:59.263123 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2207c-89fe-4d3c-8f7b-595bfa9ecc98 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:59.403682 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1360/2714] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:41:59 2022] POST /identity/v3/users => generated 291 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:41:59.408617 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30995d01-47d4-41f8-a618-d826a9c499dd admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:59.418973 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30995d01-47d4-41f8-a618-d826a9c499dd admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:59.423807 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dcfde-baaa-4eff-a2a2-27e179ca8c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:59.424415 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dcfde-baaa-4eff-a2a2-27e179ca8c65 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:59.424968 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dcfde-baaa-4eff-a2a2-27e179ca8c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:59.424968 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dcfde-baaa-4eff-a2a2-27e179ca8c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:59.425779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7dcfde-baaa-4eff-a2a2-27e179ca8c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:59.427384 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7dcfde-baaa-4eff-a2a2-27e179ca8c65 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:59.438368 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1355/2715] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:41:59.442970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2207c-89fe-4d3c-8f7b-595bfa9ecc98 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:59.454827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2207c-89fe-4d3c-8f7b-595bfa9ecc98 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:59.459678 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31876609-561e-4fbf-a1da-f64a9c3623e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:59.460308 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31876609-561e-4fbf-a1da-f64a9c3623e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:59.460586 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31876609-561e-4fbf-a1da-f64a9c3623e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:59.460905 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31876609-561e-4fbf-a1da-f64a9c3623e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:59.461833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31876609-561e-4fbf-a1da-f64a9c3623e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:59.463857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31876609-561e-4fbf-a1da-f64a9c3623e5 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:59.476718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1361/2716] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:41:59.480988 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dcfde-baaa-4eff-a2a2-27e179ca8c65 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:59.492627 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dcfde-baaa-4eff-a2a2-27e179ca8c65 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:59.497280 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24afe9-c0f1-4abc-8362-277ac8bb8e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:59.498481 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24afe9-c0f1-4abc-8362-277ac8bb8e6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:59.498763 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24afe9-c0f1-4abc-8362-277ac8bb8e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:59.499040 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24afe9-c0f1-4abc-8362-277ac8bb8e6c admin admin] PATH_INFO: `/v3/projects/18e4843cc36e4f02b6865ba2267e59b4/users/c681d46e102c44fb85346e1be96ac4c4/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:59.515679 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24afe9-c0f1-4abc-8362-277ac8bb8e6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=18e4843cc36e4f02b6865ba2267e59b4, user_id=c681d46e102c44fb85346e1be96ac4c4, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:59.518529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24afe9-c0f1-4abc-8362-277ac8bb8e6c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:59.589165 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:59.596070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1356/2717] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:41:59 2022] PUT /identity/v3/projects/18e4843cc36e4f02b6865ba2267e59b4/users/c681d46e102c44fb85346e1be96ac4c4/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:41:59.606882 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d64fe-aa19-480a-8a7a-65bd47a7f7be None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:59.607235 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d64fe-aa19-480a-8a7a-65bd47a7f7be None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:59.608092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d64fe-aa19-480a-8a7a-65bd47a7f7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:59.638486 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c36d64fe-aa19-480a-8a7a-65bd47a7f7be None None] MFA Rules not processed for user `c681d46e102c44fb85346e1be96ac4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:41:59.640497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c36d64fe-aa19-480a-8a7a-65bd47a7f7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:41:59.710941 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1362/2718] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:41:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:41:59.716355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24afe9-c0f1-4abc-8362-277ac8bb8e6c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:59.796786 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24afe9-c0f1-4abc-8362-277ac8bb8e6c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:41:59.801827 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9685024-5e81-4f6e-bb57-196f6610a48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:41:59.802731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9685024-5e81-4f6e-bb57-196f6610a48a admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:41:59.803167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9685024-5e81-4f6e-bb57-196f6610a48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:41:59.803569 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9685024-5e81-4f6e-bb57-196f6610a48a admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:41:59.804540 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9685024-5e81-4f6e-bb57-196f6610a48a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:41:59.807258 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9685024-5e81-4f6e-bb57-196f6610a48a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:41:59.950038 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1357/2719] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:41:59 2022] POST /identity/v3/projects => generated 381 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:41:59.954761 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d64fe-aa19-480a-8a7a-65bd47a7f7be None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:41:59.966076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d64fe-aa19-480a-8a7a-65bd47a7f7be None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:00.010536 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:00.023309 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e41d2-5ca3-4c51-8eb6-9de2ed916e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:00.023916 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e41d2-5ca3-4c51-8eb6-9de2ed916e93 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:00.024193 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e41d2-5ca3-4c51-8eb6-9de2ed916e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:00.024474 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e41d2-5ca3-4c51-8eb6-9de2ed916e93 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:00.025130 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e41d2-5ca3-4c51-8eb6-9de2ed916e93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:00.027046 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e41d2-5ca3-4c51-8eb6-9de2ed916e93 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:00.175965 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1363/2720] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:41:59 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:42:00.180312 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9685024-5e81-4f6e-bb57-196f6610a48a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:00.191973 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9685024-5e81-4f6e-bb57-196f6610a48a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:00.197184 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be1458-10e7-40de-88d3-5c68e1934897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:00.198136 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be1458-10e7-40de-88d3-5c68e1934897 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:00.198434 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be1458-10e7-40de-88d3-5c68e1934897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:00.198712 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be1458-10e7-40de-88d3-5c68e1934897 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:00.200903 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be1458-10e7-40de-88d3-5c68e1934897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:00.202566 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be1458-10e7-40de-88d3-5c68e1934897 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:00.219877 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1358/2721] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:42:00.221220 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e41d2-5ca3-4c51-8eb6-9de2ed916e93 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:00.234698 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e41d2-5ca3-4c51-8eb6-9de2ed916e93 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:00.240791 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac102f4c-d4c3-475e-a9b6-588db0996ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:00.241764 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac102f4c-d4c3-475e-a9b6-588db0996ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:00.241974 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac102f4c-d4c3-475e-a9b6-588db0996ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:00.242247 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac102f4c-d4c3-475e-a9b6-588db0996ac9 admin admin] PATH_INFO: `/v3/projects/b892ba6475364202a2b1cf607068ffb7/users/7928bd16c2a748ed9cdd794fe8b7bb40/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:00.262456 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac102f4c-d4c3-475e-a9b6-588db0996ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b892ba6475364202a2b1cf607068ffb7, user_id=7928bd16c2a748ed9cdd794fe8b7bb40, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:00.265751 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac102f4c-d4c3-475e-a9b6-588db0996ac9 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:00.378789 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1364/2722] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:42:00 2022] PUT /identity/v3/projects/b892ba6475364202a2b1cf607068ffb7/users/7928bd16c2a748ed9cdd794fe8b7bb40/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:42:00.382799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be1458-10e7-40de-88d3-5c68e1934897 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:00.394508 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be1458-10e7-40de-88d3-5c68e1934897 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:00.469501 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01d47a-09ae-448c-8531-c52725d733f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:00.470254 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01d47a-09ae-448c-8531-c52725d733f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:00.470451 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01d47a-09ae-448c-8531-c52725d733f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:00.470660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01d47a-09ae-448c-8531-c52725d733f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:00.471314 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01d47a-09ae-448c-8531-c52725d733f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:00.472935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01d47a-09ae-448c-8531-c52725d733f8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:00.485683 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1359/2723] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:42:00.490005 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac102f4c-d4c3-475e-a9b6-588db0996ac9 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:00.500957 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac102f4c-d4c3-475e-a9b6-588db0996ac9 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:00.506863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3eb494-f201-4c36-8341-8210609c316e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:00.507566 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3eb494-f201-4c36-8341-8210609c316e admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:00.507847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3eb494-f201-4c36-8341-8210609c316e admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:00.508121 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3eb494-f201-4c36-8341-8210609c316e admin admin] PATH_INFO: `/v3/projects/b892ba6475364202a2b1cf607068ffb7/users/7928bd16c2a748ed9cdd794fe8b7bb40/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:00.510136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3eb494-f201-4c36-8341-8210609c316e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b892ba6475364202a2b1cf607068ffb7, user_id=7928bd16c2a748ed9cdd794fe8b7bb40, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:00.512851 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3eb494-f201-4c36-8341-8210609c316e admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:00.529507 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1365/2724] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:42:00 2022] PUT /identity/v3/projects/b892ba6475364202a2b1cf607068ffb7/users/7928bd16c2a748ed9cdd794fe8b7bb40/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:42:00.544860 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeb9ce-45cb-4deb-91d8-4862c7726f23 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:00.545494 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeb9ce-45cb-4deb-91d8-4862c7726f23 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:00.546626 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeb9ce-45cb-4deb-91d8-4862c7726f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:00.585335 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-66aeb9ce-45cb-4deb-91d8-4862c7726f23 None None] MFA Rules not processed for user `7928bd16c2a748ed9cdd794fe8b7bb40`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:42:00.586681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-66aeb9ce-45cb-4deb-91d8-4862c7726f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:00.657089 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:00.668194 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1360/2725] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:42:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:42:00.679937 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3eb494-f201-4c36-8341-8210609c316e admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:00.681786 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ff3eb494-f201-4c36-8341-8210609c316e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:00.746020 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3eb494-f201-4c36-8341-8210609c316e admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:00.749813 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5d9c5-9dc2-48cb-ac7d-6e73a4bd1ceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:00.750426 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5d9c5-9dc2-48cb-ac7d-6e73a4bd1ceb service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:00.750701 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5d9c5-9dc2-48cb-ac7d-6e73a4bd1ceb service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:00.750967 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5d9c5-9dc2-48cb-ac7d-6e73a4bd1ceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:00.760721 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d5d9c5-9dc2-48cb-ac7d-6e73a4bd1ceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:00.762200 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d5d9c5-9dc2-48cb-ac7d-6e73a4bd1ceb service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:00.773359 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1366/2726] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:42:00 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:42:00.903428 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aeb9ce-45cb-4deb-91d8-4862c7726f23 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:00.914317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aeb9ce-45cb-4deb-91d8-4862c7726f23 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:00.918086 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e0661-cf35-44c0-8888-d72d27c45ba0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:00.918694 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e0661-cf35-44c0-8888-d72d27c45ba0 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:00.919105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e0661-cf35-44c0-8888-d72d27c45ba0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:00.919377 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e0661-cf35-44c0-8888-d72d27c45ba0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:00.986217 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e0661-cf35-44c0-8888-d72d27c45ba0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:00.987673 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e0661-cf35-44c0-8888-d72d27c45ba0 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:00.997123 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1361/2727] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:42:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:42:01.392953 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622b843-0025-4d9e-bf22-ada38c95acff None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:01.392953 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622b843-0025-4d9e-bf22-ada38c95acff None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:01.392953 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622b843-0025-4d9e-bf22-ada38c95acff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:01.424612 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-a622b843-0025-4d9e-bf22-ada38c95acff None None] MFA Rules not processed for user `635e47d0a5a34fdfb5c8967a96a87828`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:42:01.426334 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a622b843-0025-4d9e-bf22-ada38c95acff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:01.493623 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1367/2728] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 5 14:42:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:42:01.506689 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e0661-cf35-44c0-8888-d72d27c45ba0 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:01.508208 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-122e0661-cf35-44c0-8888-d72d27c45ba0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:01.608631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e0661-cf35-44c0-8888-d72d27c45ba0 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:01.615016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe69aa-3394-42c2-b752-716e6e24e121 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed60e9eecb94ef39c2f4a5e5f50d670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:01.615648 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe69aa-3394-42c2-b752-716e6e24e121 service swift] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:01.615931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe69aa-3394-42c2-b752-716e6e24e121 service swift] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:01.616200 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe69aa-3394-42c2-b752-716e6e24e121 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:01.625321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe69aa-3394-42c2-b752-716e6e24e121 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:01.626969 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe69aa-3394-42c2-b752-716e6e24e121 service swift] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:01.637149 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1362/2729] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 5 14:42:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 14:42:04.465933 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622b843-0025-4d9e-bf22-ada38c95acff None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:04.545587 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:04.565224 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622b843-0025-4d9e-bf22-ada38c95acff None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:04.570448 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb3a40-2e37-45d4-b047-fe6ef319ebdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:04.571094 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb3a40-2e37-45d4-b047-fe6ef319ebdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:04.571368 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb3a40-2e37-45d4-b047-fe6ef319ebdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:04.571751 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb3a40-2e37-45d4-b047-fe6ef319ebdd admin admin] PATH_INFO: `/v3/users/c681d46e102c44fb85346e1be96ac4c4` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:04.573043 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb3a40-2e37-45d4-b047-fe6ef319ebdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c681d46e102c44fb85346e1be96ac4c4)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:04.575259 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb3a40-2e37-45d4-b047-fe6ef319ebdd admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:04.776743 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-67cb3a40-2e37-45d4-b047-fe6ef319ebdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c681d46e102c44fb85346e1be96ac4c4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:04.851616 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-67cb3a40-2e37-45d4-b047-fe6ef319ebdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c681d46e102c44fb85346e1be96ac4c4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:04.867344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-67cb3a40-2e37-45d4-b047-fe6ef319ebdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c681d46e102c44fb85346e1be96ac4c4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:04.868092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-67cb3a40-2e37-45d4-b047-fe6ef319ebdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c681d46e102c44fb85346e1be96ac4c4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:04.876422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-67cb3a40-2e37-45d4-b047-fe6ef319ebdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c681d46e102c44fb85346e1be96ac4c4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:04.884592 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1368/2730] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:42:04 2022] DELETE /identity/v3/users/c681d46e102c44fb85346e1be96ac4c4 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:42:04.889154 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b508dc-02f8-4d04-9a3e-6f68b9516bf9 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:04.889863 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b508dc-02f8-4d04-9a3e-6f68b9516bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:04.889863 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b508dc-02f8-4d04-9a3e-6f68b9516bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:04.914848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-84b508dc-02f8-4d04-9a3e-6f68b9516bf9 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:42:04.916194 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-84b508dc-02f8-4d04-9a3e-6f68b9516bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:05.009546 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1363/2731] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:42:05.019374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb3a40-2e37-45d4-b047-fe6ef319ebdd admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:05.020818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-67cb3a40-2e37-45d4-b047-fe6ef319ebdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:05.113277 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb3a40-2e37-45d4-b047-fe6ef319ebdd admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:05.117219 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a2196-cfdf-44a8-85db-f73989f6c92f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:05.117964 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a2196-cfdf-44a8-85db-f73989f6c92f service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:05.118343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a2196-cfdf-44a8-85db-f73989f6c92f service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:05.118732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a2196-cfdf-44a8-85db-f73989f6c92f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:05.140888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a2196-cfdf-44a8-85db-f73989f6c92f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:05.142692 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a2196-cfdf-44a8-85db-f73989f6c92f service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:05.172747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1369/2732] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:42:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:42:05.796125 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b508dc-02f8-4d04-9a3e-6f68b9516bf9 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:05.796125 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-84b508dc-02f8-4d04-9a3e-6f68b9516bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:05.807462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b508dc-02f8-4d04-9a3e-6f68b9516bf9 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:05.814460 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0aa28-4d27-472e-a483-43b0af931d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:05.815361 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0aa28-4d27-472e-a483-43b0af931d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:05.815802 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0aa28-4d27-472e-a483-43b0af931d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:05.816309 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0aa28-4d27-472e-a483-43b0af931d54 admin admin] PATH_INFO: `/v3/projects/18e4843cc36e4f02b6865ba2267e59b4` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:05.818085 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0aa28-4d27-472e-a483-43b0af931d54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18e4843cc36e4f02b6865ba2267e59b4)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:05.820916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0aa28-4d27-472e-a483-43b0af931d54 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:05.884907 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:05.984495 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-88d0aa28-4d27-472e-a483-43b0af931d54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18e4843cc36e4f02b6865ba2267e59b4', 'request_id': 'req-88d0aa28-4d27-472e-a483-43b0af931d54'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:05.990991 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-88d0aa28-4d27-472e-a483-43b0af931d54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18e4843cc36e4f02b6865ba2267e59b4', 'request_id': 'req-88d0aa28-4d27-472e-a483-43b0af931d54'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:06.061140 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-88d0aa28-4d27-472e-a483-43b0af931d54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18e4843cc36e4f02b6865ba2267e59b4', 'request_id': 'req-88d0aa28-4d27-472e-a483-43b0af931d54'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:06.076021 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-88d0aa28-4d27-472e-a483-43b0af931d54 admin admin] The token cache is being invalidate because project 18e4843cc36e4f02b6865ba2267e59b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:42:06.076337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-88d0aa28-4d27-472e-a483-43b0af931d54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:06.078156 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-88d0aa28-4d27-472e-a483-43b0af931d54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:06.083745 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1364/2733] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:42:05 2022] DELETE /identity/v3/projects/18e4843cc36e4f02b6865ba2267e59b4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:42:06.085203 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a2196-cfdf-44a8-85db-f73989f6c92f service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:06.099504 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a2196-cfdf-44a8-85db-f73989f6c92f service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:06.183854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c346e-763d-4394-a87d-01df2000e8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:06.184908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c346e-763d-4394-a87d-01df2000e8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:06.185412 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c346e-763d-4394-a87d-01df2000e8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:06.185865 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c346e-763d-4394-a87d-01df2000e8e7 admin admin] PATH_INFO: `/v3/users/7928bd16c2a748ed9cdd794fe8b7bb40` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:06.187780 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c346e-763d-4394-a87d-01df2000e8e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7928bd16c2a748ed9cdd794fe8b7bb40)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:06.191407 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c346e-763d-4394-a87d-01df2000e8e7 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:06.215963 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:06.482470 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0f2c346e-763d-4394-a87d-01df2000e8e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7928bd16c2a748ed9cdd794fe8b7bb40'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:06.542730 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0f2c346e-763d-4394-a87d-01df2000e8e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7928bd16c2a748ed9cdd794fe8b7bb40'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:06.559938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0f2c346e-763d-4394-a87d-01df2000e8e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7928bd16c2a748ed9cdd794fe8b7bb40'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:06.561130 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0f2c346e-763d-4394-a87d-01df2000e8e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7928bd16c2a748ed9cdd794fe8b7bb40'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:06.584073 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0f2c346e-763d-4394-a87d-01df2000e8e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7928bd16c2a748ed9cdd794fe8b7bb40'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:06.609216 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1370/2734] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:42:06 2022] DELETE /identity/v3/users/7928bd16c2a748ed9cdd794fe8b7bb40 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:42:07.263960 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0aa28-4d27-472e-a483-43b0af931d54 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:07.267175 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-88d0aa28-4d27-472e-a483-43b0af931d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:07.284194 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0aa28-4d27-472e-a483-43b0af931d54 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:07.372554 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c020f25-a804-4e14-8acb-2ac4e9191281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:07.373637 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c020f25-a804-4e14-8acb-2ac4e9191281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:07.374094 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c020f25-a804-4e14-8acb-2ac4e9191281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:07.374736 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c020f25-a804-4e14-8acb-2ac4e9191281 admin admin] PATH_INFO: `/v3/projects/b892ba6475364202a2b1cf607068ffb7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:07.376407 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c020f25-a804-4e14-8acb-2ac4e9191281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b892ba6475364202a2b1cf607068ffb7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:07.380019 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c020f25-a804-4e14-8acb-2ac4e9191281 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:07.517580 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c020f25-a804-4e14-8acb-2ac4e9191281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b892ba6475364202a2b1cf607068ffb7', 'request_id': 'req-4c020f25-a804-4e14-8acb-2ac4e9191281'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:07.524115 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c020f25-a804-4e14-8acb-2ac4e9191281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b892ba6475364202a2b1cf607068ffb7', 'request_id': 'req-4c020f25-a804-4e14-8acb-2ac4e9191281'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:07.629279 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c020f25-a804-4e14-8acb-2ac4e9191281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b892ba6475364202a2b1cf607068ffb7', 'request_id': 'req-4c020f25-a804-4e14-8acb-2ac4e9191281'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:07.647637 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c020f25-a804-4e14-8acb-2ac4e9191281 admin admin] The token cache is being invalidate because project b892ba6475364202a2b1cf607068ffb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:42:07.654853 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c020f25-a804-4e14-8acb-2ac4e9191281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:07.654853 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c020f25-a804-4e14-8acb-2ac4e9191281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:07.654853 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1365/2735] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:42:07 2022] DELETE /identity/v3/projects/b892ba6475364202a2b1cf607068ffb7 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:42:07.656468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e8511-50a3-40ea-82d6-e4d2e5cbee7d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:07.656847 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e8511-50a3-40ea-82d6-e4d2e5cbee7d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:07.657014 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e8511-50a3-40ea-82d6-e4d2e5cbee7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:07.699480 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-5f0e8511-50a3-40ea-82d6-e4d2e5cbee7d None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:42:07.700715 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5f0e8511-50a3-40ea-82d6-e4d2e5cbee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:07.800786 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1371/2736] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:42:07.810998 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54874e2b-6d2f-49be-8101-adc5bd13ca5e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:07.812309 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54874e2b-6d2f-49be-8101-adc5bd13ca5e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:07.813187 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54874e2b-6d2f-49be-8101-adc5bd13ca5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:07.843202 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-54874e2b-6d2f-49be-8101-adc5bd13ca5e None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:42:07.845239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-54874e2b-6d2f-49be-8101-adc5bd13ca5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:07.853953 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1366/2737] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:42:07.859227 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e8511-50a3-40ea-82d6-e4d2e5cbee7d None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:07.872965 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e8511-50a3-40ea-82d6-e4d2e5cbee7d None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:07.887941 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88693a05-7d6a-4f6a-81b6-7bacc2897794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:07.888741 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88693a05-7d6a-4f6a-81b6-7bacc2897794 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:07.889174 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88693a05-7d6a-4f6a-81b6-7bacc2897794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:07.889617 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88693a05-7d6a-4f6a-81b6-7bacc2897794 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:07.890867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88693a05-7d6a-4f6a-81b6-7bacc2897794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:42:07.891458 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88693a05-7d6a-4f6a-81b6-7bacc2897794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:07.894152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88693a05-7d6a-4f6a-81b6-7bacc2897794 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:07.930766 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1372/2738] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:42:07.936623 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54874e2b-6d2f-49be-8101-adc5bd13ca5e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:07.959601 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54874e2b-6d2f-49be-8101-adc5bd13ca5e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:07.965437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b336d-b3c9-431b-8c07-a4af6acac187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:07.966143 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b336d-b3c9-431b-8c07-a4af6acac187 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:07.966493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b336d-b3c9-431b-8c07-a4af6acac187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:07.966839 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b336d-b3c9-431b-8c07-a4af6acac187 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:07.968160 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b336d-b3c9-431b-8c07-a4af6acac187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:07.970597 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b336d-b3c9-431b-8c07-a4af6acac187 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:08.079757 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1367/2739] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:42:07 2022] POST /identity/v3/projects => generated 407 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:42:08.083894 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88693a05-7d6a-4f6a-81b6-7bacc2897794 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:08.117626 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88693a05-7d6a-4f6a-81b6-7bacc2897794 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:08.193489 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88266619-4200-4cfb-98f4-9129f725f0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:08.194419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88266619-4200-4cfb-98f4-9129f725f0cf admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:08.195115 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88266619-4200-4cfb-98f4-9129f725f0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:08.195524 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88266619-4200-4cfb-98f4-9129f725f0cf admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:08.196504 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88266619-4200-4cfb-98f4-9129f725f0cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:08.199794 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88266619-4200-4cfb-98f4-9129f725f0cf admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:08.281319 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1373/2740] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:42:08 2022] POST /identity/v3/users => generated 304 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:42:08.286735 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b336d-b3c9-431b-8c07-a4af6acac187 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:08.298896 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b336d-b3c9-431b-8c07-a4af6acac187 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:08.308266 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05a26e-d5ce-4bf0-bba8-9f76c02d0fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:08.309279 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05a26e-d5ce-4bf0-bba8-9f76c02d0fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:08.309665 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05a26e-d5ce-4bf0-bba8-9f76c02d0fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:08.310173 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05a26e-d5ce-4bf0-bba8-9f76c02d0fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:08.313336 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05a26e-d5ce-4bf0-bba8-9f76c02d0fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:08.316102 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe05a26e-d5ce-4bf0-bba8-9f76c02d0fc9 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:08.318937 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:08.339566 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1368/2741] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:42:08.341083 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88266619-4200-4cfb-98f4-9129f725f0cf admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:08.349004 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:08.353839 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88266619-4200-4cfb-98f4-9129f725f0cf admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:08.364278 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a51a34-c3dc-484b-8573-bc7160f08651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:08.365020 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51a34-c3dc-484b-8573-bc7160f08651 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:08.365324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51a34-c3dc-484b-8573-bc7160f08651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:08.365679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51a34-c3dc-484b-8573-bc7160f08651 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:08.366460 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a51a34-c3dc-484b-8573-bc7160f08651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:08.368151 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a51a34-c3dc-484b-8573-bc7160f08651 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:08.384134 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1374/2742] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:42:08.385331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05a26e-d5ce-4bf0-bba8-9f76c02d0fc9 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:08.397583 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05a26e-d5ce-4bf0-bba8-9f76c02d0fc9 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:08.405519 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a75cb-3103-471a-a137-8a7145949129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:08.406295 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a75cb-3103-471a-a137-8a7145949129 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:08.406664 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a75cb-3103-471a-a137-8a7145949129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:08.407021 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a75cb-3103-471a-a137-8a7145949129 admin admin] PATH_INFO: `/v3/projects/aebb456ade10466cbfe333855d4a3810/users/6eecc84e474c49159982b45a94751b98/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:08.426001 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a75cb-3103-471a-a137-8a7145949129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aebb456ade10466cbfe333855d4a3810, user_id=6eecc84e474c49159982b45a94751b98, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:08.430514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a75cb-3103-471a-a137-8a7145949129 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:08.532889 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1369/2743] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:42:08 2022] PUT /identity/v3/projects/aebb456ade10466cbfe333855d4a3810/users/6eecc84e474c49159982b45a94751b98/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:42:08.546389 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d456f4-1468-461e-8617-b31be83a2523 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:08.546693 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d456f4-1468-461e-8617-b31be83a2523 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:08.546920 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d456f4-1468-461e-8617-b31be83a2523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:08.580369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-32d456f4-1468-461e-8617-b31be83a2523 None None] MFA Rules not processed for user `6eecc84e474c49159982b45a94751b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:42:08.581623 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-32d456f4-1468-461e-8617-b31be83a2523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:08.693882 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1375/2744] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:42:08 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:42:08.694755 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a75cb-3103-471a-a137-8a7145949129 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:08.780702 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a75cb-3103-471a-a137-8a7145949129 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:08.785704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c6b1e-9a74-4a6c-af44-10e49305534c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:08.786350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c6b1e-9a74-4a6c-af44-10e49305534c admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:08.786627 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c6b1e-9a74-4a6c-af44-10e49305534c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:08.786898 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c6b1e-9a74-4a6c-af44-10e49305534c admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:08.787578 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c6b1e-9a74-4a6c-af44-10e49305534c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:08.790010 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c6b1e-9a74-4a6c-af44-10e49305534c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:09.048233 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1370/2745] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:42:08 2022] POST /identity/v3/projects => generated 409 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:42:09.052083 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d456f4-1468-461e-8617-b31be83a2523 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:09.065423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d456f4-1468-461e-8617-b31be83a2523 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:09.156268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa64e9-b644-431b-ab64-0ae53f01d4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:09.156985 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa64e9-b644-431b-ab64-0ae53f01d4ae admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:09.157319 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa64e9-b644-431b-ab64-0ae53f01d4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:09.157642 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa64e9-b644-431b-ab64-0ae53f01d4ae admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:09.158430 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa64e9-b644-431b-ab64-0ae53f01d4ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:09.160710 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa64e9-b644-431b-ab64-0ae53f01d4ae admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:09.278892 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1376/2746] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:42:09 2022] POST /identity/v3/users => generated 311 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:42:09.291983 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c6b1e-9a74-4a6c-af44-10e49305534c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:09.305724 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c6b1e-9a74-4a6c-af44-10e49305534c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:09.312585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7ce5f-7a02-4f28-81fa-cc0751249df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:09.313773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7ce5f-7a02-4f28-81fa-cc0751249df6 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:09.314302 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7ce5f-7a02-4f28-81fa-cc0751249df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:09.314817 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7ce5f-7a02-4f28-81fa-cc0751249df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:09.315859 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7ce5f-7a02-4f28-81fa-cc0751249df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:09.317938 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7ce5f-7a02-4f28-81fa-cc0751249df6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:09.333034 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1371/2747] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:42:09.341517 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa64e9-b644-431b-ab64-0ae53f01d4ae admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:09.355662 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa64e9-b644-431b-ab64-0ae53f01d4ae admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:09.362405 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052a7e0-e826-4785-8400-892a4113dd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:09.363374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052a7e0-e826-4785-8400-892a4113dd25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:09.363880 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052a7e0-e826-4785-8400-892a4113dd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:09.364328 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052a7e0-e826-4785-8400-892a4113dd25 admin admin] PATH_INFO: `/v3/projects/86b28638a5514a8a846b5321de0a6ee2/users/f8aff22f77db48ee8632aa3a63d1b068/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:09.397477 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052a7e0-e826-4785-8400-892a4113dd25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b28638a5514a8a846b5321de0a6ee2, user_id=f8aff22f77db48ee8632aa3a63d1b068, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:09.400523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052a7e0-e826-4785-8400-892a4113dd25 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:09.515770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1377/2748] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:42:09 2022] PUT /identity/v3/projects/86b28638a5514a8a846b5321de0a6ee2/users/f8aff22f77db48ee8632aa3a63d1b068/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:42:09.517044 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7ce5f-7a02-4f28-81fa-cc0751249df6 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:09.533795 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7ce5f-7a02-4f28-81fa-cc0751249df6 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:09.608033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579d7b5-d59a-4234-8331-b28eadc26a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:09.609857 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579d7b5-d59a-4234-8331-b28eadc26a10 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:09.610279 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579d7b5-d59a-4234-8331-b28eadc26a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:09.610690 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579d7b5-d59a-4234-8331-b28eadc26a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:09.611668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579d7b5-d59a-4234-8331-b28eadc26a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:09.614706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579d7b5-d59a-4234-8331-b28eadc26a10 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:09.630440 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1372/2749] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:42:09.634661 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052a7e0-e826-4785-8400-892a4113dd25 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:09.645725 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052a7e0-e826-4785-8400-892a4113dd25 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:09.650736 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2a0f1-29f3-42d0-a24b-64b47d70f817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:09.654181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2a0f1-29f3-42d0-a24b-64b47d70f817 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:09.654181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2a0f1-29f3-42d0-a24b-64b47d70f817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:09.654181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2a0f1-29f3-42d0-a24b-64b47d70f817 admin admin] PATH_INFO: `/v3/projects/86b28638a5514a8a846b5321de0a6ee2/users/f8aff22f77db48ee8632aa3a63d1b068/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:09.656963 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2a0f1-29f3-42d0-a24b-64b47d70f817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b28638a5514a8a846b5321de0a6ee2, user_id=f8aff22f77db48ee8632aa3a63d1b068, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:09.659760 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2a0f1-29f3-42d0-a24b-64b47d70f817 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:09.672214 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1378/2750] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:42:09 2022] PUT /identity/v3/projects/86b28638a5514a8a846b5321de0a6ee2/users/f8aff22f77db48ee8632aa3a63d1b068/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:42:09.684397 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb9fba-f661-4821-a602-597003a2a31c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:09.684685 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb9fba-f661-4821-a602-597003a2a31c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:09.684992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb9fba-f661-4821-a602-597003a2a31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:09.720730 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-45eb9fba-f661-4821-a602-597003a2a31c None None] MFA Rules not processed for user `f8aff22f77db48ee8632aa3a63d1b068`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:42:09.722022 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-45eb9fba-f661-4821-a602-597003a2a31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:09.761332 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:09.806518 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1373/2751] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:42:09 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:42:09.843568 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2a0f1-29f3-42d0-a24b-64b47d70f817 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:09.845480 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0ba2a0f1-29f3-42d0-a24b-64b47d70f817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:09.895351 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:09.913739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2a0f1-29f3-42d0-a24b-64b47d70f817 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:09.917656 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7c719-e335-4e16-b5bd-f15a3c7479fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:09.918261 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7c719-e335-4e16-b5bd-f15a3c7479fc service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:09.918534 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7c719-e335-4e16-b5bd-f15a3c7479fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:09.918815 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7c719-e335-4e16-b5bd-f15a3c7479fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:09.932735 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7c719-e335-4e16-b5bd-f15a3c7479fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:09.934411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7c719-e335-4e16-b5bd-f15a3c7479fc service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:09.945523 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1379/2752] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:42:09 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:42:10.406599 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb9fba-f661-4821-a602-597003a2a31c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:10.416438 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb9fba-f661-4821-a602-597003a2a31c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:10.419976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53f15e-69ba-43a2-8eb0-f48719afdc84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:10.420691 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53f15e-69ba-43a2-8eb0-f48719afdc84 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:10.421608 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53f15e-69ba-43a2-8eb0-f48719afdc84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:10.421960 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53f15e-69ba-43a2-8eb0-f48719afdc84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:10.490606 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53f15e-69ba-43a2-8eb0-f48719afdc84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:10.492093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53f15e-69ba-43a2-8eb0-f48719afdc84 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:10.502376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1374/2753] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:42:10 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:42:16.690402 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d929ef4-96ea-4d85-83f7-6c25eb9dabf3 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:16.690924 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d929ef4-96ea-4d85-83f7-6c25eb9dabf3 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:16.691034 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d929ef4-96ea-4d85-83f7-6c25eb9dabf3 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:16.692562 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1380/2754] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 5 14:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:42:16.699271 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70869051-eedc-4a87-b941-edcecdeb526c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:16.699823 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70869051-eedc-4a87-b941-edcecdeb526c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:16.699823 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70869051-eedc-4a87-b941-edcecdeb526c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:16.723456 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-70869051-eedc-4a87-b941-edcecdeb526c None None] MFA Rules not processed for user `b0ec118e5a114429b3e1c91041f7caf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:42:16.725388 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-70869051-eedc-4a87-b941-edcecdeb526c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:16.779656 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1375/2755] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 5 14:42:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:42:16.792549 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d929ef4-96ea-4d85-83f7-6c25eb9dabf3 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:16.794358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9d929ef4-96ea-4d85-83f7-6c25eb9dabf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:16.808583 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d929ef4-96ea-4d85-83f7-6c25eb9dabf3 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:16.812671 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb59bd4-cf1e-464a-a28b-2b022ad72061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:16.813301 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb59bd4-cf1e-464a-a28b-2b022ad72061 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:16.813576 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb59bd4-cf1e-464a-a28b-2b022ad72061 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:16.813873 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb59bd4-cf1e-464a-a28b-2b022ad72061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:16.821938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb59bd4-cf1e-464a-a28b-2b022ad72061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:16.823749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb59bd4-cf1e-464a-a28b-2b022ad72061 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:16.833004 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1381/2756] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:42:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:42:16.918993 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66627c4c-ff02-4366-b655-090d0b56a8c5 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:16.919280 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66627c4c-ff02-4366-b655-090d0b56a8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:16.919557 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66627c4c-ff02-4366-b655-090d0b56a8c5 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:16.922214 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1376/2757] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 5 14:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:42:16.927914 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ddc83-6bfc-40fc-97a2-a2daefa6cc73 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:16.928241 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ddc83-6bfc-40fc-97a2-a2daefa6cc73 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:16.928500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ddc83-6bfc-40fc-97a2-a2daefa6cc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:16.949402 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-807ddc83-6bfc-40fc-97a2-a2daefa6cc73 None None] MFA Rules not processed for user `d5515accf3b64006bc41422265a641bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:42:16.950651 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-807ddc83-6bfc-40fc-97a2-a2daefa6cc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:17.021714 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1382/2758] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 5 14:42:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:42:17.037156 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66627c4c-ff02-4366-b655-090d0b56a8c5 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:17.044989 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66627c4c-ff02-4366-b655-090d0b56a8c5 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:17.049491 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823efdd0-06e8-4de3-8dc1-731007874975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:17.050115 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823efdd0-06e8-4de3-8dc1-731007874975 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:17.050393 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823efdd0-06e8-4de3-8dc1-731007874975 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:17.050681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823efdd0-06e8-4de3-8dc1-731007874975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:17.062057 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823efdd0-06e8-4de3-8dc1-731007874975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:17.063499 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823efdd0-06e8-4de3-8dc1-731007874975 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:17.075692 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1377/2759] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:42:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:42:17.620548 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd955074-a5e8-4981-9525-9673899177dd None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:17.620842 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd955074-a5e8-4981-9525-9673899177dd None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:17.621152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd955074-a5e8-4981-9525-9673899177dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:17.644256 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-fd955074-a5e8-4981-9525-9673899177dd None None] MFA Rules not processed for user `635e47d0a5a34fdfb5c8967a96a87828`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:42:17.645573 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fd955074-a5e8-4981-9525-9673899177dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:17.706462 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1383/2760] 10.222.0.23 () {58 vars in 967 bytes} [Mon Sep 5 14:42:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:42:17.718979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823efdd0-06e8-4de3-8dc1-731007874975 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:17.720426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-823efdd0-06e8-4de3-8dc1-731007874975 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:17.797378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:17.803565 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823efdd0-06e8-4de3-8dc1-731007874975 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:17.808934 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb055df1-667e-486c-8523-762fd8b9217f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed60e9eecb94ef39c2f4a5e5f50d670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:17.809727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb055df1-667e-486c-8523-762fd8b9217f service swift] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:17.810015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb055df1-667e-486c-8523-762fd8b9217f service swift] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:17.810272 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb055df1-667e-486c-8523-762fd8b9217f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:17.819840 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb055df1-667e-486c-8523-762fd8b9217f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:17.821750 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb055df1-667e-486c-8523-762fd8b9217f service swift] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:17.830743 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1378/2761] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 5 14:42:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 14:42:19.106502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd955074-a5e8-4981-9525-9673899177dd None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:19.178373 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd955074-a5e8-4981-9525-9673899177dd None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:19.182987 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659d74e-3612-4228-bd3e-223411ce8f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:19.183672 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659d74e-3612-4228-bd3e-223411ce8f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:19.183952 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659d74e-3612-4228-bd3e-223411ce8f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:19.184226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659d74e-3612-4228-bd3e-223411ce8f0e admin admin] PATH_INFO: `/v3/users/6eecc84e474c49159982b45a94751b98` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:19.185406 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659d74e-3612-4228-bd3e-223411ce8f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eecc84e474c49159982b45a94751b98)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:19.187863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659d74e-3612-4228-bd3e-223411ce8f0e admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:19.190784 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:19.355484 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1659d74e-3612-4228-bd3e-223411ce8f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eecc84e474c49159982b45a94751b98'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:19.411181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1659d74e-3612-4228-bd3e-223411ce8f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eecc84e474c49159982b45a94751b98'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:19.426187 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1659d74e-3612-4228-bd3e-223411ce8f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eecc84e474c49159982b45a94751b98'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:19.426950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1659d74e-3612-4228-bd3e-223411ce8f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eecc84e474c49159982b45a94751b98'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:19.434385 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1659d74e-3612-4228-bd3e-223411ce8f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eecc84e474c49159982b45a94751b98'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:19.442321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1384/2762] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:42:19 2022] DELETE /identity/v3/users/6eecc84e474c49159982b45a94751b98 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:42:19.446829 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133cd35-da90-41cb-93d9-839c643bb916 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:19.447376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133cd35-da90-41cb-93d9-839c643bb916 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:19.447376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133cd35-da90-41cb-93d9-839c643bb916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:19.469789 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3133cd35-da90-41cb-93d9-839c643bb916 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:42:19.471223 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3133cd35-da90-41cb-93d9-839c643bb916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:19.542764 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1379/2763] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:42:19.553883 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659d74e-3612-4228-bd3e-223411ce8f0e admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:19.555395 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1659d74e-3612-4228-bd3e-223411ce8f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:19.615608 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659d74e-3612-4228-bd3e-223411ce8f0e admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:19.619211 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ca063-39a4-4533-b1dc-b998e0fd9d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:19.619818 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ca063-39a4-4533-b1dc-b998e0fd9d91 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:19.620099 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ca063-39a4-4533-b1dc-b998e0fd9d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:19.620374 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ca063-39a4-4533-b1dc-b998e0fd9d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:19.630277 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ca063-39a4-4533-b1dc-b998e0fd9d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:19.631723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ca063-39a4-4533-b1dc-b998e0fd9d91 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:19.642480 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1385/2764] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:42:20.145384 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133cd35-da90-41cb-93d9-839c643bb916 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:20.146802 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3133cd35-da90-41cb-93d9-839c643bb916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:20.161232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133cd35-da90-41cb-93d9-839c643bb916 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:20.166418 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f9a9f-6eae-416b-b6ac-aae384bf2b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:20.167414 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f9a9f-6eae-416b-b6ac-aae384bf2b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:20.167933 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f9a9f-6eae-416b-b6ac-aae384bf2b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:20.168458 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f9a9f-6eae-416b-b6ac-aae384bf2b2d admin admin] PATH_INFO: `/v3/projects/aebb456ade10466cbfe333855d4a3810` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:20.169813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f9a9f-6eae-416b-b6ac-aae384bf2b2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aebb456ade10466cbfe333855d4a3810)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:20.172349 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f9a9f-6eae-416b-b6ac-aae384bf2b2d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:20.283093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-351f9a9f-6eae-416b-b6ac-aae384bf2b2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aebb456ade10466cbfe333855d4a3810', 'request_id': 'req-351f9a9f-6eae-416b-b6ac-aae384bf2b2d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:20.289141 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-351f9a9f-6eae-416b-b6ac-aae384bf2b2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aebb456ade10466cbfe333855d4a3810', 'request_id': 'req-351f9a9f-6eae-416b-b6ac-aae384bf2b2d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:20.351335 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-351f9a9f-6eae-416b-b6ac-aae384bf2b2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aebb456ade10466cbfe333855d4a3810', 'request_id': 'req-351f9a9f-6eae-416b-b6ac-aae384bf2b2d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:20.365573 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-351f9a9f-6eae-416b-b6ac-aae384bf2b2d admin admin] The token cache is being invalidate because project aebb456ade10466cbfe333855d4a3810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:42:20.366146 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-351f9a9f-6eae-416b-b6ac-aae384bf2b2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:20.367192 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-351f9a9f-6eae-416b-b6ac-aae384bf2b2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:20.369580 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1380/2765] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:42:20 2022] DELETE /identity/v3/projects/aebb456ade10466cbfe333855d4a3810 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:42:20.375611 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ca063-39a4-4533-b1dc-b998e0fd9d91 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:20.386723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ca063-39a4-4533-b1dc-b998e0fd9d91 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:20.449477 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559a55f-06af-4340-aae9-510854a20c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:20.450236 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559a55f-06af-4340-aae9-510854a20c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:20.450521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559a55f-06af-4340-aae9-510854a20c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:20.450798 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559a55f-06af-4340-aae9-510854a20c5c admin admin] PATH_INFO: `/v3/users/f8aff22f77db48ee8632aa3a63d1b068` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:20.452636 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559a55f-06af-4340-aae9-510854a20c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8aff22f77db48ee8632aa3a63d1b068)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:20.454625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559a55f-06af-4340-aae9-510854a20c5c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:20.564533 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:20.718892 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-3559a55f-06af-4340-aae9-510854a20c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8aff22f77db48ee8632aa3a63d1b068'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:20.805391 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-3559a55f-06af-4340-aae9-510854a20c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8aff22f77db48ee8632aa3a63d1b068'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:20.822582 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-3559a55f-06af-4340-aae9-510854a20c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8aff22f77db48ee8632aa3a63d1b068'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:20.823344 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-3559a55f-06af-4340-aae9-510854a20c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8aff22f77db48ee8632aa3a63d1b068'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:20.831866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-3559a55f-06af-4340-aae9-510854a20c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8aff22f77db48ee8632aa3a63d1b068'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:20.838639 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1386/2766] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:42:20 2022] DELETE /identity/v3/users/f8aff22f77db48ee8632aa3a63d1b068 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:42:21.253381 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f9a9f-6eae-416b-b6ac-aae384bf2b2d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:21.256062 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-351f9a9f-6eae-416b-b6ac-aae384bf2b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:21.268615 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f9a9f-6eae-416b-b6ac-aae384bf2b2d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:21.331374 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7a182-8c19-4922-9319-ea38f39230c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:21.332035 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7a182-8c19-4922-9319-ea38f39230c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:21.332317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7a182-8c19-4922-9319-ea38f39230c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:21.332591 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7a182-8c19-4922-9319-ea38f39230c2 admin admin] PATH_INFO: `/v3/projects/86b28638a5514a8a846b5321de0a6ee2` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:21.333760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7a182-8c19-4922-9319-ea38f39230c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86b28638a5514a8a846b5321de0a6ee2)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:21.335660 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7a182-8c19-4922-9319-ea38f39230c2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:21.353939 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:21.471756 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f2e7a182-8c19-4922-9319-ea38f39230c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b28638a5514a8a846b5321de0a6ee2', 'request_id': 'req-f2e7a182-8c19-4922-9319-ea38f39230c2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:21.478044 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f2e7a182-8c19-4922-9319-ea38f39230c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b28638a5514a8a846b5321de0a6ee2', 'request_id': 'req-f2e7a182-8c19-4922-9319-ea38f39230c2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:21.571484 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f2e7a182-8c19-4922-9319-ea38f39230c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b28638a5514a8a846b5321de0a6ee2', 'request_id': 'req-f2e7a182-8c19-4922-9319-ea38f39230c2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:21.586048 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f2e7a182-8c19-4922-9319-ea38f39230c2 admin admin] The token cache is being invalidate because project 86b28638a5514a8a846b5321de0a6ee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:42:21.586048 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f2e7a182-8c19-4922-9319-ea38f39230c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:21.586048 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f2e7a182-8c19-4922-9319-ea38f39230c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:21.587091 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1381/2767] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:42:21 2022] DELETE /identity/v3/projects/86b28638a5514a8a846b5321de0a6ee2 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:42:21.593252 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d78df3-1c08-4188-974d-aa11b9f7c775 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:21.593932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d78df3-1c08-4188-974d-aa11b9f7c775 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:21.593932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d78df3-1c08-4188-974d-aa11b9f7c775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:21.616275 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-e7d78df3-1c08-4188-974d-aa11b9f7c775 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:42:21.617526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e7d78df3-1c08-4188-974d-aa11b9f7c775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:21.678217 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1387/2768] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:42:21.685987 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f2990-1a2f-4df0-9c23-fe2a7cd7e724 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:21.686428 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f2990-1a2f-4df0-9c23-fe2a7cd7e724 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:21.686788 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f2990-1a2f-4df0-9c23-fe2a7cd7e724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:21.707705 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ec2f2990-1a2f-4df0-9c23-fe2a7cd7e724 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:42:21.708910 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ec2f2990-1a2f-4df0-9c23-fe2a7cd7e724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:21.716908 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1382/2769] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:42:21.721963 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d78df3-1c08-4188-974d-aa11b9f7c775 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:21.731565 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d78df3-1c08-4188-974d-aa11b9f7c775 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:21.736139 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5803a-6796-43f4-830a-582ce271cb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:21.736719 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5803a-6796-43f4-830a-582ce271cb35 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:21.736990 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5803a-6796-43f4-830a-582ce271cb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:21.737285 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5803a-6796-43f4-830a-582ce271cb35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:21.737921 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5803a-6796-43f4-830a-582ce271cb35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:42:21.738212 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5803a-6796-43f4-830a-582ce271cb35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:21.739802 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5803a-6796-43f4-830a-582ce271cb35 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:21.751676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1388/2770] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:42:21.756242 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f2990-1a2f-4df0-9c23-fe2a7cd7e724 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:21.767086 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f2990-1a2f-4df0-9c23-fe2a7cd7e724 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:21.771959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4413840-8def-49c4-81ec-7e393822fffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:21.772592 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4413840-8def-49c4-81ec-7e393822fffc admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:21.772838 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4413840-8def-49c4-81ec-7e393822fffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:21.773154 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4413840-8def-49c4-81ec-7e393822fffc admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:21.774016 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4413840-8def-49c4-81ec-7e393822fffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:21.775931 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4413840-8def-49c4-81ec-7e393822fffc admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:21.876391 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1383/2771] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:42:21 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:42:21.880846 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5803a-6796-43f4-830a-582ce271cb35 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:21.891786 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5803a-6796-43f4-830a-582ce271cb35 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:21.950714 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c8087-25be-4d16-8ba0-bacc9d21f10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:21.951324 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c8087-25be-4d16-8ba0-bacc9d21f10b admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:21.951601 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c8087-25be-4d16-8ba0-bacc9d21f10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:21.951872 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c8087-25be-4d16-8ba0-bacc9d21f10b admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:21.952507 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c8087-25be-4d16-8ba0-bacc9d21f10b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:21.954478 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c8087-25be-4d16-8ba0-bacc9d21f10b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:22.034798 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1389/2772] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:42:21 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:42:22.039207 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4413840-8def-49c4-81ec-7e393822fffc admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:22.050189 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4413840-8def-49c4-81ec-7e393822fffc admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:22.054899 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f4a35-eefd-4f5b-bc28-f8457add23e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:22.055519 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f4a35-eefd-4f5b-bc28-f8457add23e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:22.055796 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f4a35-eefd-4f5b-bc28-f8457add23e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:22.056070 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f4a35-eefd-4f5b-bc28-f8457add23e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:22.056710 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f4a35-eefd-4f5b-bc28-f8457add23e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:22.058353 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f4a35-eefd-4f5b-bc28-f8457add23e4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:22.069580 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1384/2773] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:42:22.073993 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c8087-25be-4d16-8ba0-bacc9d21f10b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:22.085175 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c8087-25be-4d16-8ba0-bacc9d21f10b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:22.090242 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d27033-d2c5-4954-a272-096028ae8a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:22.090850 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d27033-d2c5-4954-a272-096028ae8a5d admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:22.091124 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d27033-d2c5-4954-a272-096028ae8a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:22.091388 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d27033-d2c5-4954-a272-096028ae8a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:22.092046 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d27033-d2c5-4954-a272-096028ae8a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:22.094076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d27033-d2c5-4954-a272-096028ae8a5d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:22.105762 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1390/2774] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:42:22.110310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f4a35-eefd-4f5b-bc28-f8457add23e4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:22.120891 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f4a35-eefd-4f5b-bc28-f8457add23e4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:22.126317 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1ad76-24e1-45ad-b920-e9e1f4db8b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:22.129046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1ad76-24e1-45ad-b920-e9e1f4db8b0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:22.129046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1ad76-24e1-45ad-b920-e9e1f4db8b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:22.129046 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1ad76-24e1-45ad-b920-e9e1f4db8b0b admin admin] PATH_INFO: `/v3/projects/1c2bd0c6878648388a9e35ced7739eb9/users/0a0e63a94d7348b5813af0c1d6b0ed6c/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:22.144475 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1ad76-24e1-45ad-b920-e9e1f4db8b0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c2bd0c6878648388a9e35ced7739eb9, user_id=0a0e63a94d7348b5813af0c1d6b0ed6c, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:22.147164 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1ad76-24e1-45ad-b920-e9e1f4db8b0b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:22.297067 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1385/2775] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:42:22 2022] PUT /identity/v3/projects/1c2bd0c6878648388a9e35ced7739eb9/users/0a0e63a94d7348b5813af0c1d6b0ed6c/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:42:22.317749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767a90b-d630-4014-88d6-969159047826 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:22.318037 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767a90b-d630-4014-88d6-969159047826 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:22.318312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767a90b-d630-4014-88d6-969159047826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:22.339148 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:22.348658 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-8767a90b-d630-4014-88d6-969159047826 None None] MFA Rules not processed for user `0a0e63a94d7348b5813af0c1d6b0ed6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:42:22.350009 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8767a90b-d630-4014-88d6-969159047826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:22.420036 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1391/2776] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:42:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:42:22.424567 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1ad76-24e1-45ad-b920-e9e1f4db8b0b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:22.490849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1ad76-24e1-45ad-b920-e9e1f4db8b0b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:22.495511 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6a3b4-9137-4939-b3e4-74fb9a5e7481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:22.496229 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6a3b4-9137-4939-b3e4-74fb9a5e7481 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:22.496512 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6a3b4-9137-4939-b3e4-74fb9a5e7481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:22.496785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6a3b4-9137-4939-b3e4-74fb9a5e7481 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:22.497443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6a3b4-9137-4939-b3e4-74fb9a5e7481 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:22.499901 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6a3b4-9137-4939-b3e4-74fb9a5e7481 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:22.598795 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1386/2777] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:42:22 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:42:22.603052 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767a90b-d630-4014-88d6-969159047826 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:22.616068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767a90b-d630-4014-88d6-969159047826 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:22.680341 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b40f5-5163-4b72-80be-c0e63b18c8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:22.680887 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b40f5-5163-4b72-80be-c0e63b18c8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:22.681199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b40f5-5163-4b72-80be-c0e63b18c8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:22.681475 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b40f5-5163-4b72-80be-c0e63b18c8f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:22.682560 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b40f5-5163-4b72-80be-c0e63b18c8f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:22.684864 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b40f5-5163-4b72-80be-c0e63b18c8f9 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:22.775219 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1392/2778] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:42:22 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:42:22.776584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6a3b4-9137-4939-b3e4-74fb9a5e7481 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:22.789176 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6a3b4-9137-4939-b3e4-74fb9a5e7481 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:22.794175 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df263139-002d-49f0-baa1-153f20f68bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:22.794799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df263139-002d-49f0-baa1-153f20f68bff admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:22.795072 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df263139-002d-49f0-baa1-153f20f68bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:22.795350 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df263139-002d-49f0-baa1-153f20f68bff admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:22.796320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df263139-002d-49f0-baa1-153f20f68bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:22.797982 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df263139-002d-49f0-baa1-153f20f68bff admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:22.813094 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1387/2779] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:42:22.815261 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b40f5-5163-4b72-80be-c0e63b18c8f9 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:22.826303 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b40f5-5163-4b72-80be-c0e63b18c8f9 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:22.831997 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1665507-1dbd-4f85-8fb7-85f99d9da5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:22.832676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1665507-1dbd-4f85-8fb7-85f99d9da5ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:22.833000 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1665507-1dbd-4f85-8fb7-85f99d9da5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:22.833356 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1665507-1dbd-4f85-8fb7-85f99d9da5ad admin admin] PATH_INFO: `/v3/projects/6e08766a55c143c9a1cbd3a95f9350ec/users/48e0a990f5fc4822a65700208ba8181d/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:22.852433 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1665507-1dbd-4f85-8fb7-85f99d9da5ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e08766a55c143c9a1cbd3a95f9350ec, user_id=48e0a990f5fc4822a65700208ba8181d, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:22.855394 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1665507-1dbd-4f85-8fb7-85f99d9da5ad admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:22.943249 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1393/2780] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:42:22 2022] PUT /identity/v3/projects/6e08766a55c143c9a1cbd3a95f9350ec/users/48e0a990f5fc4822a65700208ba8181d/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:42:22.947249 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df263139-002d-49f0-baa1-153f20f68bff admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:22.959152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df263139-002d-49f0-baa1-153f20f68bff admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:22.981534 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:23.028414 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755dccc-dbf4-4000-83f3-1342aae60e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:23.029011 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755dccc-dbf4-4000-83f3-1342aae60e3c admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:23.029324 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755dccc-dbf4-4000-83f3-1342aae60e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:23.029597 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755dccc-dbf4-4000-83f3-1342aae60e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:23.030763 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755dccc-dbf4-4000-83f3-1342aae60e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:23.032351 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755dccc-dbf4-4000-83f3-1342aae60e3c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:23.042167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1388/2781] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:42:23.047506 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1665507-1dbd-4f85-8fb7-85f99d9da5ad admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:23.057724 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1665507-1dbd-4f85-8fb7-85f99d9da5ad admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:23.062854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf66ed8-20ef-4db7-8bb6-f3f812e15205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:23.063494 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf66ed8-20ef-4db7-8bb6-f3f812e15205 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:23.064550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf66ed8-20ef-4db7-8bb6-f3f812e15205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:23.064550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf66ed8-20ef-4db7-8bb6-f3f812e15205 admin admin] PATH_INFO: `/v3/projects/6e08766a55c143c9a1cbd3a95f9350ec/users/48e0a990f5fc4822a65700208ba8181d/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:23.066048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf66ed8-20ef-4db7-8bb6-f3f812e15205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e08766a55c143c9a1cbd3a95f9350ec, user_id=48e0a990f5fc4822a65700208ba8181d, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:23.068680 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf66ed8-20ef-4db7-8bb6-f3f812e15205 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:23.081605 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1394/2782] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:42:23 2022] PUT /identity/v3/projects/6e08766a55c143c9a1cbd3a95f9350ec/users/48e0a990f5fc4822a65700208ba8181d/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:42:23.094143 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad965259-c38c-4f15-ae80-39a1af9180a7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:23.094447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad965259-c38c-4f15-ae80-39a1af9180a7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:23.094695 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad965259-c38c-4f15-ae80-39a1af9180a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:23.124927 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ad965259-c38c-4f15-ae80-39a1af9180a7 None None] MFA Rules not processed for user `48e0a990f5fc4822a65700208ba8181d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:42:23.126206 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ad965259-c38c-4f15-ae80-39a1af9180a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:23.199367 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1389/2783] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:42:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:42:23.211778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf66ed8-20ef-4db7-8bb6-f3f812e15205 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:23.213618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-abf66ed8-20ef-4db7-8bb6-f3f812e15205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:23.274141 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf66ed8-20ef-4db7-8bb6-f3f812e15205 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:23.277753 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329b478-ea3b-4489-8daf-b5474d0c024e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:23.278350 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329b478-ea3b-4489-8daf-b5474d0c024e service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:23.278624 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329b478-ea3b-4489-8daf-b5474d0c024e service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:23.278888 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329b478-ea3b-4489-8daf-b5474d0c024e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:23.283918 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:23.341178 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329b478-ea3b-4489-8daf-b5474d0c024e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:23.344069 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329b478-ea3b-4489-8daf-b5474d0c024e service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:23.353850 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1395/2784] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:42:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:42:26.653177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad965259-c38c-4f15-ae80-39a1af9180a7 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:26.720047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad965259-c38c-4f15-ae80-39a1af9180a7 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:26.724566 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cabb9e-42a3-4db2-a04e-87346c639e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:26.725232 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cabb9e-42a3-4db2-a04e-87346c639e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:26.725510 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cabb9e-42a3-4db2-a04e-87346c639e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:26.725783 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cabb9e-42a3-4db2-a04e-87346c639e28 admin admin] PATH_INFO: `/v3/users/0a0e63a94d7348b5813af0c1d6b0ed6c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:26.726981 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cabb9e-42a3-4db2-a04e-87346c639e28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0e63a94d7348b5813af0c1d6b0ed6c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:26.728892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cabb9e-42a3-4db2-a04e-87346c639e28 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:26.962196 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:26.968378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-72cabb9e-42a3-4db2-a04e-87346c639e28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0e63a94d7348b5813af0c1d6b0ed6c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:26.969128 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-72cabb9e-42a3-4db2-a04e-87346c639e28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0e63a94d7348b5813af0c1d6b0ed6c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:27.085319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-72cabb9e-42a3-4db2-a04e-87346c639e28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0e63a94d7348b5813af0c1d6b0ed6c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:27.099047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-72cabb9e-42a3-4db2-a04e-87346c639e28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0e63a94d7348b5813af0c1d6b0ed6c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:27.099763 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-72cabb9e-42a3-4db2-a04e-87346c639e28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0e63a94d7348b5813af0c1d6b0ed6c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:27.112986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1390/2785] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:42:26 2022] DELETE /identity/v3/users/0a0e63a94d7348b5813af0c1d6b0ed6c => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:42:27.117271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06017b81-1ece-433d-88e9-ffe5c5e5b9f5 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:27.117760 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06017b81-1ece-433d-88e9-ffe5c5e5b9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:27.117858 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06017b81-1ece-433d-88e9-ffe5c5e5b9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:27.137547 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-06017b81-1ece-433d-88e9-ffe5c5e5b9f5 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:42:27.138750 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-06017b81-1ece-433d-88e9-ffe5c5e5b9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:27.201541 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1396/2786] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:42:27.211886 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cabb9e-42a3-4db2-a04e-87346c639e28 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:27.213422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-72cabb9e-42a3-4db2-a04e-87346c639e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:27.273945 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cabb9e-42a3-4db2-a04e-87346c639e28 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:27.277500 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fab85-4bcb-4206-8a72-cfd050245075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:27.278095 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fab85-4bcb-4206-8a72-cfd050245075 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:27.278375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fab85-4bcb-4206-8a72-cfd050245075 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:27.278642 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fab85-4bcb-4206-8a72-cfd050245075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:27.288443 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fab85-4bcb-4206-8a72-cfd050245075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:27.290003 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fab85-4bcb-4206-8a72-cfd050245075 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:27.300359 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1391/2787] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:42:27.760223 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06017b81-1ece-433d-88e9-ffe5c5e5b9f5 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:27.766327 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-06017b81-1ece-433d-88e9-ffe5c5e5b9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:27.793670 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06017b81-1ece-433d-88e9-ffe5c5e5b9f5 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:27.804654 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3581b-edb8-471a-b35b-a571ae5928d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:27.804654 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3581b-edb8-471a-b35b-a571ae5928d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:27.804654 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3581b-edb8-471a-b35b-a571ae5928d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:27.804654 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3581b-edb8-471a-b35b-a571ae5928d5 admin admin] PATH_INFO: `/v3/projects/1c2bd0c6878648388a9e35ced7739eb9` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:27.805483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3581b-edb8-471a-b35b-a571ae5928d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c2bd0c6878648388a9e35ced7739eb9)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:27.805483 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3581b-edb8-471a-b35b-a571ae5928d5 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:27.913860 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b6e3581b-edb8-471a-b35b-a571ae5928d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c2bd0c6878648388a9e35ced7739eb9', 'request_id': 'req-b6e3581b-edb8-471a-b35b-a571ae5928d5'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:27.919494 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b6e3581b-edb8-471a-b35b-a571ae5928d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c2bd0c6878648388a9e35ced7739eb9', 'request_id': 'req-b6e3581b-edb8-471a-b35b-a571ae5928d5'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:28.031910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b6e3581b-edb8-471a-b35b-a571ae5928d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c2bd0c6878648388a9e35ced7739eb9', 'request_id': 'req-b6e3581b-edb8-471a-b35b-a571ae5928d5'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:28.044824 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b6e3581b-edb8-471a-b35b-a571ae5928d5 admin admin] The token cache is being invalidate because project 1c2bd0c6878648388a9e35ced7739eb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:42:28.045267 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b6e3581b-edb8-471a-b35b-a571ae5928d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:28.046023 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b6e3581b-edb8-471a-b35b-a571ae5928d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:28.048210 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1397/2788] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:42:27 2022] DELETE /identity/v3/projects/1c2bd0c6878648388a9e35ced7739eb9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:42:28.052229 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fab85-4bcb-4206-8a72-cfd050245075 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:28.062602 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fab85-4bcb-4206-8a72-cfd050245075 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:28.123832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af5d22-32b1-4a61-baec-6b64c4ebff3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:28.124455 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af5d22-32b1-4a61-baec-6b64c4ebff3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:28.124731 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af5d22-32b1-4a61-baec-6b64c4ebff3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:28.125085 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af5d22-32b1-4a61-baec-6b64c4ebff3a admin admin] PATH_INFO: `/v3/users/48e0a990f5fc4822a65700208ba8181d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:28.126202 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af5d22-32b1-4a61-baec-6b64c4ebff3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=48e0a990f5fc4822a65700208ba8181d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:28.128105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af5d22-32b1-4a61-baec-6b64c4ebff3a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:28.428167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-77af5d22-32b1-4a61-baec-6b64c4ebff3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e0a990f5fc4822a65700208ba8181d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:28.428827 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-77af5d22-32b1-4a61-baec-6b64c4ebff3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e0a990f5fc4822a65700208ba8181d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:28.517898 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-77af5d22-32b1-4a61-baec-6b64c4ebff3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e0a990f5fc4822a65700208ba8181d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:28.524113 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:28.531239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-77af5d22-32b1-4a61-baec-6b64c4ebff3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e0a990f5fc4822a65700208ba8181d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:28.533321 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-77af5d22-32b1-4a61-baec-6b64c4ebff3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e0a990f5fc4822a65700208ba8181d'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:28.545585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1392/2789] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:42:28 2022] DELETE /identity/v3/users/48e0a990f5fc4822a65700208ba8181d => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:42:29.072133 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3581b-edb8-471a-b35b-a571ae5928d5 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:29.072133 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b6e3581b-edb8-471a-b35b-a571ae5928d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:29.088677 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3581b-edb8-471a-b35b-a571ae5928d5 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:29.120141 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:29.161733 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567cd04-d38f-486b-b85e-29a0a2253396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:29.162663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567cd04-d38f-486b-b85e-29a0a2253396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:29.163082 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567cd04-d38f-486b-b85e-29a0a2253396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:29.163524 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567cd04-d38f-486b-b85e-29a0a2253396 admin admin] PATH_INFO: `/v3/projects/6e08766a55c143c9a1cbd3a95f9350ec` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:29.165254 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567cd04-d38f-486b-b85e-29a0a2253396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e08766a55c143c9a1cbd3a95f9350ec)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:29.168322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567cd04-d38f-486b-b85e-29a0a2253396 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:29.302512 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5567cd04-d38f-486b-b85e-29a0a2253396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e08766a55c143c9a1cbd3a95f9350ec', 'request_id': 'req-5567cd04-d38f-486b-b85e-29a0a2253396'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:29.308508 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5567cd04-d38f-486b-b85e-29a0a2253396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e08766a55c143c9a1cbd3a95f9350ec', 'request_id': 'req-5567cd04-d38f-486b-b85e-29a0a2253396'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:29.416711 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5567cd04-d38f-486b-b85e-29a0a2253396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e08766a55c143c9a1cbd3a95f9350ec', 'request_id': 'req-5567cd04-d38f-486b-b85e-29a0a2253396'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:29.429691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5567cd04-d38f-486b-b85e-29a0a2253396 admin admin] The token cache is being invalidate because project 6e08766a55c143c9a1cbd3a95f9350ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:42:29.429981 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5567cd04-d38f-486b-b85e-29a0a2253396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:29.430630 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5567cd04-d38f-486b-b85e-29a0a2253396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:42:29.432151 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1398/2790] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:42:29 2022] DELETE /identity/v3/projects/6e08766a55c143c9a1cbd3a95f9350ec => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:42:38.820967 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=9,keystone:DELETE=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:39.426572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=38,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:58.451417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af5d22-32b1-4a61-baec-6b64c4ebff3a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:42:58.452919 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-77af5d22-32b1-4a61-baec-6b64c4ebff3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:58.624173 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af5d22-32b1-4a61-baec-6b64c4ebff3a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:42:58.687062 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004262e-2ec0-4177-9894-e10ee5bc164d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1880dab32fa424a9356b3fe940d4856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:42:58.687680 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004262e-2ec0-4177-9894-e10ee5bc164d service placement] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:42:58.687964 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004262e-2ec0-4177-9894-e10ee5bc164d service placement] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:42:58.688241 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004262e-2ec0-4177-9894-e10ee5bc164d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:42:58.690028 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3004262e-2ec0-4177-9894-e10ee5bc164d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:42:58.703177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004262e-2ec0-4177-9894-e10ee5bc164d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:42:58.704790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004262e-2ec0-4177-9894-e10ee5bc164d service placement] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:42:58.716553 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1393/2791] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:42:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:43:02.923543 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8de31c-bd72-41dc-9472-dde44b62f097 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:43:02.924043 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8de31c-bd72-41dc-9472-dde44b62f097 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:43:02.924149 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8de31c-bd72-41dc-9472-dde44b62f097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:43:02.943690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-fd8de31c-bd72-41dc-9472-dde44b62f097 None None] MFA Rules not processed for user `fce888a3a8f24ee8a10e32b030bbd56b`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:43:02.944935 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fd8de31c-bd72-41dc-9472-dde44b62f097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:43:03.008134 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1399/2792] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:43:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:43:08.710960 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:43:13.001667 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=25 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:00.406427 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004262e-2ec0-4177-9894-e10ee5bc164d service placement] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:44:00.407889 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3004262e-2ec0-4177-9894-e10ee5bc164d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:44:00.516128 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004262e-2ec0-4177-9894-e10ee5bc164d service placement] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:44:00.521118 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274d351-1450-4020-a003-794e5d0eb5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:44:00.521894 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274d351-1450-4020-a003-794e5d0eb5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:44:00.522207 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274d351-1450-4020-a003-794e5d0eb5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:44:00.522477 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274d351-1450-4020-a003-794e5d0eb5e7 admin admin] PATH_INFO: `/v3/users/1e78f25687db42f891d5fccdfe2ecf4f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:44:00.523614 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274d351-1450-4020-a003-794e5d0eb5e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e78f25687db42f891d5fccdfe2ecf4f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:44:00.525564 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274d351-1450-4020-a003-794e5d0eb5e7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:44:00.665268 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2274d351-1450-4020-a003-794e5d0eb5e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e78f25687db42f891d5fccdfe2ecf4f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:44:00.666028 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2274d351-1450-4020-a003-794e5d0eb5e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e78f25687db42f891d5fccdfe2ecf4f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:44:00.730637 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2274d351-1450-4020-a003-794e5d0eb5e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e78f25687db42f891d5fccdfe2ecf4f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:44:00.744241 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2274d351-1450-4020-a003-794e5d0eb5e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e78f25687db42f891d5fccdfe2ecf4f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:44:00.744892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2274d351-1450-4020-a003-794e5d0eb5e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e78f25687db42f891d5fccdfe2ecf4f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:44:00.758619 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1394/2793] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:44:00 2022] DELETE /identity/v3/users/1e78f25687db42f891d5fccdfe2ecf4f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:44:01.020827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8de31c-bd72-41dc-9472-dde44b62f097 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:44:01.030182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8de31c-bd72-41dc-9472-dde44b62f097 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:44:01.089925 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d7c45-9e51-4489-85b3-fdb1d4d660fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:44:01.090553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d7c45-9e51-4489-85b3-fdb1d4d660fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:44:01.090831 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d7c45-9e51-4489-85b3-fdb1d4d660fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:44:01.091100 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d7c45-9e51-4489-85b3-fdb1d4d660fe admin admin] PATH_INFO: `/v3/projects/bac68ec3f1a74f5784509573fb45e906` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:44:01.092202 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d7c45-9e51-4489-85b3-fdb1d4d660fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=bac68ec3f1a74f5784509573fb45e906)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:44:01.094154 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d7c45-9e51-4489-85b3-fdb1d4d660fe admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:44:01.218840 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fc0d7c45-9e51-4489-85b3-fdb1d4d660fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bac68ec3f1a74f5784509573fb45e906', 'request_id': 'req-fc0d7c45-9e51-4489-85b3-fdb1d4d660fe'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:44:01.224992 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fc0d7c45-9e51-4489-85b3-fdb1d4d660fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bac68ec3f1a74f5784509573fb45e906', 'request_id': 'req-fc0d7c45-9e51-4489-85b3-fdb1d4d660fe'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:44:01.319415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fc0d7c45-9e51-4489-85b3-fdb1d4d660fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bac68ec3f1a74f5784509573fb45e906', 'request_id': 'req-fc0d7c45-9e51-4489-85b3-fdb1d4d660fe'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:44:01.333365 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fc0d7c45-9e51-4489-85b3-fdb1d4d660fe admin admin] The token cache is being invalidate because project bac68ec3f1a74f5784509573fb45e906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:44:01.333664 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fc0d7c45-9e51-4489-85b3-fdb1d4d660fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:44:01.334369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fc0d7c45-9e51-4489-85b3-fdb1d4d660fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:44:01.335824 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1400/2794] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:44:01 2022] DELETE /identity/v3/projects/bac68ec3f1a74f5784509573fb45e906 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:44:01.344355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274d351-1450-4020-a003-794e5d0eb5e7 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:44:01.345815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2274d351-1450-4020-a003-794e5d0eb5e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:44:01.359614 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274d351-1450-4020-a003-794e5d0eb5e7 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:44:01.409496 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:01.420872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1538a-d3b9-49b4-a101-5caa758784b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:44:01.421532 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1538a-d3b9-49b4-a101-5caa758784b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:44:01.424376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1538a-d3b9-49b4-a101-5caa758784b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:44:01.424376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1538a-d3b9-49b4-a101-5caa758784b4 admin admin] PATH_INFO: `/v3/users/b946124c97ac48688e1b24695cc67eb0` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:44:01.424376 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1538a-d3b9-49b4-a101-5caa758784b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b946124c97ac48688e1b24695cc67eb0)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:44:01.425080 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1538a-d3b9-49b4-a101-5caa758784b4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:44:01.626342 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-65e1538a-d3b9-49b4-a101-5caa758784b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b946124c97ac48688e1b24695cc67eb0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:44:01.627104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-65e1538a-d3b9-49b4-a101-5caa758784b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b946124c97ac48688e1b24695cc67eb0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:44:01.685188 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-65e1538a-d3b9-49b4-a101-5caa758784b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b946124c97ac48688e1b24695cc67eb0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:44:01.700887 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-65e1538a-d3b9-49b4-a101-5caa758784b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b946124c97ac48688e1b24695cc67eb0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:44:01.701825 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-65e1538a-d3b9-49b4-a101-5caa758784b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b946124c97ac48688e1b24695cc67eb0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:44:01.714900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1395/2795] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:44:01 2022] DELETE /identity/v3/users/b946124c97ac48688e1b24695cc67eb0 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:44:02.007682 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d7c45-9e51-4489-85b3-fdb1d4d660fe admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:44:02.010079 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fc0d7c45-9e51-4489-85b3-fdb1d4d660fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:44:02.022645 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d7c45-9e51-4489-85b3-fdb1d4d660fe admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:44:02.082123 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0aa766-1e8e-4d08-b5ff-e65edfd8ad7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:44:02.082833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0aa766-1e8e-4d08-b5ff-e65edfd8ad7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:44:02.083107 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0aa766-1e8e-4d08-b5ff-e65edfd8ad7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:44:02.083486 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0aa766-1e8e-4d08-b5ff-e65edfd8ad7e admin admin] PATH_INFO: `/v3/projects/341e84919d2445b8b1e182b9b9568926` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:44:02.084575 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0aa766-1e8e-4d08-b5ff-e65edfd8ad7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=341e84919d2445b8b1e182b9b9568926)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:44:02.086563 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0aa766-1e8e-4d08-b5ff-e65edfd8ad7e admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:44:02.237358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:02.250540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-bc0aa766-1e8e-4d08-b5ff-e65edfd8ad7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '341e84919d2445b8b1e182b9b9568926', 'request_id': 'req-bc0aa766-1e8e-4d08-b5ff-e65edfd8ad7e'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:44:02.256600 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-bc0aa766-1e8e-4d08-b5ff-e65edfd8ad7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '341e84919d2445b8b1e182b9b9568926', 'request_id': 'req-bc0aa766-1e8e-4d08-b5ff-e65edfd8ad7e'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:44:02.316150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-bc0aa766-1e8e-4d08-b5ff-e65edfd8ad7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '341e84919d2445b8b1e182b9b9568926', 'request_id': 'req-bc0aa766-1e8e-4d08-b5ff-e65edfd8ad7e'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:44:02.328953 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-bc0aa766-1e8e-4d08-b5ff-e65edfd8ad7e admin admin] The token cache is being invalidate because project 341e84919d2445b8b1e182b9b9568926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:44:02.329268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-bc0aa766-1e8e-4d08-b5ff-e65edfd8ad7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:44:02.329908 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-bc0aa766-1e8e-4d08-b5ff-e65edfd8ad7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:44:02.331420 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1401/2796] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:44:02 2022] DELETE /identity/v3/projects/341e84919d2445b8b1e182b9b9568926 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:44:11.711228 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=30,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:12.373388 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:14.736203 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a5de0-9881-4560-b59b-b11b50aa1702 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:44:14.736734 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a5de0-9881-4560-b59b-b11b50aa1702 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:44:14.736734 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a5de0-9881-4560-b59b-b11b50aa1702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:44:14.768387 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3b5a5de0-9881-4560-b59b-b11b50aa1702 None None] MFA Rules not processed for user `635e47d0a5a34fdfb5c8967a96a87828`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:44:14.769618 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3b5a5de0-9881-4560-b59b-b11b50aa1702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:44:14.849708 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1396/2797] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 5 14:44:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:44:15.037780 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0aa766-1e8e-4d08-b5ff-e65edfd8ad7e admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:44:15.039167 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-bc0aa766-1e8e-4d08-b5ff-e65edfd8ad7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:44:15.109166 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0aa766-1e8e-4d08-b5ff-e65edfd8ad7e admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:44:15.114125 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b85dfb-01f2-4e28-9bf8-d821f2c62c54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed60e9eecb94ef39c2f4a5e5f50d670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:44:15.114732 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b85dfb-01f2-4e28-9bf8-d821f2c62c54 service swift] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:44:15.115003 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b85dfb-01f2-4e28-9bf8-d821f2c62c54 service swift] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:44:15.115272 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b85dfb-01f2-4e28-9bf8-d821f2c62c54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:44:15.124335 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b85dfb-01f2-4e28-9bf8-d821f2c62c54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:44:15.126866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b85dfb-01f2-4e28-9bf8-d821f2c62c54 service swift] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:44:15.135923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1402/2798] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 5 14:44:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 14:44:24.842206 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=32 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:25.132674 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=32 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:31.807814 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba514dfd-3ff6-4485-826b-447f2365f668 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:44:31.808389 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba514dfd-3ff6-4485-826b-447f2365f668 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:44:31.808389 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba514dfd-3ff6-4485-826b-447f2365f668 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:44:31.809952 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1397/2799] 10.222.0.23 () {54 vars in 921 bytes} [Mon Sep 5 14:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 14:44:31.815164 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f66f99-5229-4113-a907-b024ffc12304 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:44:31.819716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f66f99-5229-4113-a907-b024ffc12304 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:44:31.819716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f66f99-5229-4113-a907-b024ffc12304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:44:31.874518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-f6f66f99-5229-4113-a907-b024ffc12304 None None] MFA Rules not processed for user `d5515accf3b64006bc41422265a641bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:44:31.875754 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f6f66f99-5229-4113-a907-b024ffc12304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:44:31.961639 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1403/2800] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Sep 5 14:44:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:44:31.973134 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba514dfd-3ff6-4485-826b-447f2365f668 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:44:31.975510 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ba514dfd-3ff6-4485-826b-447f2365f668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:44:32.040756 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba514dfd-3ff6-4485-826b-447f2365f668 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:44:32.044552 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d925a8-158f-4706-b086-eecd63a941f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a7e9f0daa1c48eca87d92ced265afdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:44:32.045214 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d925a8-158f-4706-b086-eecd63a941f4 service glance] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:44:32.045499 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d925a8-158f-4706-b086-eecd63a941f4 service glance] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:44:32.045797 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d925a8-158f-4706-b086-eecd63a941f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:44:32.058112 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d925a8-158f-4706-b086-eecd63a941f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:44:32.059554 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d925a8-158f-4706-b086-eecd63a941f4 service glance] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:44:32.071247 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1398/2801] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:44:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:44:34.998992 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff61f64-71e0-4935-b8c5-ca57b378f8e3 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:44:35.000274 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff61f64-71e0-4935-b8c5-ca57b378f8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:44:35.000274 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff61f64-71e0-4935-b8c5-ca57b378f8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:44:35.019863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-0ff61f64-71e0-4935-b8c5-ca57b378f8e3 None None] MFA Rules not processed for user `635e47d0a5a34fdfb5c8967a96a87828`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:44:35.021787 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0ff61f64-71e0-4935-b8c5-ca57b378f8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:44:35.032930 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1404/2802] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Sep 5 14:44:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:44:35.046268 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d925a8-158f-4706-b086-eecd63a941f4 service glance] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:44:35.058530 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d925a8-158f-4706-b086-eecd63a941f4 service glance] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:44:35.063488 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed36869-f18f-4937-8f32-c3eadba497f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed60e9eecb94ef39c2f4a5e5f50d670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:44:35.064108 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed36869-f18f-4937-8f32-c3eadba497f8 service swift] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:44:35.064395 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed36869-f18f-4937-8f32-c3eadba497f8 service swift] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:44:35.064654 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed36869-f18f-4937-8f32-c3eadba497f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:44:35.073656 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed36869-f18f-4937-8f32-c3eadba497f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:44:35.076255 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed36869-f18f-4937-8f32-c3eadba497f8 service swift] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:44:35.084481 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1399/2803] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 5 14:44:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 14:44:42.828099 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff61f64-71e0-4935-b8c5-ca57b378f8e3 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:44:42.828675 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0ff61f64-71e0-4935-b8c5-ca57b378f8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:44:42.959046 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff61f64-71e0-4935-b8c5-ca57b378f8e3 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:44:42.963102 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d8551-c06a-4ad1-ac06-c218681e02fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:44:42.963891 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d8551-c06a-4ad1-ac06-c218681e02fb service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:44:42.964165 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d8551-c06a-4ad1-ac06-c218681e02fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:44:42.964434 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d8551-c06a-4ad1-ac06-c218681e02fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:44:42.967062 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4d9d8551-c06a-4ad1-ac06-c218681e02fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:44:42.983949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d8551-c06a-4ad1-ac06-c218681e02fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:44:42.985465 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d8551-c06a-4ad1-ac06-c218681e02fb service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:44:42.999981 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1405/2804] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:44:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:44:44.217843 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed36869-f18f-4937-8f32-c3eadba497f8 service swift] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:44:44.219325 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-aed36869-f18f-4937-8f32-c3eadba497f8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:44:44.232104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed36869-f18f-4937-8f32-c3eadba497f8 service swift] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:44:44.235965 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35d09d-b656-469b-a617-ca0bdd5065f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:44:44.236564 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35d09d-b656-469b-a617-ca0bdd5065f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:44:44.236843 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35d09d-b656-469b-a617-ca0bdd5065f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:44:44.237133 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35d09d-b656-469b-a617-ca0bdd5065f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:44:44.238928 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ca35d09d-b656-469b-a617-ca0bdd5065f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:44:44.253539 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35d09d-b656-469b-a617-ca0bdd5065f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:44:44.255010 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35d09d-b656-469b-a617-ca0bdd5065f5 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:44:44.267383 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1400/2805] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:44:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:44:50.842271 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df89d8c-8834-49cb-84b9-36a8b350bbdb None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:44:50.842786 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df89d8c-8834-49cb-84b9-36a8b350bbdb None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:44:50.842897 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df89d8c-8834-49cb-84b9-36a8b350bbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:44:50.863195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-6df89d8c-8834-49cb-84b9-36a8b350bbdb None None] MFA Rules not processed for user `635e47d0a5a34fdfb5c8967a96a87828`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:44:50.864422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6df89d8c-8834-49cb-84b9-36a8b350bbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:44:50.873139 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1406/2806] 10.222.0.23 () {58 vars in 967 bytes} [Mon Sep 5 14:44:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:44:50.885784 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35d09d-b656-469b-a617-ca0bdd5065f5 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:44:50.897477 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35d09d-b656-469b-a617-ca0bdd5065f5 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:44:50.902922 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27346f24-2f46-4a8a-b6ce-a140bcc7d612 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ed60e9eecb94ef39c2f4a5e5f50d670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:44:50.903535 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27346f24-2f46-4a8a-b6ce-a140bcc7d612 service swift] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:44:50.903818 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27346f24-2f46-4a8a-b6ce-a140bcc7d612 service swift] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:44:50.904090 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27346f24-2f46-4a8a-b6ce-a140bcc7d612 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:44:50.915683 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27346f24-2f46-4a8a-b6ce-a140bcc7d612 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:44:50.917301 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27346f24-2f46-4a8a-b6ce-a140bcc7d612 service swift] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:44:50.925892 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1401/2807] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Sep 5 14:44:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 14:45:00.857955 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=85 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:00.922431 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=44 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:24.164219 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df89d8c-8834-49cb-84b9-36a8b350bbdb None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:45:24.175618 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df89d8c-8834-49cb-84b9-36a8b350bbdb None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:45:24.179896 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3f5b6-915a-494f-9c15-ad1e978c5efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:45:24.180641 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3f5b6-915a-494f-9c15-ad1e978c5efe service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:45:24.180980 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3f5b6-915a-494f-9c15-ad1e978c5efe service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:45:24.181462 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3f5b6-915a-494f-9c15-ad1e978c5efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:45:24.183744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5ed3f5b6-915a-494f-9c15-ad1e978c5efe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:45:24.284518 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3f5b6-915a-494f-9c15-ad1e978c5efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:45:24.286554 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3f5b6-915a-494f-9c15-ad1e978c5efe service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:45:24.301822 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1407/2808] 10.222.0.23 () {60 vars in 1396 bytes} [Mon Sep 5 14:45:24 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3266 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:45:29.292655 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27346f24-2f46-4a8a-b6ce-a140bcc7d612 service swift] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:45:29.301997 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27346f24-2f46-4a8a-b6ce-a140bcc7d612 service swift] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:45:29.305488 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ff91a-c019-41b0-a9b0-c24327721efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:45:29.306095 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ff91a-c019-41b0-a9b0-c24327721efa service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:45:29.306370 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ff91a-c019-41b0-a9b0-c24327721efa service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:45:29.306643 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ff91a-c019-41b0-a9b0-c24327721efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:45:29.308309 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e60ff91a-c019-41b0-a9b0-c24327721efa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:45:29.376813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ff91a-c019-41b0-a9b0-c24327721efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:45:29.378284 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ff91a-c019-41b0-a9b0-c24327721efa service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:45:29.388987 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1402/2809] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:45:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:45:33.091308 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3f5b6-915a-494f-9c15-ad1e978c5efe service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:45:33.093950 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5ed3f5b6-915a-494f-9c15-ad1e978c5efe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:45:33.187899 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3f5b6-915a-494f-9c15-ad1e978c5efe service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:45:33.194827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5393d9d-a216-49fe-aa72-e27311baf25f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1880dab32fa424a9356b3fe940d4856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:45:33.194827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5393d9d-a216-49fe-aa72-e27311baf25f service placement] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:45:33.194827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5393d9d-a216-49fe-aa72-e27311baf25f service placement] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:45:33.194827 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5393d9d-a216-49fe-aa72-e27311baf25f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:45:33.195859 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c5393d9d-a216-49fe-aa72-e27311baf25f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:45:33.209262 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5393d9d-a216-49fe-aa72-e27311baf25f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:45:33.210854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5393d9d-a216-49fe-aa72-e27311baf25f service placement] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:45:33.221620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1408/2810] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:45:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:45:33.311065 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ff91a-c019-41b0-a9b0-c24327721efa service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:45:33.312727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e60ff91a-c019-41b0-a9b0-c24327721efa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:45:33.326857 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ff91a-c019-41b0-a9b0-c24327721efa service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:45:33.331440 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76664a-7071-4ff1-ae14-03df52a174db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:45:33.332113 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76664a-7071-4ff1-ae14-03df52a174db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:45:33.332395 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76664a-7071-4ff1-ae14-03df52a174db admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:45:33.332664 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76664a-7071-4ff1-ae14-03df52a174db admin admin] PATH_INFO: `/v3/users/fce888a3a8f24ee8a10e32b030bbd56b` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:45:33.334038 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76664a-7071-4ff1-ae14-03df52a174db admin admin] RBAC: Authorizing `identity:delete_user(user_id=fce888a3a8f24ee8a10e32b030bbd56b)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:45:33.336106 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76664a-7071-4ff1-ae14-03df52a174db admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:45:33.569612 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9c76664a-7071-4ff1-ae14-03df52a174db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fce888a3a8f24ee8a10e32b030bbd56b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:45:33.570262 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9c76664a-7071-4ff1-ae14-03df52a174db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fce888a3a8f24ee8a10e32b030bbd56b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:45:33.663360 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9c76664a-7071-4ff1-ae14-03df52a174db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fce888a3a8f24ee8a10e32b030bbd56b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:45:33.676343 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9c76664a-7071-4ff1-ae14-03df52a174db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fce888a3a8f24ee8a10e32b030bbd56b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:45:33.677005 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9c76664a-7071-4ff1-ae14-03df52a174db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fce888a3a8f24ee8a10e32b030bbd56b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:45:33.690631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1403/2811] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:45:33 2022] DELETE /identity/v3/users/fce888a3a8f24ee8a10e32b030bbd56b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:45:33.961869 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5393d9d-a216-49fe-aa72-e27311baf25f service placement] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:45:33.975126 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5393d9d-a216-49fe-aa72-e27311baf25f service placement] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:45:34.055612 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d559692-656a-4331-af01-8b4cec2f0fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:45:34.056293 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d559692-656a-4331-af01-8b4cec2f0fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:45:34.056569 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d559692-656a-4331-af01-8b4cec2f0fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:45:34.056835 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d559692-656a-4331-af01-8b4cec2f0fad admin admin] PATH_INFO: `/v3/projects/68e59b07ad6d42d7a201c7f14a3ffcac` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:45:34.058029 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d559692-656a-4331-af01-8b4cec2f0fad admin admin] RBAC: Authorizing `identity:delete_project(project_id=68e59b07ad6d42d7a201c7f14a3ffcac)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:45:34.059926 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d559692-656a-4331-af01-8b4cec2f0fad admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:45:34.246330 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:34.261393 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-7d559692-656a-4331-af01-8b4cec2f0fad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68e59b07ad6d42d7a201c7f14a3ffcac', 'request_id': 'req-7d559692-656a-4331-af01-8b4cec2f0fad'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:45:34.267970 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-7d559692-656a-4331-af01-8b4cec2f0fad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68e59b07ad6d42d7a201c7f14a3ffcac', 'request_id': 'req-7d559692-656a-4331-af01-8b4cec2f0fad'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:45:34.371863 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-7d559692-656a-4331-af01-8b4cec2f0fad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68e59b07ad6d42d7a201c7f14a3ffcac', 'request_id': 'req-7d559692-656a-4331-af01-8b4cec2f0fad'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:45:34.386816 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-7d559692-656a-4331-af01-8b4cec2f0fad admin admin] The token cache is being invalidate because project 68e59b07ad6d42d7a201c7f14a3ffcac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:45:34.390133 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-7d559692-656a-4331-af01-8b4cec2f0fad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:45:34.390133 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-7d559692-656a-4331-af01-8b4cec2f0fad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:45:34.392332 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1409/2812] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:45:33 2022] DELETE /identity/v3/projects/68e59b07ad6d42d7a201c7f14a3ffcac => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:45:34.397913 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db17ace-680a-4e9e-bcb3-0d78ab21da3a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:45:34.398462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db17ace-680a-4e9e-bcb3-0d78ab21da3a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:45:34.398462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db17ace-680a-4e9e-bcb3-0d78ab21da3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:45:34.453508 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5db17ace-680a-4e9e-bcb3-0d78ab21da3a None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:45:34.454871 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5db17ace-680a-4e9e-bcb3-0d78ab21da3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:45:34.503216 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:34.524297 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1404/2813] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:45:34.533384 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22a662-9355-4508-b4d7-1c7825de80d1 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:45:34.533666 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22a662-9355-4508-b4d7-1c7825de80d1 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:45:34.533939 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22a662-9355-4508-b4d7-1c7825de80d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:45:34.556502 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-1c22a662-9355-4508-b4d7-1c7825de80d1 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:45:34.557810 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1c22a662-9355-4508-b4d7-1c7825de80d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:45:34.570278 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1410/2814] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:45:34.575033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db17ace-680a-4e9e-bcb3-0d78ab21da3a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:45:34.586707 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db17ace-680a-4e9e-bcb3-0d78ab21da3a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:45:34.593868 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250091f5-9aa7-474f-8814-694031f7cc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:45:34.594494 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250091f5-9aa7-474f-8814-694031f7cc23 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:45:34.594773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250091f5-9aa7-474f-8814-694031f7cc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:45:34.595039 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250091f5-9aa7-474f-8814-694031f7cc23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:45:34.595776 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250091f5-9aa7-474f-8814-694031f7cc23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:45:34.596107 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250091f5-9aa7-474f-8814-694031f7cc23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:45:34.597804 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250091f5-9aa7-474f-8814-694031f7cc23 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:45:34.610628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1405/2815] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:45:34.615348 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22a662-9355-4508-b4d7-1c7825de80d1 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:45:34.627213 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22a662-9355-4508-b4d7-1c7825de80d1 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:45:34.632189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e521d4-77e6-45d5-b729-6b28e4d275b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:45:34.633038 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e521d4-77e6-45d5-b729-6b28e4d275b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:45:34.633407 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e521d4-77e6-45d5-b729-6b28e4d275b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:45:34.633682 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e521d4-77e6-45d5-b729-6b28e4d275b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:45:34.634331 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e521d4-77e6-45d5-b729-6b28e4d275b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:45:34.636312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e521d4-77e6-45d5-b729-6b28e4d275b3 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:45:34.757858 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1411/2816] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:45:34 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:45:34.761844 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250091f5-9aa7-474f-8814-694031f7cc23 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:45:34.773413 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250091f5-9aa7-474f-8814-694031f7cc23 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:45:34.840517 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb16d3d-fef0-4588-b161-1926604646c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:45:34.841154 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb16d3d-fef0-4588-b161-1926604646c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:45:34.841436 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb16d3d-fef0-4588-b161-1926604646c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:45:34.841707 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb16d3d-fef0-4588-b161-1926604646c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:45:34.842927 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb16d3d-fef0-4588-b161-1926604646c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:45:34.844840 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb16d3d-fef0-4588-b161-1926604646c8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:45:34.926982 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1406/2817] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:45:34 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:45:34.931828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e521d4-77e6-45d5-b729-6b28e4d275b3 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:45:34.949650 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e521d4-77e6-45d5-b729-6b28e4d275b3 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:45:34.955263 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a59e2a-05f0-47d8-9ccf-822f63f4b33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:45:34.955905 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a59e2a-05f0-47d8-9ccf-822f63f4b33b admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:45:34.956221 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a59e2a-05f0-47d8-9ccf-822f63f4b33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:45:34.956492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a59e2a-05f0-47d8-9ccf-822f63f4b33b admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:45:34.957166 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a59e2a-05f0-47d8-9ccf-822f63f4b33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:45:34.958916 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a59e2a-05f0-47d8-9ccf-822f63f4b33b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:45:34.970953 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1412/2818] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:45:34.973877 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb16d3d-fef0-4588-b161-1926604646c8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:45:34.984722 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb16d3d-fef0-4588-b161-1926604646c8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:45:34.989709 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87846c-3171-41de-8baf-5c7f0c089210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:45:34.990305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87846c-3171-41de-8baf-5c7f0c089210 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:45:34.990581 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87846c-3171-41de-8baf-5c7f0c089210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:45:34.990849 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87846c-3171-41de-8baf-5c7f0c089210 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:45:34.991484 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87846c-3171-41de-8baf-5c7f0c089210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:45:34.993132 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87846c-3171-41de-8baf-5c7f0c089210 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:45:35.004205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1407/2819] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:45:35.008472 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a59e2a-05f0-47d8-9ccf-822f63f4b33b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:45:35.019338 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a59e2a-05f0-47d8-9ccf-822f63f4b33b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:45:35.024441 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f748263-ca31-48c7-9147-2ad37910c4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:45:35.025119 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f748263-ca31-48c7-9147-2ad37910c4ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:45:35.025402 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f748263-ca31-48c7-9147-2ad37910c4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:45:35.025674 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f748263-ca31-48c7-9147-2ad37910c4ac admin admin] PATH_INFO: `/v3/projects/4791703294944349b62ebf6502f3a382/users/14f556e0c4d64016817a542f0a9368a8/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:45:35.041421 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f748263-ca31-48c7-9147-2ad37910c4ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4791703294944349b62ebf6502f3a382, user_id=14f556e0c4d64016817a542f0a9368a8, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:45:35.044202 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f748263-ca31-48c7-9147-2ad37910c4ac admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:45:35.166984 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1413/2820] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:45:35 2022] PUT /identity/v3/projects/4791703294944349b62ebf6502f3a382/users/14f556e0c4d64016817a542f0a9368a8/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:45:35.172450 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814e33b-01b1-4197-be73-ba5446434ff9 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:45:35.172737 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814e33b-01b1-4197-be73-ba5446434ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:45:35.173021 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814e33b-01b1-4197-be73-ba5446434ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:45:35.192718 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4814e33b-01b1-4197-be73-ba5446434ff9 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:45:35.194313 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4814e33b-01b1-4197-be73-ba5446434ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:45:35.255939 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1408/2821] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:45:35.266423 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f748263-ca31-48c7-9147-2ad37910c4ac admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:45:35.268390 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5f748263-ca31-48c7-9147-2ad37910c4ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:45:35.328784 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f748263-ca31-48c7-9147-2ad37910c4ac admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:45:35.332561 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbbe08-dc4b-4033-980a-46ae338270f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:45:35.333332 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbbe08-dc4b-4033-980a-46ae338270f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:45:35.333517 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbbe08-dc4b-4033-980a-46ae338270f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:45:35.333769 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbbe08-dc4b-4033-980a-46ae338270f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:45:35.343734 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbbe08-dc4b-4033-980a-46ae338270f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:45:35.345284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbbe08-dc4b-4033-980a-46ae338270f8 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:45:35.355232 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1414/2822] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:45:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:45:41.370446 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256d675-814a-48c1-a1d1-1561c2c7280f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:45:41.371339 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256d675-814a-48c1-a1d1-1561c2c7280f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:45:41.372378 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256d675-814a-48c1-a1d1-1561c2c7280f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:45:41.406561 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4256d675-814a-48c1-a1d1-1561c2c7280f None None] MFA Rules not processed for user `14f556e0c4d64016817a542f0a9368a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:45:41.407890 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4256d675-814a-48c1-a1d1-1561c2c7280f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:45:41.459604 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:41.487021 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1409/2823] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:45:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:45:41.504844 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbbe08-dc4b-4033-980a-46ae338270f8 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:45:41.506356 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-85fbbe08-dc4b-4033-980a-46ae338270f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:45:41.563377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:41.587865 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbbe08-dc4b-4033-980a-46ae338270f8 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:45:41.594746 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9e771-54d6-4f69-9729-0d9409a6e251 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:45:41.595356 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9e771-54d6-4f69-9729-0d9409a6e251 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:45:41.595632 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9e771-54d6-4f69-9729-0d9409a6e251 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:45:41.595906 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9e771-54d6-4f69-9729-0d9409a6e251 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:45:41.604705 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9e771-54d6-4f69-9729-0d9409a6e251 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:45:41.606340 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9e771-54d6-4f69-9729-0d9409a6e251 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:45:41.617265 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1415/2824] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:45:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:45:44.255538 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f48881-9146-4d0b-a178-c3cb47f51326 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:45:44.256089 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f48881-9146-4d0b-a178-c3cb47f51326 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:45:44.256089 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f48881-9146-4d0b-a178-c3cb47f51326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:45:44.276415 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-24f48881-9146-4d0b-a178-c3cb47f51326 None None] MFA Rules not processed for user `14f556e0c4d64016817a542f0a9368a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:45:44.277670 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-24f48881-9146-4d0b-a178-c3cb47f51326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:45:44.285691 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1410/2825] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:45:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:45:44.620949 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9e771-54d6-4f69-9729-0d9409a6e251 service nova] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:45:44.622687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ddd9e771-54d6-4f69-9729-0d9409a6e251 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:45:44.636369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9e771-54d6-4f69-9729-0d9409a6e251 service nova] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:45:44.640784 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b82536-f896-49ec-acb1-32937fb7903b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:45:44.641739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b82536-f896-49ec-acb1-32937fb7903b service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:45:44.642022 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b82536-f896-49ec-acb1-32937fb7903b service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:45:44.642288 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b82536-f896-49ec-acb1-32937fb7903b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:45:44.644716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-00b82536-f896-49ec-acb1-32937fb7903b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:45:44.655012 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b82536-f896-49ec-acb1-32937fb7903b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:45:44.656447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b82536-f896-49ec-acb1-32937fb7903b service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:45:44.665489 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1416/2826] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:45:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:45:45.333207 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f48881-9146-4d0b-a178-c3cb47f51326 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:45:45.335319 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-24f48881-9146-4d0b-a178-c3cb47f51326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:45:45.425770 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f48881-9146-4d0b-a178-c3cb47f51326 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:45:45.431496 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c0821-0296-40c1-9732-e74341171052 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1880dab32fa424a9356b3fe940d4856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:45:45.432104 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c0821-0296-40c1-9732-e74341171052 service placement] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:45:45.432380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c0821-0296-40c1-9732-e74341171052 service placement] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:45:45.432650 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c0821-0296-40c1-9732-e74341171052 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:45:45.434421 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c69c0821-0296-40c1-9732-e74341171052 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:45:45.446522 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c0821-0296-40c1-9732-e74341171052 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:45:45.448147 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c0821-0296-40c1-9732-e74341171052 service placement] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:45:45.459468 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1411/2827] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:45:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:45:49.237593 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b82536-f896-49ec-acb1-32937fb7903b service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:45:49.242182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b82536-f896-49ec-acb1-32937fb7903b service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:45:49.245826 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0ba5b-aac1-4a43-9762-574258dd9704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:45:49.246411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0ba5b-aac1-4a43-9762-574258dd9704 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:45:49.246685 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0ba5b-aac1-4a43-9762-574258dd9704 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:45:49.246952 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0ba5b-aac1-4a43-9762-574258dd9704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:45:49.248712 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0ac0ba5b-aac1-4a43-9762-574258dd9704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:45:49.258716 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0ba5b-aac1-4a43-9762-574258dd9704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:45:49.260167 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0ba5b-aac1-4a43-9762-574258dd9704 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:45:49.268962 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1417/2828] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:45:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 14:45:50.168280 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c0821-0296-40c1-9732-e74341171052 service placement] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:45:50.170787 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c69c0821-0296-40c1-9732-e74341171052 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:45:50.188497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c0821-0296-40c1-9732-e74341171052 service placement] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:45:50.194488 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f076cf2-549f-4adc-8b8b-caba2e90ea45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:45:50.195281 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f076cf2-549f-4adc-8b8b-caba2e90ea45 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:45:50.195573 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f076cf2-549f-4adc-8b8b-caba2e90ea45 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:45:50.195852 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f076cf2-549f-4adc-8b8b-caba2e90ea45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:45:50.197671 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6f076cf2-549f-4adc-8b8b-caba2e90ea45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:45:50.218305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f076cf2-549f-4adc-8b8b-caba2e90ea45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:45:50.220002 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f076cf2-549f-4adc-8b8b-caba2e90ea45 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:45:50.231417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1412/2829] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:45:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:45:56.550125 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0ba5b-aac1-4a43-9762-574258dd9704 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:45:56.564160 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0ba5b-aac1-4a43-9762-574258dd9704 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:45:56.569650 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c770a-f1b5-4103-b86c-b0910ef9b74c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:45:56.570253 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c770a-f1b5-4103-b86c-b0910ef9b74c service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:45:56.570526 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c770a-f1b5-4103-b86c-b0910ef9b74c service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:45:56.570792 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c770a-f1b5-4103-b86c-b0910ef9b74c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:45:56.572727 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b45c770a-f1b5-4103-b86c-b0910ef9b74c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:45:56.586931 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c770a-f1b5-4103-b86c-b0910ef9b74c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:45:56.588530 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c770a-f1b5-4103-b86c-b0910ef9b74c service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:45:56.600013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1418/2830] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:45:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:46:00.226585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=50 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:46:06.595457 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=30 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:48:19.636799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f076cf2-549f-4adc-8b8b-caba2e90ea45 service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:48:19.638423 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6f076cf2-549f-4adc-8b8b-caba2e90ea45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:48:19.654199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f076cf2-549f-4adc-8b8b-caba2e90ea45 service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:48:19.659375 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92c545-8d15-412b-8d8e-2b99345e6dab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1880dab32fa424a9356b3fe940d4856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:48:19.660111 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92c545-8d15-412b-8d8e-2b99345e6dab service placement] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:48:19.660434 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92c545-8d15-412b-8d8e-2b99345e6dab service placement] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:48:19.660716 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92c545-8d15-412b-8d8e-2b99345e6dab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:48:19.663271 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2f92c545-8d15-412b-8d8e-2b99345e6dab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:48:19.676239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92c545-8d15-412b-8d8e-2b99345e6dab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:48:19.679964 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92c545-8d15-412b-8d8e-2b99345e6dab service placement] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:48:19.691525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1413/2831] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:48:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:48:26.125432 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1346aa-02b7-4127-861a-6d57be4970fc None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:48:26.125987 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1346aa-02b7-4127-861a-6d57be4970fc None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:48:26.126096 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1346aa-02b7-4127-861a-6d57be4970fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:48:26.146785 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-0f1346aa-02b7-4127-861a-6d57be4970fc None None] MFA Rules not processed for user `14f556e0c4d64016817a542f0a9368a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:48:26.148934 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0f1346aa-02b7-4127-861a-6d57be4970fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:48:26.155992 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1419/2832] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:48:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:48:26.478141 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92c545-8d15-412b-8d8e-2b99345e6dab service placement] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:48:26.490167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92c545-8d15-412b-8d8e-2b99345e6dab service placement] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:48:26.496033 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b82a9-d0b6-46f7-86ed-a14675501dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:48:26.496639 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b82a9-d0b6-46f7-86ed-a14675501dfd service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:48:26.496918 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b82a9-d0b6-46f7-86ed-a14675501dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:48:26.499222 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b82a9-d0b6-46f7-86ed-a14675501dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:48:26.499222 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ac1b82a9-d0b6-46f7-86ed-a14675501dfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:48:26.509830 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b82a9-d0b6-46f7-86ed-a14675501dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:48:26.511249 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b82a9-d0b6-46f7-86ed-a14675501dfd service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:48:26.519502 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1414/2833] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:48:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:48:36.140782 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:48:36.516109 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=12 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:48:41.533148 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1346aa-02b7-4127-861a-6d57be4970fc None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:48:41.545944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1346aa-02b7-4127-861a-6d57be4970fc None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:48:41.551684 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90aab8-dfb6-4c3c-814b-f6d77dcc7d91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5515accf3b64006bc41422265a641bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:48:41.552287 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90aab8-dfb6-4c3c-814b-f6d77dcc7d91 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:48:41.552789 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90aab8-dfb6-4c3c-814b-f6d77dcc7d91 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:48:41.553081 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90aab8-dfb6-4c3c-814b-f6d77dcc7d91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:48:41.555424 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4c90aab8-dfb6-4c3c-814b-f6d77dcc7d91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:48:41.568179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90aab8-dfb6-4c3c-814b-f6d77dcc7d91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:48:41.569828 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90aab8-dfb6-4c3c-814b-f6d77dcc7d91 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:48:41.581622 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1420/2834] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:48:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:48:51.577634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=6 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:43.504752 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b82a9-d0b6-46f7-86ed-a14675501dfd service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:43.517279 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b82a9-d0b6-46f7-86ed-a14675501dfd service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:43.522963 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05156c1c-387c-4766-a4e6-7bf9a486e925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:43.523598 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05156c1c-387c-4766-a4e6-7bf9a486e925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:43.523878 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05156c1c-387c-4766-a4e6-7bf9a486e925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:43.524152 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05156c1c-387c-4766-a4e6-7bf9a486e925 admin admin] PATH_INFO: `/v3/users/14f556e0c4d64016817a542f0a9368a8` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:43.525297 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05156c1c-387c-4766-a4e6-7bf9a486e925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f556e0c4d64016817a542f0a9368a8)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:43.527268 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05156c1c-387c-4766-a4e6-7bf9a486e925 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:43.829538 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-05156c1c-387c-4766-a4e6-7bf9a486e925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f556e0c4d64016817a542f0a9368a8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:43.830351 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-05156c1c-387c-4766-a4e6-7bf9a486e925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f556e0c4d64016817a542f0a9368a8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:43.927417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-05156c1c-387c-4766-a4e6-7bf9a486e925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f556e0c4d64016817a542f0a9368a8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:43.940641 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-05156c1c-387c-4766-a4e6-7bf9a486e925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f556e0c4d64016817a542f0a9368a8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:43.941484 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-05156c1c-387c-4766-a4e6-7bf9a486e925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f556e0c4d64016817a542f0a9368a8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:43.954612 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1415/2835] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:49:43 2022] DELETE /identity/v3/users/14f556e0c4d64016817a542f0a9368a8 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:49:44.225634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90aab8-dfb6-4c3c-814b-f6d77dcc7d91 service nova] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:44.240092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90aab8-dfb6-4c3c-814b-f6d77dcc7d91 service nova] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:44.301871 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8f9c5-95eb-468b-86c7-93df85dc213d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:44.302509 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8f9c5-95eb-468b-86c7-93df85dc213d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:44.302778 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8f9c5-95eb-468b-86c7-93df85dc213d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:44.303046 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8f9c5-95eb-468b-86c7-93df85dc213d admin admin] PATH_INFO: `/v3/projects/4791703294944349b62ebf6502f3a382` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:44.304207 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8f9c5-95eb-468b-86c7-93df85dc213d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4791703294944349b62ebf6502f3a382)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:44.306192 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8f9c5-95eb-468b-86c7-93df85dc213d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:44.414524 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-18a8f9c5-95eb-468b-86c7-93df85dc213d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4791703294944349b62ebf6502f3a382', 'request_id': 'req-18a8f9c5-95eb-468b-86c7-93df85dc213d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:44.420232 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-18a8f9c5-95eb-468b-86c7-93df85dc213d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4791703294944349b62ebf6502f3a382', 'request_id': 'req-18a8f9c5-95eb-468b-86c7-93df85dc213d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:44.498321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-18a8f9c5-95eb-468b-86c7-93df85dc213d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4791703294944349b62ebf6502f3a382', 'request_id': 'req-18a8f9c5-95eb-468b-86c7-93df85dc213d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:44.511875 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-18a8f9c5-95eb-468b-86c7-93df85dc213d admin admin] The token cache is being invalidate because project 4791703294944349b62ebf6502f3a382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:49:44.512163 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-18a8f9c5-95eb-468b-86c7-93df85dc213d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:44.512816 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-18a8f9c5-95eb-468b-86c7-93df85dc213d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:44.514425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1421/2836] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:49:44 2022] DELETE /identity/v3/projects/4791703294944349b62ebf6502f3a382 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:49:44.520373 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5555ec3-b0d9-4886-9988-ba936640cd94 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:44.525554 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5555ec3-b0d9-4886-9988-ba936640cd94 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:44.525554 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5555ec3-b0d9-4886-9988-ba936640cd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:44.542197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e5555ec3-b0d9-4886-9988-ba936640cd94 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:49:44.550075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e5555ec3-b0d9-4886-9988-ba936640cd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:44.605888 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1416/2837] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:49:44.667635 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656d48f-7773-413e-bd53-4ada40aaab88 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:44.667866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656d48f-7773-413e-bd53-4ada40aaab88 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:44.668088 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d656d48f-7773-413e-bd53-4ada40aaab88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:44.688769 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d656d48f-7773-413e-bd53-4ada40aaab88 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:49:44.690022 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d656d48f-7773-413e-bd53-4ada40aaab88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:44.699405 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1422/2838] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:49:44.704119 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5555ec3-b0d9-4886-9988-ba936640cd94 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:44.715113 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5555ec3-b0d9-4886-9988-ba936640cd94 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:44.719666 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e99526-bf8f-4c84-a6b8-92cdf7f6b830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:44.720260 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e99526-bf8f-4c84-a6b8-92cdf7f6b830 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:44.720534 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e99526-bf8f-4c84-a6b8-92cdf7f6b830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:44.720802 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e99526-bf8f-4c84-a6b8-92cdf7f6b830 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:44.721480 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e99526-bf8f-4c84-a6b8-92cdf7f6b830 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:49:44.721780 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e99526-bf8f-4c84-a6b8-92cdf7f6b830 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:44.723502 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e99526-bf8f-4c84-a6b8-92cdf7f6b830 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:44.735837 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1417/2839] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:49:44.740338 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656d48f-7773-413e-bd53-4ada40aaab88 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:44.749664 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d656d48f-7773-413e-bd53-4ada40aaab88 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:44.754987 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9143c3-4b4d-42c9-92c3-a85f34319da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:44.755577 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9143c3-4b4d-42c9-92c3-a85f34319da2 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:44.755857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9143c3-4b4d-42c9-92c3-a85f34319da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:44.756129 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9143c3-4b4d-42c9-92c3-a85f34319da2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:44.756755 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9143c3-4b4d-42c9-92c3-a85f34319da2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:44.758770 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9143c3-4b4d-42c9-92c3-a85f34319da2 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:44.868403 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1423/2840] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:49:44 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:49:44.873367 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e99526-bf8f-4c84-a6b8-92cdf7f6b830 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:44.884427 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e99526-bf8f-4c84-a6b8-92cdf7f6b830 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:44.950125 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4660a24-707d-4a98-a406-2cbbfd75e054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:44.950800 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4660a24-707d-4a98-a406-2cbbfd75e054 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:44.951095 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4660a24-707d-4a98-a406-2cbbfd75e054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:44.951380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4660a24-707d-4a98-a406-2cbbfd75e054 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:44.952075 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4660a24-707d-4a98-a406-2cbbfd75e054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:44.954451 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4660a24-707d-4a98-a406-2cbbfd75e054 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:44.963387 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:45.043648 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1418/2841] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:49:44 2022] POST /identity/v3/users => generated 283 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:49:45.048184 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9143c3-4b4d-42c9-92c3-a85f34319da2 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:45.059590 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9143c3-4b4d-42c9-92c3-a85f34319da2 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:45.064242 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafadc6-0e7c-4666-99a1-b5f8cc3b2dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:45.064835 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafadc6-0e7c-4666-99a1-b5f8cc3b2dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:45.065147 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafadc6-0e7c-4666-99a1-b5f8cc3b2dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:45.065422 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafadc6-0e7c-4666-99a1-b5f8cc3b2dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:45.066061 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafadc6-0e7c-4666-99a1-b5f8cc3b2dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:45.068643 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafadc6-0e7c-4666-99a1-b5f8cc3b2dd0 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:45.079210 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1424/2842] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:49:45.083478 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4660a24-707d-4a98-a406-2cbbfd75e054 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:45.094242 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4660a24-707d-4a98-a406-2cbbfd75e054 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:45.099899 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee87b52-a2dd-4f4a-8d43-763618ea5c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:45.100509 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee87b52-a2dd-4f4a-8d43-763618ea5c6f admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:45.100785 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee87b52-a2dd-4f4a-8d43-763618ea5c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:45.101076 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee87b52-a2dd-4f4a-8d43-763618ea5c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:45.101728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee87b52-a2dd-4f4a-8d43-763618ea5c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:45.103449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee87b52-a2dd-4f4a-8d43-763618ea5c6f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:45.114656 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1419/2843] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:49:45.118947 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafadc6-0e7c-4666-99a1-b5f8cc3b2dd0 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:45.130447 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafadc6-0e7c-4666-99a1-b5f8cc3b2dd0 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:45.135425 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7c55b-12a1-4043-adc3-f1b5af39cacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:45.137333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7c55b-12a1-4043-adc3-f1b5af39cacb admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:45.137333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7c55b-12a1-4043-adc3-f1b5af39cacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:45.137333 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7c55b-12a1-4043-adc3-f1b5af39cacb admin admin] PATH_INFO: `/v3/projects/b42929c61bfa49d1bd28d25c3881831d/users/5c50580fc1934d64b31c2b98a02d1392/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:45.152890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7c55b-12a1-4043-adc3-f1b5af39cacb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b42929c61bfa49d1bd28d25c3881831d, user_id=5c50580fc1934d64b31c2b98a02d1392, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:45.157605 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7c55b-12a1-4043-adc3-f1b5af39cacb admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:45.226789 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1425/2844] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:49:45 2022] PUT /identity/v3/projects/b42929c61bfa49d1bd28d25c3881831d/users/5c50580fc1934d64b31c2b98a02d1392/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:49:45.236884 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e993d3b-569e-4150-bb2d-9d77b95b2643 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:45.237207 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e993d3b-569e-4150-bb2d-9d77b95b2643 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:45.237488 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e993d3b-569e-4150-bb2d-9d77b95b2643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:45.272681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7e993d3b-569e-4150-bb2d-9d77b95b2643 None None] MFA Rules not processed for user `5c50580fc1934d64b31c2b98a02d1392`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:49:45.273964 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7e993d3b-569e-4150-bb2d-9d77b95b2643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:45.340729 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1420/2845] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:49:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:49:45.345750 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7c55b-12a1-4043-adc3-f1b5af39cacb admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:45.380399 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:45.414094 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7c55b-12a1-4043-adc3-f1b5af39cacb admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:45.419213 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808039bc-4f49-4f76-9240-19994434419f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:45.419813 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808039bc-4f49-4f76-9240-19994434419f admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:45.420088 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808039bc-4f49-4f76-9240-19994434419f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:45.420358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808039bc-4f49-4f76-9240-19994434419f admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:45.420984 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808039bc-4f49-4f76-9240-19994434419f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:45.422910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808039bc-4f49-4f76-9240-19994434419f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:45.517042 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1426/2846] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:49:45 2022] POST /identity/v3/projects => generated 363 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:49:45.523093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e993d3b-569e-4150-bb2d-9d77b95b2643 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:45.541858 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e993d3b-569e-4150-bb2d-9d77b95b2643 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:45.611274 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f508235-3fb6-4b21-b187-e97983b28fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:45.611882 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f508235-3fb6-4b21-b187-e97983b28fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:45.612165 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f508235-3fb6-4b21-b187-e97983b28fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:45.612432 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f508235-3fb6-4b21-b187-e97983b28fe7 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:45.613691 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f508235-3fb6-4b21-b187-e97983b28fe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:45.615642 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f508235-3fb6-4b21-b187-e97983b28fe7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:45.695848 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1421/2847] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:49:45 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:49:45.699846 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808039bc-4f49-4f76-9240-19994434419f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:45.710822 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808039bc-4f49-4f76-9240-19994434419f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:45.715576 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20333a3f-d2c0-4b52-a78b-b7c488e5ae9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:45.716174 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20333a3f-d2c0-4b52-a78b-b7c488e5ae9d admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:45.716454 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20333a3f-d2c0-4b52-a78b-b7c488e5ae9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:45.716726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20333a3f-d2c0-4b52-a78b-b7c488e5ae9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:45.717392 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20333a3f-d2c0-4b52-a78b-b7c488e5ae9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:45.718999 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20333a3f-d2c0-4b52-a78b-b7c488e5ae9d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:45.729175 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1427/2848] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:49:45.733871 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f508235-3fb6-4b21-b187-e97983b28fe7 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:45.744606 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f508235-3fb6-4b21-b187-e97983b28fe7 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:45.749167 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648ef83-c154-4333-bee4-9388bc667a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:45.749821 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648ef83-c154-4333-bee4-9388bc667a8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:45.750097 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648ef83-c154-4333-bee4-9388bc667a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:45.750367 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648ef83-c154-4333-bee4-9388bc667a8a admin admin] PATH_INFO: `/v3/projects/9f9f764e37d94c1ba05f4a518782a622/users/e9e7079845374e6f847cab86ad9166b3/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:45.766986 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648ef83-c154-4333-bee4-9388bc667a8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f9f764e37d94c1ba05f4a518782a622, user_id=e9e7079845374e6f847cab86ad9166b3, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:45.769952 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648ef83-c154-4333-bee4-9388bc667a8a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:45.866773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1422/2849] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:49:45 2022] PUT /identity/v3/projects/9f9f764e37d94c1ba05f4a518782a622/users/e9e7079845374e6f847cab86ad9166b3/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:49:45.871357 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20333a3f-d2c0-4b52-a78b-b7c488e5ae9d admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:45.884128 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20333a3f-d2c0-4b52-a78b-b7c488e5ae9d admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:45.954236 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168d2c0-7517-4390-b408-cf879ca7a7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:45.954833 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168d2c0-7517-4390-b408-cf879ca7a7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:45.955112 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168d2c0-7517-4390-b408-cf879ca7a7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:45.955440 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168d2c0-7517-4390-b408-cf879ca7a7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:45.956076 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168d2c0-7517-4390-b408-cf879ca7a7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:45.957803 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168d2c0-7517-4390-b408-cf879ca7a7c3 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:45.967718 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1428/2850] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:49:45.972091 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648ef83-c154-4333-bee4-9388bc667a8a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:45.982976 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648ef83-c154-4333-bee4-9388bc667a8a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:45.987750 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d8490-6db5-45ce-97e1-1e9788fea151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:45.989799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d8490-6db5-45ce-97e1-1e9788fea151 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:45.989799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d8490-6db5-45ce-97e1-1e9788fea151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:45.989799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d8490-6db5-45ce-97e1-1e9788fea151 admin admin] PATH_INFO: `/v3/projects/9f9f764e37d94c1ba05f4a518782a622/users/e9e7079845374e6f847cab86ad9166b3/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:45.991604 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d8490-6db5-45ce-97e1-1e9788fea151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f9f764e37d94c1ba05f4a518782a622, user_id=e9e7079845374e6f847cab86ad9166b3, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:45.994268 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d8490-6db5-45ce-97e1-1e9788fea151 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:46.005524 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1423/2851] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:49:45 2022] PUT /identity/v3/projects/9f9f764e37d94c1ba05f4a518782a622/users/e9e7079845374e6f847cab86ad9166b3/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:49:46.015676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63422bb8-85b0-494c-a5b9-440cce61d923 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:46.015965 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63422bb8-85b0-494c-a5b9-440cce61d923 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:46.016246 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63422bb8-85b0-494c-a5b9-440cce61d923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:46.045966 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-63422bb8-85b0-494c-a5b9-440cce61d923 None None] MFA Rules not processed for user `e9e7079845374e6f847cab86ad9166b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:49:46.047134 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-63422bb8-85b0-494c-a5b9-440cce61d923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:46.117462 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1429/2852] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:49:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:49:46.128667 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d8490-6db5-45ce-97e1-1e9788fea151 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:46.134226 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7a5d8490-6db5-45ce-97e1-1e9788fea151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:46.154356 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:46.231668 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d8490-6db5-45ce-97e1-1e9788fea151 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:46.237528 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d190da8-7919-4232-b3ec-50c4b372e299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:46.238177 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d190da8-7919-4232-b3ec-50c4b372e299 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:46.238566 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d190da8-7919-4232-b3ec-50c4b372e299 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:46.238912 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d190da8-7919-4232-b3ec-50c4b372e299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:46.251784 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d190da8-7919-4232-b3ec-50c4b372e299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:46.253264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d190da8-7919-4232-b3ec-50c4b372e299 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:46.263805 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1424/2853] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:49:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:49:47.200196 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63422bb8-85b0-494c-a5b9-440cce61d923 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:47.227226 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:47.266109 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63422bb8-85b0-494c-a5b9-440cce61d923 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:47.270835 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4915da1-9be5-4ef2-8b2d-8c3923a0470f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:47.271464 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4915da1-9be5-4ef2-8b2d-8c3923a0470f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:47.271966 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4915da1-9be5-4ef2-8b2d-8c3923a0470f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:47.272120 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4915da1-9be5-4ef2-8b2d-8c3923a0470f admin admin] PATH_INFO: `/v3/users/5c50580fc1934d64b31c2b98a02d1392` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:47.273185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4915da1-9be5-4ef2-8b2d-8c3923a0470f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c50580fc1934d64b31c2b98a02d1392)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:47.275218 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4915da1-9be5-4ef2-8b2d-8c3923a0470f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:47.497349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b4915da1-9be5-4ef2-8b2d-8c3923a0470f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c50580fc1934d64b31c2b98a02d1392'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:47.571866 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b4915da1-9be5-4ef2-8b2d-8c3923a0470f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c50580fc1934d64b31c2b98a02d1392'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:47.585940 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b4915da1-9be5-4ef2-8b2d-8c3923a0470f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c50580fc1934d64b31c2b98a02d1392'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:47.591430 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b4915da1-9be5-4ef2-8b2d-8c3923a0470f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c50580fc1934d64b31c2b98a02d1392'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:47.593811 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b4915da1-9be5-4ef2-8b2d-8c3923a0470f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c50580fc1934d64b31c2b98a02d1392'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:47.600486 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1430/2854] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:49:47 2022] DELETE /identity/v3/users/5c50580fc1934d64b31c2b98a02d1392 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:49:47.605201 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273c214-fd2f-4039-b3c2-701e09e16353 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:47.605699 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273c214-fd2f-4039-b3c2-701e09e16353 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:47.605804 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273c214-fd2f-4039-b3c2-701e09e16353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:47.626250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e273c214-fd2f-4039-b3c2-701e09e16353 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:49:47.627475 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e273c214-fd2f-4039-b3c2-701e09e16353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:47.688646 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1425/2855] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:49:47.698931 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4915da1-9be5-4ef2-8b2d-8c3923a0470f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:47.700351 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b4915da1-9be5-4ef2-8b2d-8c3923a0470f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:47.758464 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4915da1-9be5-4ef2-8b2d-8c3923a0470f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:47.762299 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7de6e2-b5f0-4328-989c-aff4ccc0f420 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:47.762904 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7de6e2-b5f0-4328-989c-aff4ccc0f420 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:47.763181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7de6e2-b5f0-4328-989c-aff4ccc0f420 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:47.763452 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7de6e2-b5f0-4328-989c-aff4ccc0f420 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:47.773321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7de6e2-b5f0-4328-989c-aff4ccc0f420 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:47.774757 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7de6e2-b5f0-4328-989c-aff4ccc0f420 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:47.784292 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1431/2856] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:49:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:49:48.250261 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273c214-fd2f-4039-b3c2-701e09e16353 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:48.252116 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e273c214-fd2f-4039-b3c2-701e09e16353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:48.268800 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273c214-fd2f-4039-b3c2-701e09e16353 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:48.276316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dc3e9-41d1-491d-bf35-877801ff4f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:48.277231 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dc3e9-41d1-491d-bf35-877801ff4f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:48.277715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dc3e9-41d1-491d-bf35-877801ff4f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:48.278051 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dc3e9-41d1-491d-bf35-877801ff4f68 admin admin] PATH_INFO: `/v3/projects/b42929c61bfa49d1bd28d25c3881831d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:48.279449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245dc3e9-41d1-491d-bf35-877801ff4f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b42929c61bfa49d1bd28d25c3881831d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:48.281773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245dc3e9-41d1-491d-bf35-877801ff4f68 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:48.392114 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-245dc3e9-41d1-491d-bf35-877801ff4f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b42929c61bfa49d1bd28d25c3881831d', 'request_id': 'req-245dc3e9-41d1-491d-bf35-877801ff4f68'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:48.398459 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-245dc3e9-41d1-491d-bf35-877801ff4f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b42929c61bfa49d1bd28d25c3881831d', 'request_id': 'req-245dc3e9-41d1-491d-bf35-877801ff4f68'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:48.460080 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-245dc3e9-41d1-491d-bf35-877801ff4f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b42929c61bfa49d1bd28d25c3881831d', 'request_id': 'req-245dc3e9-41d1-491d-bf35-877801ff4f68'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:48.471514 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-245dc3e9-41d1-491d-bf35-877801ff4f68 admin admin] The token cache is being invalidate because project b42929c61bfa49d1bd28d25c3881831d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:49:48.471799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-245dc3e9-41d1-491d-bf35-877801ff4f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:48.472449 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-245dc3e9-41d1-491d-bf35-877801ff4f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:48.474204 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1426/2857] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:49:48 2022] DELETE /identity/v3/projects/b42929c61bfa49d1bd28d25c3881831d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:49:48.478861 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7de6e2-b5f0-4328-989c-aff4ccc0f420 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:48.490055 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7de6e2-b5f0-4328-989c-aff4ccc0f420 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:48.532092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:48.550113 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24159497-c6ea-4536-a06f-a9ed015861c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:48.550739 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24159497-c6ea-4536-a06f-a9ed015861c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:48.551015 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24159497-c6ea-4536-a06f-a9ed015861c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:48.551865 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24159497-c6ea-4536-a06f-a9ed015861c1 admin admin] PATH_INFO: `/v3/users/e9e7079845374e6f847cab86ad9166b3` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:48.555706 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24159497-c6ea-4536-a06f-a9ed015861c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e7079845374e6f847cab86ad9166b3)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:48.555706 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24159497-c6ea-4536-a06f-a9ed015861c1 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:48.751580 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-24159497-c6ea-4536-a06f-a9ed015861c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e7079845374e6f847cab86ad9166b3'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:48.825462 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-24159497-c6ea-4536-a06f-a9ed015861c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e7079845374e6f847cab86ad9166b3'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:48.839690 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-24159497-c6ea-4536-a06f-a9ed015861c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e7079845374e6f847cab86ad9166b3'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:48.840386 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-24159497-c6ea-4536-a06f-a9ed015861c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e7079845374e6f847cab86ad9166b3'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:48.847289 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-24159497-c6ea-4536-a06f-a9ed015861c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e7079845374e6f847cab86ad9166b3'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:48.853768 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1432/2858] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:49:48 2022] DELETE /identity/v3/users/e9e7079845374e6f847cab86ad9166b3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:49:49.318150 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dc3e9-41d1-491d-bf35-877801ff4f68 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:49.319713 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-245dc3e9-41d1-491d-bf35-877801ff4f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:49.333748 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dc3e9-41d1-491d-bf35-877801ff4f68 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:49.360876 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:49.393566 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861853c-6290-4aae-bbde-8aec3fd102b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:49.394203 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861853c-6290-4aae-bbde-8aec3fd102b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:49.394486 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861853c-6290-4aae-bbde-8aec3fd102b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:49.394760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861853c-6290-4aae-bbde-8aec3fd102b3 admin admin] PATH_INFO: `/v3/projects/9f9f764e37d94c1ba05f4a518782a622` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:49.396528 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861853c-6290-4aae-bbde-8aec3fd102b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f9f764e37d94c1ba05f4a518782a622)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:49.398471 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861853c-6290-4aae-bbde-8aec3fd102b3 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:49.517515 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4861853c-6290-4aae-bbde-8aec3fd102b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f9f764e37d94c1ba05f4a518782a622', 'request_id': 'req-4861853c-6290-4aae-bbde-8aec3fd102b3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:49.523759 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4861853c-6290-4aae-bbde-8aec3fd102b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f9f764e37d94c1ba05f4a518782a622', 'request_id': 'req-4861853c-6290-4aae-bbde-8aec3fd102b3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:49.613462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4861853c-6290-4aae-bbde-8aec3fd102b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f9f764e37d94c1ba05f4a518782a622', 'request_id': 'req-4861853c-6290-4aae-bbde-8aec3fd102b3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:49.625695 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4861853c-6290-4aae-bbde-8aec3fd102b3 admin admin] The token cache is being invalidate because project 9f9f764e37d94c1ba05f4a518782a622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:49:49.625969 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4861853c-6290-4aae-bbde-8aec3fd102b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:49.626693 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4861853c-6290-4aae-bbde-8aec3fd102b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:49.628244 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1427/2859] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:49:49 2022] DELETE /identity/v3/projects/9f9f764e37d94c1ba05f4a518782a622 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:49:49.633528 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56317ab-e198-453f-9299-680fedd19064 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:49.634011 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56317ab-e198-453f-9299-680fedd19064 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:49.634123 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56317ab-e198-453f-9299-680fedd19064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:49.654597 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-e56317ab-e198-453f-9299-680fedd19064 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:49:49.655858 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e56317ab-e198-453f-9299-680fedd19064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:49.716382 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1433/2860] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:49:49.725495 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed58daa-c906-45b0-a476-44047abdbc44 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:49.725790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed58daa-c906-45b0-a476-44047abdbc44 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:49.726071 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed58daa-c906-45b0-a476-44047abdbc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:49.746007 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-fed58daa-c906-45b0-a476-44047abdbc44 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:49:49.747331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fed58daa-c906-45b0-a476-44047abdbc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:49.755982 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1428/2861] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:49:49.760280 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56317ab-e198-453f-9299-680fedd19064 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:49.770022 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56317ab-e198-453f-9299-680fedd19064 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:49.775234 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c5efe-838b-4a8d-86c2-dec5a58df10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:49.775823 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c5efe-838b-4a8d-86c2-dec5a58df10c admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:49.776098 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c5efe-838b-4a8d-86c2-dec5a58df10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:49.776367 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c5efe-838b-4a8d-86c2-dec5a58df10c admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:49.777007 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c5efe-838b-4a8d-86c2-dec5a58df10c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:49:49.777335 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c5efe-838b-4a8d-86c2-dec5a58df10c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:49.778923 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c5efe-838b-4a8d-86c2-dec5a58df10c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:49.790507 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1434/2862] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:49:49.794749 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed58daa-c906-45b0-a476-44047abdbc44 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:49.803964 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed58daa-c906-45b0-a476-44047abdbc44 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:49.808779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4883bf-4df0-4f09-bd2e-ac43f32fb3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:49.809422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4883bf-4df0-4f09-bd2e-ac43f32fb3ce admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:49.809704 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4883bf-4df0-4f09-bd2e-ac43f32fb3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:49.809977 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4883bf-4df0-4f09-bd2e-ac43f32fb3ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:49.810652 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4883bf-4df0-4f09-bd2e-ac43f32fb3ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:49.812559 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4883bf-4df0-4f09-bd2e-ac43f32fb3ce admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:49.901761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1429/2863] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:49:49 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:49:49.905957 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c5efe-838b-4a8d-86c2-dec5a58df10c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:49.916159 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c5efe-838b-4a8d-86c2-dec5a58df10c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:49.968591 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:49.978527 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5918f-3ea7-460e-8ac7-08d5159fe506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:49.979136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5918f-3ea7-460e-8ac7-08d5159fe506 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:49.979418 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5918f-3ea7-460e-8ac7-08d5159fe506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:49.979691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5918f-3ea7-460e-8ac7-08d5159fe506 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:49.980321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5918f-3ea7-460e-8ac7-08d5159fe506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:49.982352 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5918f-3ea7-460e-8ac7-08d5159fe506 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:50.094298 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1435/2864] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:49:49 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:49:50.098355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4883bf-4df0-4f09-bd2e-ac43f32fb3ce admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:50.109539 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4883bf-4df0-4f09-bd2e-ac43f32fb3ce admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:50.114163 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d20e1-bce0-40fe-a0c9-74ed340cde31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:50.114764 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d20e1-bce0-40fe-a0c9-74ed340cde31 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:50.115043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d20e1-bce0-40fe-a0c9-74ed340cde31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:50.115315 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d20e1-bce0-40fe-a0c9-74ed340cde31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:50.115959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d20e1-bce0-40fe-a0c9-74ed340cde31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:50.118705 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d20e1-bce0-40fe-a0c9-74ed340cde31 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:50.129129 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1430/2865] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:49:50.133932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5918f-3ea7-460e-8ac7-08d5159fe506 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:50.144506 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5918f-3ea7-460e-8ac7-08d5159fe506 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:50.150005 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dc701-99be-4834-810a-0d7b2da1e1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:50.150624 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dc701-99be-4834-810a-0d7b2da1e1be admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:50.150906 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dc701-99be-4834-810a-0d7b2da1e1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:50.151181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dc701-99be-4834-810a-0d7b2da1e1be admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:50.151884 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80dc701-99be-4834-810a-0d7b2da1e1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:50.153492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80dc701-99be-4834-810a-0d7b2da1e1be admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:50.165337 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1436/2866] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:49:50.169805 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d20e1-bce0-40fe-a0c9-74ed340cde31 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:50.180013 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d20e1-bce0-40fe-a0c9-74ed340cde31 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:50.184574 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ae87f-0f53-4581-bded-8118f94eaee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:50.185259 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ae87f-0f53-4581-bded-8118f94eaee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:50.185545 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ae87f-0f53-4581-bded-8118f94eaee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:50.185822 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ae87f-0f53-4581-bded-8118f94eaee8 admin admin] PATH_INFO: `/v3/projects/7e9c7cde2382496294b51f0355478057/users/fdf457e6a4604276b10c15483deced40/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:50.200942 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ae87f-0f53-4581-bded-8118f94eaee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e9c7cde2382496294b51f0355478057, user_id=fdf457e6a4604276b10c15483deced40, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:50.203903 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ae87f-0f53-4581-bded-8118f94eaee8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:50.277896 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1431/2867] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:49:50 2022] PUT /identity/v3/projects/7e9c7cde2382496294b51f0355478057/users/fdf457e6a4604276b10c15483deced40/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:49:50.288887 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c80874-4755-4b50-9ccd-5870b7a73834 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:50.289276 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c80874-4755-4b50-9ccd-5870b7a73834 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:50.289548 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c80874-4755-4b50-9ccd-5870b7a73834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:50.317854 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-05c80874-4755-4b50-9ccd-5870b7a73834 None None] MFA Rules not processed for user `fdf457e6a4604276b10c15483deced40`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:49:50.319227 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-05c80874-4755-4b50-9ccd-5870b7a73834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:50.384899 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1437/2868] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:49:50.389724 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ae87f-0f53-4581-bded-8118f94eaee8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:50.441089 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:50.452412 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ae87f-0f53-4581-bded-8118f94eaee8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:50.457620 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c757b9-42cf-4f77-b25a-aaf205bfc2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:50.458264 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c757b9-42cf-4f77-b25a-aaf205bfc2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:50.458540 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c757b9-42cf-4f77-b25a-aaf205bfc2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:50.458811 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c757b9-42cf-4f77-b25a-aaf205bfc2a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:50.459432 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c757b9-42cf-4f77-b25a-aaf205bfc2a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:50.462031 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c757b9-42cf-4f77-b25a-aaf205bfc2a7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:50.588151 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1432/2869] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:49:50 2022] POST /identity/v3/projects => generated 387 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:49:50.592343 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c80874-4755-4b50-9ccd-5870b7a73834 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:50.603613 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c80874-4755-4b50-9ccd-5870b7a73834 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:50.659570 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e43c05-1cec-467d-96ba-98ec76162aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:50.660228 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e43c05-1cec-467d-96ba-98ec76162aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:50.660428 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e43c05-1cec-467d-96ba-98ec76162aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:50.660694 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e43c05-1cec-467d-96ba-98ec76162aa3 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:50.661355 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e43c05-1cec-467d-96ba-98ec76162aa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:50.663878 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e43c05-1cec-467d-96ba-98ec76162aa3 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:50.745728 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1438/2870] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:49:50 2022] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:49:50.749729 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c757b9-42cf-4f77-b25a-aaf205bfc2a7 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:50.760599 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c757b9-42cf-4f77-b25a-aaf205bfc2a7 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:50.766486 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20567d90-e514-45eb-9d27-7244d7aaacc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:50.766486 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20567d90-e514-45eb-9d27-7244d7aaacc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:50.766486 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20567d90-e514-45eb-9d27-7244d7aaacc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:50.766486 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20567d90-e514-45eb-9d27-7244d7aaacc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:50.767117 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20567d90-e514-45eb-9d27-7244d7aaacc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:50.768766 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20567d90-e514-45eb-9d27-7244d7aaacc9 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:50.780073 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1433/2871] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:49:50.784006 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e43c05-1cec-467d-96ba-98ec76162aa3 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:50.795136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e43c05-1cec-467d-96ba-98ec76162aa3 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:50.800071 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755a1ea-2e42-46d5-9ad0-3a96a7309b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:50.800733 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755a1ea-2e42-46d5-9ad0-3a96a7309b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:50.806503 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755a1ea-2e42-46d5-9ad0-3a96a7309b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:50.806503 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755a1ea-2e42-46d5-9ad0-3a96a7309b9e admin admin] PATH_INFO: `/v3/projects/3116550c9d404be4a5a506ac10a9b907/users/6f19dd20fec944e3aadeb17d06c79fb1/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:50.818198 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755a1ea-2e42-46d5-9ad0-3a96a7309b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3116550c9d404be4a5a506ac10a9b907, user_id=6f19dd20fec944e3aadeb17d06c79fb1, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:50.820890 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755a1ea-2e42-46d5-9ad0-3a96a7309b9e admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:50.906394 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1439/2872] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:49:50 2022] PUT /identity/v3/projects/3116550c9d404be4a5a506ac10a9b907/users/6f19dd20fec944e3aadeb17d06c79fb1/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:49:50.910426 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20567d90-e514-45eb-9d27-7244d7aaacc9 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:50.922191 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20567d90-e514-45eb-9d27-7244d7aaacc9 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:50.988146 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550195d1-9a0e-4918-ba84-375797c82973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:50.988761 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550195d1-9a0e-4918-ba84-375797c82973 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:50.989043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550195d1-9a0e-4918-ba84-375797c82973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:50.989345 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550195d1-9a0e-4918-ba84-375797c82973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:50.989992 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550195d1-9a0e-4918-ba84-375797c82973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:50.992239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550195d1-9a0e-4918-ba84-375797c82973 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:51.002026 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1434/2873] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:49:51.006185 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755a1ea-2e42-46d5-9ad0-3a96a7309b9e admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:51.018537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755a1ea-2e42-46d5-9ad0-3a96a7309b9e admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:51.023722 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fca46a-8bd3-4469-8457-04b54f82f1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:51.024384 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fca46a-8bd3-4469-8457-04b54f82f1e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:51.033648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fca46a-8bd3-4469-8457-04b54f82f1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:51.033648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fca46a-8bd3-4469-8457-04b54f82f1e8 admin admin] PATH_INFO: `/v3/projects/3116550c9d404be4a5a506ac10a9b907/users/6f19dd20fec944e3aadeb17d06c79fb1/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:51.033648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fca46a-8bd3-4469-8457-04b54f82f1e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3116550c9d404be4a5a506ac10a9b907, user_id=6f19dd20fec944e3aadeb17d06c79fb1, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:51.033648 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fca46a-8bd3-4469-8457-04b54f82f1e8 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:51.041239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1440/2874] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:49:51 2022] PUT /identity/v3/projects/3116550c9d404be4a5a506ac10a9b907/users/6f19dd20fec944e3aadeb17d06c79fb1/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:49:51.052380 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bc5ab-f262-4ffc-810e-19e0add3aa01 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:51.052702 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bc5ab-f262-4ffc-810e-19e0add3aa01 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:51.053007 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bc5ab-f262-4ffc-810e-19e0add3aa01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:51.082922 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-906bc5ab-f262-4ffc-810e-19e0add3aa01 None None] MFA Rules not processed for user `6f19dd20fec944e3aadeb17d06c79fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:49:51.084135 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-906bc5ab-f262-4ffc-810e-19e0add3aa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:51.156172 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1435/2875] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:49:51 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:49:51.168152 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fca46a-8bd3-4469-8457-04b54f82f1e8 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:51.169927 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-17fca46a-8bd3-4469-8457-04b54f82f1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:51.184136 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:51.228236 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fca46a-8bd3-4469-8457-04b54f82f1e8 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:51.231947 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957f9fc-e6f6-42c3-bb29-3d3ce56b2c9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:51.232546 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957f9fc-e6f6-42c3-bb29-3d3ce56b2c9a service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:51.232821 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957f9fc-e6f6-42c3-bb29-3d3ce56b2c9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:51.233113 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957f9fc-e6f6-42c3-bb29-3d3ce56b2c9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:51.244761 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957f9fc-e6f6-42c3-bb29-3d3ce56b2c9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:51.246252 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957f9fc-e6f6-42c3-bb29-3d3ce56b2c9a service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:51.255853 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1441/2876] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:49:51 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:49:51.289199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906bc5ab-f262-4ffc-810e-19e0add3aa01 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:51.343281 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:51.357774 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906bc5ab-f262-4ffc-810e-19e0add3aa01 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:51.362299 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272606c-ae83-4137-9669-bcec7022f365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:51.362922 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272606c-ae83-4137-9669-bcec7022f365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:51.363213 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272606c-ae83-4137-9669-bcec7022f365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:51.363466 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272606c-ae83-4137-9669-bcec7022f365 admin admin] PATH_INFO: `/v3/users/fdf457e6a4604276b10c15483deced40` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:51.364587 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272606c-ae83-4137-9669-bcec7022f365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdf457e6a4604276b10c15483deced40)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:51.366611 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272606c-ae83-4137-9669-bcec7022f365 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:51.596080 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1272606c-ae83-4137-9669-bcec7022f365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdf457e6a4604276b10c15483deced40'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:51.596753 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1272606c-ae83-4137-9669-bcec7022f365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdf457e6a4604276b10c15483deced40'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:51.688143 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1272606c-ae83-4137-9669-bcec7022f365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdf457e6a4604276b10c15483deced40'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:51.701825 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1272606c-ae83-4137-9669-bcec7022f365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdf457e6a4604276b10c15483deced40'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:51.702467 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1272606c-ae83-4137-9669-bcec7022f365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdf457e6a4604276b10c15483deced40'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:51.715077 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1436/2877] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:49:51 2022] DELETE /identity/v3/users/fdf457e6a4604276b10c15483deced40 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:49:51.719909 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919de31-bf95-4dd1-895f-9fc1cf97d519 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:51.720420 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919de31-bf95-4dd1-895f-9fc1cf97d519 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:51.720540 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919de31-bf95-4dd1-895f-9fc1cf97d519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:51.739826 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b919de31-bf95-4dd1-895f-9fc1cf97d519 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:49:51.741017 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b919de31-bf95-4dd1-895f-9fc1cf97d519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:51.806458 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1442/2878] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:49:51.816487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272606c-ae83-4137-9669-bcec7022f365 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:51.818036 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1272606c-ae83-4137-9669-bcec7022f365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:51.877498 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272606c-ae83-4137-9669-bcec7022f365 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:51.881243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147da593-faf7-4288-a55c-78e79cf3a334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:51.881875 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147da593-faf7-4288-a55c-78e79cf3a334 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:51.882198 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147da593-faf7-4288-a55c-78e79cf3a334 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:51.882586 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147da593-faf7-4288-a55c-78e79cf3a334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:51.891858 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147da593-faf7-4288-a55c-78e79cf3a334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:51.893310 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147da593-faf7-4288-a55c-78e79cf3a334 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:51.902830 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1437/2879] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:49:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:49:52.311342 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919de31-bf95-4dd1-895f-9fc1cf97d519 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:52.316795 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b919de31-bf95-4dd1-895f-9fc1cf97d519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:52.327516 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919de31-bf95-4dd1-895f-9fc1cf97d519 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:52.333009 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cf054-361a-4724-bf2d-97782b945651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:52.333713 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cf054-361a-4724-bf2d-97782b945651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:52.333995 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cf054-361a-4724-bf2d-97782b945651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:52.334268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cf054-361a-4724-bf2d-97782b945651 admin admin] PATH_INFO: `/v3/projects/7e9c7cde2382496294b51f0355478057` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:52.336110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03cf054-361a-4724-bf2d-97782b945651 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e9c7cde2382496294b51f0355478057)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:52.338416 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03cf054-361a-4724-bf2d-97782b945651 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:52.473850 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e03cf054-361a-4724-bf2d-97782b945651 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e9c7cde2382496294b51f0355478057', 'request_id': 'req-e03cf054-361a-4724-bf2d-97782b945651'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:52.480407 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e03cf054-361a-4724-bf2d-97782b945651 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e9c7cde2382496294b51f0355478057', 'request_id': 'req-e03cf054-361a-4724-bf2d-97782b945651'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:52.544885 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e03cf054-361a-4724-bf2d-97782b945651 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e9c7cde2382496294b51f0355478057', 'request_id': 'req-e03cf054-361a-4724-bf2d-97782b945651'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:52.556701 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e03cf054-361a-4724-bf2d-97782b945651 admin admin] The token cache is being invalidate because project 7e9c7cde2382496294b51f0355478057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:49:52.556984 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e03cf054-361a-4724-bf2d-97782b945651 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:52.557668 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e03cf054-361a-4724-bf2d-97782b945651 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:52.559135 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1443/2880] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:49:52 2022] DELETE /identity/v3/projects/7e9c7cde2382496294b51f0355478057 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:49:52.563120 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147da593-faf7-4288-a55c-78e79cf3a334 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:52.575791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147da593-faf7-4288-a55c-78e79cf3a334 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:52.636764 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d12c5b-db5f-446f-8d3e-26a501fe5915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:52.637519 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d12c5b-db5f-446f-8d3e-26a501fe5915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:52.637702 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d12c5b-db5f-446f-8d3e-26a501fe5915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:52.637974 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d12c5b-db5f-446f-8d3e-26a501fe5915 admin admin] PATH_INFO: `/v3/users/6f19dd20fec944e3aadeb17d06c79fb1` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:52.639215 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d12c5b-db5f-446f-8d3e-26a501fe5915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f19dd20fec944e3aadeb17d06c79fb1)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:52.641166 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d12c5b-db5f-446f-8d3e-26a501fe5915 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:52.654061 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:52.843485 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-52d12c5b-db5f-446f-8d3e-26a501fe5915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f19dd20fec944e3aadeb17d06c79fb1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:52.844157 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-52d12c5b-db5f-446f-8d3e-26a501fe5915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f19dd20fec944e3aadeb17d06c79fb1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:52.928298 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-52d12c5b-db5f-446f-8d3e-26a501fe5915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f19dd20fec944e3aadeb17d06c79fb1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:52.950240 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-52d12c5b-db5f-446f-8d3e-26a501fe5915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f19dd20fec944e3aadeb17d06c79fb1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:52.951373 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-52d12c5b-db5f-446f-8d3e-26a501fe5915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f19dd20fec944e3aadeb17d06c79fb1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:52.974773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1438/2881] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:49:52 2022] DELETE /identity/v3/users/6f19dd20fec944e3aadeb17d06c79fb1 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:49:53.395916 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cf054-361a-4724-bf2d-97782b945651 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:53.398627 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e03cf054-361a-4724-bf2d-97782b945651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:53.415113 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cf054-361a-4724-bf2d-97782b945651 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:53.465663 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:53.504583 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330a3b4-eeb6-4a47-9a85-9fdf0b383f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:53.506473 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330a3b4-eeb6-4a47-9a85-9fdf0b383f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:53.507625 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330a3b4-eeb6-4a47-9a85-9fdf0b383f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:53.508304 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330a3b4-eeb6-4a47-9a85-9fdf0b383f5d admin admin] PATH_INFO: `/v3/projects/3116550c9d404be4a5a506ac10a9b907` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:53.511120 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330a3b4-eeb6-4a47-9a85-9fdf0b383f5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3116550c9d404be4a5a506ac10a9b907)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:53.516789 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0330a3b4-eeb6-4a47-9a85-9fdf0b383f5d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:53.629079 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0330a3b4-eeb6-4a47-9a85-9fdf0b383f5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3116550c9d404be4a5a506ac10a9b907', 'request_id': 'req-0330a3b4-eeb6-4a47-9a85-9fdf0b383f5d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:53.634554 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0330a3b4-eeb6-4a47-9a85-9fdf0b383f5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3116550c9d404be4a5a506ac10a9b907', 'request_id': 'req-0330a3b4-eeb6-4a47-9a85-9fdf0b383f5d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:53.681985 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0330a3b4-eeb6-4a47-9a85-9fdf0b383f5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3116550c9d404be4a5a506ac10a9b907', 'request_id': 'req-0330a3b4-eeb6-4a47-9a85-9fdf0b383f5d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:53.693809 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0330a3b4-eeb6-4a47-9a85-9fdf0b383f5d admin admin] The token cache is being invalidate because project 3116550c9d404be4a5a506ac10a9b907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:49:53.694097 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0330a3b4-eeb6-4a47-9a85-9fdf0b383f5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:53.695049 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0330a3b4-eeb6-4a47-9a85-9fdf0b383f5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:53.696567 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1444/2882] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:49:53 2022] DELETE /identity/v3/projects/3116550c9d404be4a5a506ac10a9b907 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:49:53.701670 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52550ff7-0d50-4200-8061-6fb9201b6875 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:53.702165 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52550ff7-0d50-4200-8061-6fb9201b6875 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:53.702289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52550ff7-0d50-4200-8061-6fb9201b6875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:53.723791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-52550ff7-0d50-4200-8061-6fb9201b6875 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:49:53.728499 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-52550ff7-0d50-4200-8061-6fb9201b6875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:53.783008 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1439/2883] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:49:53.791204 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437d3c0-5bd9-4bac-93f6-8ebfbcbde480 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:53.791488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437d3c0-5bd9-4bac-93f6-8ebfbcbde480 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:53.791757 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437d3c0-5bd9-4bac-93f6-8ebfbcbde480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:53.811085 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-1437d3c0-5bd9-4bac-93f6-8ebfbcbde480 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:49:53.812250 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1437d3c0-5bd9-4bac-93f6-8ebfbcbde480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:53.819996 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1445/2884] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:49:53.824112 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52550ff7-0d50-4200-8061-6fb9201b6875 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:53.834058 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52550ff7-0d50-4200-8061-6fb9201b6875 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:53.839133 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf19794-1bb3-49ae-9aaa-606f060e837e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:53.839723 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19794-1bb3-49ae-9aaa-606f060e837e admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:53.839999 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19794-1bb3-49ae-9aaa-606f060e837e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:53.840270 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19794-1bb3-49ae-9aaa-606f060e837e admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:53.840906 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf19794-1bb3-49ae-9aaa-606f060e837e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:49:53.841244 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf19794-1bb3-49ae-9aaa-606f060e837e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:53.842833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf19794-1bb3-49ae-9aaa-606f060e837e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:53.854913 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1440/2885] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:49:53.859339 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437d3c0-5bd9-4bac-93f6-8ebfbcbde480 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:53.869620 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437d3c0-5bd9-4bac-93f6-8ebfbcbde480 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:53.874586 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27fd90-9d71-42e6-bdab-e976cbc07d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:53.875182 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27fd90-9d71-42e6-bdab-e976cbc07d13 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:53.875488 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27fd90-9d71-42e6-bdab-e976cbc07d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:53.875758 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27fd90-9d71-42e6-bdab-e976cbc07d13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:53.876392 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27fd90-9d71-42e6-bdab-e976cbc07d13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:53.878321 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27fd90-9d71-42e6-bdab-e976cbc07d13 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:53.973816 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1446/2886] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:49:53 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 14:49:53.978730 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf19794-1bb3-49ae-9aaa-606f060e837e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:53.988935 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf19794-1bb3-49ae-9aaa-606f060e837e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:54.044490 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c4c7e-ad78-4d19-913f-529a53f38938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:54.045119 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c4c7e-ad78-4d19-913f-529a53f38938 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:54.045421 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c4c7e-ad78-4d19-913f-529a53f38938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:54.045692 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c4c7e-ad78-4d19-913f-529a53f38938 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:54.046425 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c4c7e-ad78-4d19-913f-529a53f38938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:54.048331 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c4c7e-ad78-4d19-913f-529a53f38938 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:54.138205 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1441/2887] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:49:53 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:49:54.142805 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27fd90-9d71-42e6-bdab-e976cbc07d13 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:54.153624 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27fd90-9d71-42e6-bdab-e976cbc07d13 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:54.158200 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f1c88-9744-423d-9724-f50b621163f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:54.158787 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f1c88-9744-423d-9724-f50b621163f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:54.159063 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f1c88-9744-423d-9724-f50b621163f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:54.159388 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f1c88-9744-423d-9724-f50b621163f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:54.160022 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f1c88-9744-423d-9724-f50b621163f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:54.161694 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f1c88-9744-423d-9724-f50b621163f8 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:54.172841 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1447/2888] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:49:54.177202 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c4c7e-ad78-4d19-913f-529a53f38938 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:54.190547 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c4c7e-ad78-4d19-913f-529a53f38938 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:54.195964 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32796d-5f8c-4b3f-bbcc-c718f0bd6b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:54.196584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32796d-5f8c-4b3f-bbcc-c718f0bd6b47 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:54.196866 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32796d-5f8c-4b3f-bbcc-c718f0bd6b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:54.197172 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32796d-5f8c-4b3f-bbcc-c718f0bd6b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:54.197827 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32796d-5f8c-4b3f-bbcc-c718f0bd6b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:54.199465 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32796d-5f8c-4b3f-bbcc-c718f0bd6b47 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:54.200958 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:54.216872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1442/2889] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:49:54.221932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f1c88-9744-423d-9724-f50b621163f8 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:54.236181 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f1c88-9744-423d-9724-f50b621163f8 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:54.240001 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fc6f1-5def-42e1-9759-dbcb975a73c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:54.240659 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fc6f1-5def-42e1-9759-dbcb975a73c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:54.240936 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fc6f1-5def-42e1-9759-dbcb975a73c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:54.241308 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fc6f1-5def-42e1-9759-dbcb975a73c3 admin admin] PATH_INFO: `/v3/projects/65b418ad55734592b8b1ffffcaf92259/users/b34a3eb7f5604aaca06fd62d8b8f0751/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:54.257284 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fc6f1-5def-42e1-9759-dbcb975a73c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b418ad55734592b8b1ffffcaf92259, user_id=b34a3eb7f5604aaca06fd62d8b8f0751, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:54.259982 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fc6f1-5def-42e1-9759-dbcb975a73c3 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:54.345251 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1448/2890] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:49:54 2022] PUT /identity/v3/projects/65b418ad55734592b8b1ffffcaf92259/users/b34a3eb7f5604aaca06fd62d8b8f0751/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:49:54.356243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbd499-41d5-4344-b587-2a97aa5d3b2b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:54.356525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbd499-41d5-4344-b587-2a97aa5d3b2b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:54.356915 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbd499-41d5-4344-b587-2a97aa5d3b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:54.386105 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-fbdbd499-41d5-4344-b587-2a97aa5d3b2b None None] MFA Rules not processed for user `b34a3eb7f5604aaca06fd62d8b8f0751`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:49:54.387389 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fbdbd499-41d5-4344-b587-2a97aa5d3b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:54.463158 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1443/2891] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:49:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:49:54.467797 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fc6f1-5def-42e1-9759-dbcb975a73c3 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:54.530761 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fc6f1-5def-42e1-9759-dbcb975a73c3 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:54.535862 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92197c3b-2386-4a41-9257-eb17c29e7faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:54.536495 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92197c3b-2386-4a41-9257-eb17c29e7faf admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:54.536777 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92197c3b-2386-4a41-9257-eb17c29e7faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:54.537068 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92197c3b-2386-4a41-9257-eb17c29e7faf admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:54.537731 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92197c3b-2386-4a41-9257-eb17c29e7faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:54.540521 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92197c3b-2386-4a41-9257-eb17c29e7faf admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:54.550700 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:54.643687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1449/2892] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:49:54 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:49:54.648550 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbd499-41d5-4344-b587-2a97aa5d3b2b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:54.659618 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbd499-41d5-4344-b587-2a97aa5d3b2b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:54.717499 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223e7f4-951d-4940-9daf-a76ccfe23976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:54.718243 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223e7f4-951d-4940-9daf-a76ccfe23976 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:54.718461 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223e7f4-951d-4940-9daf-a76ccfe23976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:54.718738 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223e7f4-951d-4940-9daf-a76ccfe23976 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:54.719447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223e7f4-951d-4940-9daf-a76ccfe23976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:54.721728 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223e7f4-951d-4940-9daf-a76ccfe23976 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:54.806778 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1444/2893] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:49:54 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:49:54.811070 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92197c3b-2386-4a41-9257-eb17c29e7faf admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:54.822595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92197c3b-2386-4a41-9257-eb17c29e7faf admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:54.827627 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6dcb5-e4a2-46b6-bc68-cf4ba1f95691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:54.828478 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6dcb5-e4a2-46b6-bc68-cf4ba1f95691 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:54.828756 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6dcb5-e4a2-46b6-bc68-cf4ba1f95691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:54.829028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6dcb5-e4a2-46b6-bc68-cf4ba1f95691 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:54.829693 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6dcb5-e4a2-46b6-bc68-cf4ba1f95691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:54.831287 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6dcb5-e4a2-46b6-bc68-cf4ba1f95691 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:54.841823 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1450/2894] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:49:54.845936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223e7f4-951d-4940-9daf-a76ccfe23976 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:54.856861 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223e7f4-951d-4940-9daf-a76ccfe23976 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:54.861606 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd68ee-c69d-436e-84f6-35ae0174e4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:54.862249 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd68ee-c69d-436e-84f6-35ae0174e4a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:54.862790 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd68ee-c69d-436e-84f6-35ae0174e4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:54.862926 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd68ee-c69d-436e-84f6-35ae0174e4a0 admin admin] PATH_INFO: `/v3/projects/fff192c68985443992b32bbd5ba940bb/users/07489e1e12f247428e56dd46d0fa815f/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:54.878777 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd68ee-c69d-436e-84f6-35ae0174e4a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff192c68985443992b32bbd5ba940bb, user_id=07489e1e12f247428e56dd46d0fa815f, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:54.881497 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd68ee-c69d-436e-84f6-35ae0174e4a0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:54.951680 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1445/2895] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:49:54 2022] PUT /identity/v3/projects/fff192c68985443992b32bbd5ba940bb/users/07489e1e12f247428e56dd46d0fa815f/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:49:54.955981 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6dcb5-e4a2-46b6-bc68-cf4ba1f95691 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:54.966629 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6dcb5-e4a2-46b6-bc68-cf4ba1f95691 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:55.026106 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc47af5-f44a-48c9-8233-93b94eaf62bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:55.026708 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc47af5-f44a-48c9-8233-93b94eaf62bc admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:55.026986 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc47af5-f44a-48c9-8233-93b94eaf62bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:55.027361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc47af5-f44a-48c9-8233-93b94eaf62bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:55.027894 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc47af5-f44a-48c9-8233-93b94eaf62bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:55.029595 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc47af5-f44a-48c9-8233-93b94eaf62bc admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:55.041253 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1451/2896] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:49:55.045591 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd68ee-c69d-436e-84f6-35ae0174e4a0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:55.056947 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd68ee-c69d-436e-84f6-35ae0174e4a0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:55.061937 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b20d70-3d44-4a7b-873f-7707601709b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:55.064092 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b20d70-3d44-4a7b-873f-7707601709b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:55.064092 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b20d70-3d44-4a7b-873f-7707601709b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:55.064092 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b20d70-3d44-4a7b-873f-7707601709b6 admin admin] PATH_INFO: `/v3/projects/fff192c68985443992b32bbd5ba940bb/users/07489e1e12f247428e56dd46d0fa815f/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:55.065308 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b20d70-3d44-4a7b-873f-7707601709b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff192c68985443992b32bbd5ba940bb, user_id=07489e1e12f247428e56dd46d0fa815f, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:55.067940 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b20d70-3d44-4a7b-873f-7707601709b6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:55.079303 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1446/2897] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:49:55 2022] PUT /identity/v3/projects/fff192c68985443992b32bbd5ba940bb/users/07489e1e12f247428e56dd46d0fa815f/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:49:55.091349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b19580-4a4b-4a62-8157-1f63bd40eb45 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:55.091658 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b19580-4a4b-4a62-8157-1f63bd40eb45 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:55.091930 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b19580-4a4b-4a62-8157-1f63bd40eb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:55.121500 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-f5b19580-4a4b-4a62-8157-1f63bd40eb45 None None] MFA Rules not processed for user `07489e1e12f247428e56dd46d0fa815f`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:49:55.122726 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f5b19580-4a4b-4a62-8157-1f63bd40eb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:55.209098 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1452/2898] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:49:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:49:55.221960 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b20d70-3d44-4a7b-873f-7707601709b6 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:55.223642 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-39b20d70-3d44-4a7b-873f-7707601709b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:55.271333 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:55.288833 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b20d70-3d44-4a7b-873f-7707601709b6 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:55.292948 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402db192-f0c9-45e3-b51b-68352add9cc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:55.298081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402db192-f0c9-45e3-b51b-68352add9cc4 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:55.298081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402db192-f0c9-45e3-b51b-68352add9cc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:55.298081 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402db192-f0c9-45e3-b51b-68352add9cc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:55.303301 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402db192-f0c9-45e3-b51b-68352add9cc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:55.305093 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402db192-f0c9-45e3-b51b-68352add9cc4 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:55.314936 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1447/2899] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:49:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:49:55.390918 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b19580-4a4b-4a62-8157-1f63bd40eb45 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:55.455291 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b19580-4a4b-4a62-8157-1f63bd40eb45 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:55.460442 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439481b-b90c-43f9-9186-4cd16165e14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:55.461484 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439481b-b90c-43f9-9186-4cd16165e14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:55.461768 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439481b-b90c-43f9-9186-4cd16165e14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:55.462048 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439481b-b90c-43f9-9186-4cd16165e14f admin admin] PATH_INFO: `/v3/users/b34a3eb7f5604aaca06fd62d8b8f0751` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:55.463289 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439481b-b90c-43f9-9186-4cd16165e14f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b34a3eb7f5604aaca06fd62d8b8f0751)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:55.465322 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439481b-b90c-43f9-9186-4cd16165e14f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:55.466905 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:55.656356 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-2439481b-b90c-43f9-9186-4cd16165e14f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b34a3eb7f5604aaca06fd62d8b8f0751'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:55.731654 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-2439481b-b90c-43f9-9186-4cd16165e14f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b34a3eb7f5604aaca06fd62d8b8f0751'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:55.744553 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-2439481b-b90c-43f9-9186-4cd16165e14f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b34a3eb7f5604aaca06fd62d8b8f0751'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:55.745219 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-2439481b-b90c-43f9-9186-4cd16165e14f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b34a3eb7f5604aaca06fd62d8b8f0751'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:55.752089 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-2439481b-b90c-43f9-9186-4cd16165e14f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b34a3eb7f5604aaca06fd62d8b8f0751'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:55.758846 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1453/2900] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:49:55 2022] DELETE /identity/v3/users/b34a3eb7f5604aaca06fd62d8b8f0751 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:49:55.763423 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6ed4a-3a18-4d39-bbb9-5e91c5a96bff None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:55.763879 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6ed4a-3a18-4d39-bbb9-5e91c5a96bff None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:55.764015 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6ed4a-3a18-4d39-bbb9-5e91c5a96bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:55.787246 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b9a6ed4a-3a18-4d39-bbb9-5e91c5a96bff None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:49:55.788479 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b9a6ed4a-3a18-4d39-bbb9-5e91c5a96bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:55.849368 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1448/2901] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:49:55.859572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439481b-b90c-43f9-9186-4cd16165e14f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:55.861013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2439481b-b90c-43f9-9186-4cd16165e14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:55.919280 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439481b-b90c-43f9-9186-4cd16165e14f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:55.923074 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b6dbd-b031-4fe1-bd46-0d69805bda73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:55.923669 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b6dbd-b031-4fe1-bd46-0d69805bda73 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:55.923945 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b6dbd-b031-4fe1-bd46-0d69805bda73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:55.924265 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b6dbd-b031-4fe1-bd46-0d69805bda73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:55.933468 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b6dbd-b031-4fe1-bd46-0d69805bda73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:55.934915 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b6dbd-b031-4fe1-bd46-0d69805bda73 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:55.944377 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1454/2902] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:49:56.467250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6ed4a-3a18-4d39-bbb9-5e91c5a96bff None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:56.474462 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b9a6ed4a-3a18-4d39-bbb9-5e91c5a96bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:56.481989 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6ed4a-3a18-4d39-bbb9-5e91c5a96bff None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:56.486950 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbc7be-f160-4473-a308-fb6b142539bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:56.487585 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbc7be-f160-4473-a308-fb6b142539bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:56.487872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbc7be-f160-4473-a308-fb6b142539bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:56.488139 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbc7be-f160-4473-a308-fb6b142539bb admin admin] PATH_INFO: `/v3/projects/65b418ad55734592b8b1ffffcaf92259` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:56.489305 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bbc7be-f160-4473-a308-fb6b142539bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=65b418ad55734592b8b1ffffcaf92259)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:56.491277 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bbc7be-f160-4473-a308-fb6b142539bb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:56.655813 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-81bbc7be-f160-4473-a308-fb6b142539bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65b418ad55734592b8b1ffffcaf92259', 'request_id': 'req-81bbc7be-f160-4473-a308-fb6b142539bb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:56.661608 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-81bbc7be-f160-4473-a308-fb6b142539bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65b418ad55734592b8b1ffffcaf92259', 'request_id': 'req-81bbc7be-f160-4473-a308-fb6b142539bb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:56.796408 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-81bbc7be-f160-4473-a308-fb6b142539bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65b418ad55734592b8b1ffffcaf92259', 'request_id': 'req-81bbc7be-f160-4473-a308-fb6b142539bb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:56.808249 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-81bbc7be-f160-4473-a308-fb6b142539bb admin admin] The token cache is being invalidate because project 65b418ad55734592b8b1ffffcaf92259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:49:56.808532 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-81bbc7be-f160-4473-a308-fb6b142539bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:56.809258 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-81bbc7be-f160-4473-a308-fb6b142539bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:56.810805 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1449/2903] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:49:56 2022] DELETE /identity/v3/projects/65b418ad55734592b8b1ffffcaf92259 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:49:56.815000 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b6dbd-b031-4fe1-bd46-0d69805bda73 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:56.825427 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b6dbd-b031-4fe1-bd46-0d69805bda73 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:56.885027 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359bbc3-267e-4820-8573-1c16d4b01264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:56.885744 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359bbc3-267e-4820-8573-1c16d4b01264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:56.886017 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359bbc3-267e-4820-8573-1c16d4b01264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:56.886291 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359bbc3-267e-4820-8573-1c16d4b01264 admin admin] PATH_INFO: `/v3/users/07489e1e12f247428e56dd46d0fa815f` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:56.887411 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359bbc3-267e-4820-8573-1c16d4b01264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07489e1e12f247428e56dd46d0fa815f)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:56.889375 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359bbc3-267e-4820-8573-1c16d4b01264 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:56.912482 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:57.125766 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-7359bbc3-267e-4820-8573-1c16d4b01264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07489e1e12f247428e56dd46d0fa815f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:57.190879 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-7359bbc3-267e-4820-8573-1c16d4b01264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07489e1e12f247428e56dd46d0fa815f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:57.206510 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-7359bbc3-267e-4820-8573-1c16d4b01264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07489e1e12f247428e56dd46d0fa815f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:57.207802 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-7359bbc3-267e-4820-8573-1c16d4b01264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07489e1e12f247428e56dd46d0fa815f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:57.215587 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-7359bbc3-267e-4820-8573-1c16d4b01264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07489e1e12f247428e56dd46d0fa815f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:57.222466 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1455/2904] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:49:56 2022] DELETE /identity/v3/users/07489e1e12f247428e56dd46d0fa815f => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:49:57.656840 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbc7be-f160-4473-a308-fb6b142539bb admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:57.658323 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-81bbc7be-f160-4473-a308-fb6b142539bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:57.672126 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbc7be-f160-4473-a308-fb6b142539bb admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:57.732126 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41814c8-e40d-40ea-905a-38eef9495d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:57.734487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41814c8-e40d-40ea-905a-38eef9495d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:57.734487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41814c8-e40d-40ea-905a-38eef9495d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:57.734487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41814c8-e40d-40ea-905a-38eef9495d05 admin admin] PATH_INFO: `/v3/projects/fff192c68985443992b32bbd5ba940bb` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:57.734487 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41814c8-e40d-40ea-905a-38eef9495d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fff192c68985443992b32bbd5ba940bb)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:57.736306 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41814c8-e40d-40ea-905a-38eef9495d05 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:57.742870 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:57.847121 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f41814c8-e40d-40ea-905a-38eef9495d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fff192c68985443992b32bbd5ba940bb', 'request_id': 'req-f41814c8-e40d-40ea-905a-38eef9495d05'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:57.854975 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f41814c8-e40d-40ea-905a-38eef9495d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fff192c68985443992b32bbd5ba940bb', 'request_id': 'req-f41814c8-e40d-40ea-905a-38eef9495d05'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:57.937094 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f41814c8-e40d-40ea-905a-38eef9495d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fff192c68985443992b32bbd5ba940bb', 'request_id': 'req-f41814c8-e40d-40ea-905a-38eef9495d05'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:57.949478 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f41814c8-e40d-40ea-905a-38eef9495d05 admin admin] The token cache is being invalidate because project fff192c68985443992b32bbd5ba940bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:49:57.949768 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f41814c8-e40d-40ea-905a-38eef9495d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:57.950407 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f41814c8-e40d-40ea-905a-38eef9495d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:49:57.951893 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1450/2905] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:49:57 2022] DELETE /identity/v3/projects/fff192c68985443992b32bbd5ba940bb => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:49:57.956940 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e63f17-4ea6-4d23-9eb9-b0d1614ba8c0 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:57.957433 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e63f17-4ea6-4d23-9eb9-b0d1614ba8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:57.957544 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e63f17-4ea6-4d23-9eb9-b0d1614ba8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:57.977743 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-e4e63f17-4ea6-4d23-9eb9-b0d1614ba8c0 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:49:57.978942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e4e63f17-4ea6-4d23-9eb9-b0d1614ba8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:58.039938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1456/2906] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:49:58.047713 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd39a9-25ea-43fe-8d59-078884102deb None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:58.064279 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd39a9-25ea-43fe-8d59-078884102deb None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:58.064279 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd39a9-25ea-43fe-8d59-078884102deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:58.068316 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-12cd39a9-25ea-43fe-8d59-078884102deb None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:49:58.069620 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-12cd39a9-25ea-43fe-8d59-078884102deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:58.078789 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1451/2907] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:49:58.083131 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e63f17-4ea6-4d23-9eb9-b0d1614ba8c0 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:58.093612 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e63f17-4ea6-4d23-9eb9-b0d1614ba8c0 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:58.098245 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae604bf-32db-48a2-85c7-349e2b8c74f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:58.098832 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae604bf-32db-48a2-85c7-349e2b8c74f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:58.099110 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae604bf-32db-48a2-85c7-349e2b8c74f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:58.099381 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae604bf-32db-48a2-85c7-349e2b8c74f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:58.100031 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae604bf-32db-48a2-85c7-349e2b8c74f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:49:58.100336 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae604bf-32db-48a2-85c7-349e2b8c74f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:58.102175 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae604bf-32db-48a2-85c7-349e2b8c74f1 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:58.113682 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1457/2908] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 14:49:58.117990 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd39a9-25ea-43fe-8d59-078884102deb None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:58.127272 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd39a9-25ea-43fe-8d59-078884102deb None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:58.132062 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5189eef-e4e4-48db-9532-e80dd6f45a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:58.136669 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5189eef-e4e4-48db-9532-e80dd6f45a88 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:58.136669 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5189eef-e4e4-48db-9532-e80dd6f45a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:58.136669 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5189eef-e4e4-48db-9532-e80dd6f45a88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:58.136669 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5189eef-e4e4-48db-9532-e80dd6f45a88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:58.136669 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5189eef-e4e4-48db-9532-e80dd6f45a88 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:58.238262 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1452/2909] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:49:58 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:49:58.244433 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae604bf-32db-48a2-85c7-349e2b8c74f1 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:58.253427 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae604bf-32db-48a2-85c7-349e2b8c74f1 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:58.314072 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a1f2f-87f8-49a8-907a-b5481c9b1024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:58.314709 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a1f2f-87f8-49a8-907a-b5481c9b1024 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:58.314990 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a1f2f-87f8-49a8-907a-b5481c9b1024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:58.315261 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a1f2f-87f8-49a8-907a-b5481c9b1024 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:58.315915 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a1f2f-87f8-49a8-907a-b5481c9b1024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:58.317932 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a1f2f-87f8-49a8-907a-b5481c9b1024 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:58.397150 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1458/2910] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:49:58 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:49:58.403216 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5189eef-e4e4-48db-9532-e80dd6f45a88 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:58.416356 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5189eef-e4e4-48db-9532-e80dd6f45a88 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:58.421038 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5973c-e879-472d-b45f-d58c46d30d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:58.421663 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5973c-e879-472d-b45f-d58c46d30d50 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:58.421944 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5973c-e879-472d-b45f-d58c46d30d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:58.422220 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5973c-e879-472d-b45f-d58c46d30d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:58.422858 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5973c-e879-472d-b45f-d58c46d30d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:58.424454 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5973c-e879-472d-b45f-d58c46d30d50 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:58.436245 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1453/2911] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:49:58.441116 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a1f2f-87f8-49a8-907a-b5481c9b1024 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:58.452274 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a1f2f-87f8-49a8-907a-b5481c9b1024 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:58.457264 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b0d84-fb43-40ee-b3dd-d65eb81be760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:58.457849 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b0d84-fb43-40ee-b3dd-d65eb81be760 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:58.458128 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b0d84-fb43-40ee-b3dd-d65eb81be760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:58.458402 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b0d84-fb43-40ee-b3dd-d65eb81be760 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:58.459031 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b0d84-fb43-40ee-b3dd-d65eb81be760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:58.460627 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b0d84-fb43-40ee-b3dd-d65eb81be760 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:58.472186 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1459/2912] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:49:58.476208 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5973c-e879-472d-b45f-d58c46d30d50 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:58.486283 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5973c-e879-472d-b45f-d58c46d30d50 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:58.490969 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41652b7a-2a1c-479e-993b-eaefb0fc49fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:58.491610 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41652b7a-2a1c-479e-993b-eaefb0fc49fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:58.491893 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41652b7a-2a1c-479e-993b-eaefb0fc49fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:58.492717 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41652b7a-2a1c-479e-993b-eaefb0fc49fd admin admin] PATH_INFO: `/v3/projects/636a0d32f13743adb5a54384dd769cdb/users/6d5484bd754a4e2c936d9226f79533c7/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:58.507352 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41652b7a-2a1c-479e-993b-eaefb0fc49fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=636a0d32f13743adb5a54384dd769cdb, user_id=6d5484bd754a4e2c936d9226f79533c7, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:58.510906 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41652b7a-2a1c-479e-993b-eaefb0fc49fd admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:58.612478 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1454/2913] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:49:58 2022] PUT /identity/v3/projects/636a0d32f13743adb5a54384dd769cdb/users/6d5484bd754a4e2c936d9226f79533c7/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:49:58.623301 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9526d-cfe3-44f3-9a52-6a734bd8619a None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:58.623589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9526d-cfe3-44f3-9a52-6a734bd8619a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:58.623867 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9526d-cfe3-44f3-9a52-6a734bd8619a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:58.638804 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:58.657385 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c0f9526d-cfe3-44f3-9a52-6a734bd8619a None None] MFA Rules not processed for user `6d5484bd754a4e2c936d9226f79533c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:49:58.658672 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c0f9526d-cfe3-44f3-9a52-6a734bd8619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:58.731565 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1460/2914] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:49:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:49:58.742745 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41652b7a-2a1c-479e-993b-eaefb0fc49fd admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:49:58.744719 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-41652b7a-2a1c-479e-993b-eaefb0fc49fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:49:58.803061 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41652b7a-2a1c-479e-993b-eaefb0fc49fd admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:49:58.817781 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9267c-100c-46cd-9eeb-0ba69da296e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:49:58.820918 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9267c-100c-46cd-9eeb-0ba69da296e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:49:58.822437 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9267c-100c-46cd-9eeb-0ba69da296e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:49:58.823807 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9267c-100c-46cd-9eeb-0ba69da296e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:49:58.841323 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9267c-100c-46cd-9eeb-0ba69da296e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:49:58.845469 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9267c-100c-46cd-9eeb-0ba69da296e0 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:49:58.851374 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1455/2915] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:49:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:50:05.879584 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9526d-cfe3-44f3-9a52-6a734bd8619a None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:05.942471 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9526d-cfe3-44f3-9a52-6a734bd8619a None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:05.947687 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6cc27-375a-4634-aa61-253489fda6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:05.948367 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6cc27-375a-4634-aa61-253489fda6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:05.948602 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6cc27-375a-4634-aa61-253489fda6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:05.949723 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6cc27-375a-4634-aa61-253489fda6df admin admin] PATH_INFO: `/v3/users/6d5484bd754a4e2c936d9226f79533c7` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:05.950834 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6cc27-375a-4634-aa61-253489fda6df admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d5484bd754a4e2c936d9226f79533c7)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:05.952742 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6cc27-375a-4634-aa61-253489fda6df admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:06.162498 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4cc6cc27-375a-4634-aa61-253489fda6df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d5484bd754a4e2c936d9226f79533c7'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:06.253408 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4cc6cc27-375a-4634-aa61-253489fda6df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d5484bd754a4e2c936d9226f79533c7'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:06.266413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4cc6cc27-375a-4634-aa61-253489fda6df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d5484bd754a4e2c936d9226f79533c7'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:06.267143 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4cc6cc27-375a-4634-aa61-253489fda6df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d5484bd754a4e2c936d9226f79533c7'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:06.274562 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4cc6cc27-375a-4634-aa61-253489fda6df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d5484bd754a4e2c936d9226f79533c7'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:06.285239 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1461/2916] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:50:05 2022] DELETE /identity/v3/users/6d5484bd754a4e2c936d9226f79533c7 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:50:06.291872 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b930a7d-6d86-4a25-8897-8f19bd0556eb None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:06.294647 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b930a7d-6d86-4a25-8897-8f19bd0556eb None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:06.294647 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b930a7d-6d86-4a25-8897-8f19bd0556eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:06.312791 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2b930a7d-6d86-4a25-8897-8f19bd0556eb None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:50:06.314044 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2b930a7d-6d86-4a25-8897-8f19bd0556eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:50:06.345557 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:50:06.376199 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1456/2917] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:50:06.386657 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6cc27-375a-4634-aa61-253489fda6df admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:06.388088 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4cc6cc27-375a-4634-aa61-253489fda6df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:50:06.407028 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:50:06.446948 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6cc27-375a-4634-aa61-253489fda6df admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:06.449939 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b44e6-d83f-4fe9-95c3-7c2bb7f21091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:06.450542 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b44e6-d83f-4fe9-95c3-7c2bb7f21091 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:06.450819 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b44e6-d83f-4fe9-95c3-7c2bb7f21091 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:06.451093 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b44e6-d83f-4fe9-95c3-7c2bb7f21091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:06.460338 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b44e6-d83f-4fe9-95c3-7c2bb7f21091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:06.462032 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b44e6-d83f-4fe9-95c3-7c2bb7f21091 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:06.471665 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1462/2918] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:50:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:50:06.969770 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b930a7d-6d86-4a25-8897-8f19bd0556eb None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:06.971288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2b930a7d-6d86-4a25-8897-8f19bd0556eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:50:06.990891 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b930a7d-6d86-4a25-8897-8f19bd0556eb None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:06.992417 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352afde-3710-4599-a88d-aa78c68c3687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:06.993706 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352afde-3710-4599-a88d-aa78c68c3687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:06.994043 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352afde-3710-4599-a88d-aa78c68c3687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:06.994239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352afde-3710-4599-a88d-aa78c68c3687 admin admin] PATH_INFO: `/v3/projects/636a0d32f13743adb5a54384dd769cdb` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:06.995379 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352afde-3710-4599-a88d-aa78c68c3687 admin admin] RBAC: Authorizing `identity:delete_project(project_id=636a0d32f13743adb5a54384dd769cdb)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:06.997297 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352afde-3710-4599-a88d-aa78c68c3687 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:07.128799 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5352afde-3710-4599-a88d-aa78c68c3687 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '636a0d32f13743adb5a54384dd769cdb', 'request_id': 'req-5352afde-3710-4599-a88d-aa78c68c3687'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:07.135529 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5352afde-3710-4599-a88d-aa78c68c3687 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '636a0d32f13743adb5a54384dd769cdb', 'request_id': 'req-5352afde-3710-4599-a88d-aa78c68c3687'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:07.213467 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5352afde-3710-4599-a88d-aa78c68c3687 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '636a0d32f13743adb5a54384dd769cdb', 'request_id': 'req-5352afde-3710-4599-a88d-aa78c68c3687'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:07.225191 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5352afde-3710-4599-a88d-aa78c68c3687 admin admin] The token cache is being invalidate because project 636a0d32f13743adb5a54384dd769cdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:50:07.231190 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5352afde-3710-4599-a88d-aa78c68c3687 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:07.231190 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5352afde-3710-4599-a88d-aa78c68c3687 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:07.231190 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1457/2919] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:50:06 2022] DELETE /identity/v3/projects/636a0d32f13743adb5a54384dd769cdb => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:50:07.234111 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114527a6-316d-4567-98fb-757706b45bc4 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:07.234609 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114527a6-316d-4567-98fb-757706b45bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:07.235249 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114527a6-316d-4567-98fb-757706b45bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:07.254642 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-114527a6-316d-4567-98fb-757706b45bc4 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:50:07.255841 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-114527a6-316d-4567-98fb-757706b45bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:50:07.315747 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1463/2920] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:50:07.325451 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46f001-cdce-4b4d-a0c4-89b218a3d0c8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:07.325959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46f001-cdce-4b4d-a0c4-89b218a3d0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:07.326069 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46f001-cdce-4b4d-a0c4-89b218a3d0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:07.346083 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5e46f001-cdce-4b4d-a0c4-89b218a3d0c8 None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:50:07.347288 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5e46f001-cdce-4b4d-a0c4-89b218a3d0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:50:07.355228 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1458/2921] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 14:50:07.359529 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114527a6-316d-4567-98fb-757706b45bc4 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:07.370438 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114527a6-316d-4567-98fb-757706b45bc4 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:07.376358 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d03e1-2149-481e-a82b-4aff9961511c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:07.376955 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d03e1-2149-481e-a82b-4aff9961511c admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:07.377261 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d03e1-2149-481e-a82b-4aff9961511c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:07.377532 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d03e1-2149-481e-a82b-4aff9961511c admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:07.378179 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d03e1-2149-481e-a82b-4aff9961511c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 14:50:07.378484 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d03e1-2149-481e-a82b-4aff9961511c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:07.380088 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d03e1-2149-481e-a82b-4aff9961511c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:07.393043 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1464/2922] 10.222.0.23 () {58 vars in 1153 bytes} [Mon Sep 5 14:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 14:50:07.397387 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46f001-cdce-4b4d-a0c4-89b218a3d0c8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:07.406916 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46f001-cdce-4b4d-a0c4-89b218a3d0c8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:07.411598 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba1599-2613-4e5a-9e0d-bf42a9df7077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:07.412188 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba1599-2613-4e5a-9e0d-bf42a9df7077 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:07.412464 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba1599-2613-4e5a-9e0d-bf42a9df7077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:07.412733 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba1599-2613-4e5a-9e0d-bf42a9df7077 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:07.413411 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba1599-2613-4e5a-9e0d-bf42a9df7077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:07.415335 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba1599-2613-4e5a-9e0d-bf42a9df7077 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:07.504195 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1459/2923] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:50:07 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:50:07.506373 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d03e1-2149-481e-a82b-4aff9961511c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:07.517594 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d03e1-2149-481e-a82b-4aff9961511c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:07.575497 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799305c2-72db-4d70-89e1-729be9ddb690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:07.576134 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799305c2-72db-4d70-89e1-729be9ddb690 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:07.576410 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799305c2-72db-4d70-89e1-729be9ddb690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:07.576679 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799305c2-72db-4d70-89e1-729be9ddb690 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:07.577349 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799305c2-72db-4d70-89e1-729be9ddb690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:07.579749 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799305c2-72db-4d70-89e1-729be9ddb690 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:07.674938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1465/2924] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:50:07 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:50:07.679100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba1599-2613-4e5a-9e0d-bf42a9df7077 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:07.690299 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba1599-2613-4e5a-9e0d-bf42a9df7077 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:07.695007 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61656b4a-1fd6-4b93-8776-728497365ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:07.695604 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61656b4a-1fd6-4b93-8776-728497365ede admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:07.695884 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61656b4a-1fd6-4b93-8776-728497365ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:07.696162 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61656b4a-1fd6-4b93-8776-728497365ede admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:07.697181 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61656b4a-1fd6-4b93-8776-728497365ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:07.698654 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61656b4a-1fd6-4b93-8776-728497365ede admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:07.709215 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1460/2925] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:50:07.713305 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799305c2-72db-4d70-89e1-729be9ddb690 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:07.723634 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799305c2-72db-4d70-89e1-729be9ddb690 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:07.728796 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a421ff6-3779-4ef0-a852-1d973ed593f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:07.729492 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a421ff6-3779-4ef0-a852-1d973ed593f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:07.729773 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a421ff6-3779-4ef0-a852-1d973ed593f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:07.730058 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a421ff6-3779-4ef0-a852-1d973ed593f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:07.730685 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a421ff6-3779-4ef0-a852-1d973ed593f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:07.732275 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a421ff6-3779-4ef0-a852-1d973ed593f1 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:07.742872 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1466/2926] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:50:07.747952 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61656b4a-1fd6-4b93-8776-728497365ede admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:07.758374 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61656b4a-1fd6-4b93-8776-728497365ede admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:07.763301 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2070b5-992d-4be6-bf59-79490351cfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:07.765726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2070b5-992d-4be6-bf59-79490351cfa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:07.765726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2070b5-992d-4be6-bf59-79490351cfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:07.765726 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2070b5-992d-4be6-bf59-79490351cfa6 admin admin] PATH_INFO: `/v3/projects/a95949b0c09b439fb190944d834fbbfa/users/89b397ed6aa04248aa8dba29d6f74bbf/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:07.781525 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2070b5-992d-4be6-bf59-79490351cfa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a95949b0c09b439fb190944d834fbbfa, user_id=89b397ed6aa04248aa8dba29d6f74bbf, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:07.784211 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2070b5-992d-4be6-bf59-79490351cfa6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:07.871770 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1461/2927] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:50:07 2022] PUT /identity/v3/projects/a95949b0c09b439fb190944d834fbbfa/users/89b397ed6aa04248aa8dba29d6f74bbf/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:50:07.882057 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102bcad-d4c9-42ca-a127-6588d9b29f55 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:07.882346 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102bcad-d4c9-42ca-a127-6588d9b29f55 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:07.882623 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102bcad-d4c9-42ca-a127-6588d9b29f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:07.911979 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d102bcad-d4c9-42ca-a127-6588d9b29f55 None None] MFA Rules not processed for user `89b397ed6aa04248aa8dba29d6f74bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:50:07.913278 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d102bcad-d4c9-42ca-a127-6588d9b29f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:50:07.926055 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:50:07.980470 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1467/2928] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:50:07.984904 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2070b5-992d-4be6-bf59-79490351cfa6 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:08.037372 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:50:08.048143 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2070b5-992d-4be6-bf59-79490351cfa6 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:08.052893 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c304cd7-20c1-46aa-959c-6167a5fd95ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:08.053532 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c304cd7-20c1-46aa-959c-6167a5fd95ae admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:08.053815 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c304cd7-20c1-46aa-959c-6167a5fd95ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:08.054091 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c304cd7-20c1-46aa-959c-6167a5fd95ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:08.054724 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c304cd7-20c1-46aa-959c-6167a5fd95ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:08.056664 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c304cd7-20c1-46aa-959c-6167a5fd95ae admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:08.141096 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1462/2929] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:50:07 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:50:08.145765 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102bcad-d4c9-42ca-a127-6588d9b29f55 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:08.158633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102bcad-d4c9-42ca-a127-6588d9b29f55 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:08.217156 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0244a-af9d-4457-90e2-a0b6df3d927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:08.217767 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0244a-af9d-4457-90e2-a0b6df3d927c admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:08.218044 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0244a-af9d-4457-90e2-a0b6df3d927c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:08.218314 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0244a-af9d-4457-90e2-a0b6df3d927c admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:08.218938 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0244a-af9d-4457-90e2-a0b6df3d927c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:08.220855 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0244a-af9d-4457-90e2-a0b6df3d927c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:08.305624 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1468/2930] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:50:08 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:50:08.309955 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c304cd7-20c1-46aa-959c-6167a5fd95ae admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:08.320385 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c304cd7-20c1-46aa-959c-6167a5fd95ae admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:08.326128 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd658062-db47-4ba0-b4c5-f833fbe14328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:08.326898 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd658062-db47-4ba0-b4c5-f833fbe14328 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:08.327063 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd658062-db47-4ba0-b4c5-f833fbe14328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:08.327269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd658062-db47-4ba0-b4c5-f833fbe14328 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:08.328179 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd658062-db47-4ba0-b4c5-f833fbe14328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:08.329828 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd658062-db47-4ba0-b4c5-f833fbe14328 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:08.341590 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1463/2931] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:50:08.347503 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0244a-af9d-4457-90e2-a0b6df3d927c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:08.358164 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0244a-af9d-4457-90e2-a0b6df3d927c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:08.362829 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b742cf1-e610-4cb7-b62b-239bb6891c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:08.363419 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b742cf1-e610-4cb7-b62b-239bb6891c59 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:08.363699 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b742cf1-e610-4cb7-b62b-239bb6891c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:08.363974 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b742cf1-e610-4cb7-b62b-239bb6891c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:08.364645 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b742cf1-e610-4cb7-b62b-239bb6891c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:08.366308 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b742cf1-e610-4cb7-b62b-239bb6891c59 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:08.376877 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1469/2932] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:50:08.380933 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd658062-db47-4ba0-b4c5-f833fbe14328 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:08.392019 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd658062-db47-4ba0-b4c5-f833fbe14328 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:08.396669 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d4344-9299-4461-b6b0-b3f436eb806f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:08.397351 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d4344-9299-4461-b6b0-b3f436eb806f admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:08.397630 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d4344-9299-4461-b6b0-b3f436eb806f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:08.397900 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d4344-9299-4461-b6b0-b3f436eb806f admin admin] PATH_INFO: `/v3/projects/c5a7950baa484e64b67c2214ae0f24eb/users/ada414b6883d43cb822b7bd736efbacb/roles/d818d9cd93494e0b8e7b6d6539bc808d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:08.413161 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d4344-9299-4461-b6b0-b3f436eb806f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a7950baa484e64b67c2214ae0f24eb, user_id=ada414b6883d43cb822b7bd736efbacb, role_id=d818d9cd93494e0b8e7b6d6539bc808d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:08.415972 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d4344-9299-4461-b6b0-b3f436eb806f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:08.485752 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1464/2933] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:50:08 2022] PUT /identity/v3/projects/c5a7950baa484e64b67c2214ae0f24eb/users/ada414b6883d43cb822b7bd736efbacb/roles/d818d9cd93494e0b8e7b6d6539bc808d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:50:08.495939 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384a594-dcb3-4c94-b992-e14ae70a50d6 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:08.496375 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384a594-dcb3-4c94-b992-e14ae70a50d6 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:08.496637 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384a594-dcb3-4c94-b992-e14ae70a50d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:08.528155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-9384a594-dcb3-4c94-b992-e14ae70a50d6 None None] MFA Rules not processed for user `ada414b6883d43cb822b7bd736efbacb`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:50:08.529861 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9384a594-dcb3-4c94-b992-e14ae70a50d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:50:08.596537 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1470/2934] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:50:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:50:08.601700 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d4344-9299-4461-b6b0-b3f436eb806f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:08.685320 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d4344-9299-4461-b6b0-b3f436eb806f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:08.692888 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ac811-f220-437e-a64c-be2bb43227c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:08.693561 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ac811-f220-437e-a64c-be2bb43227c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:08.693832 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ac811-f220-437e-a64c-be2bb43227c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:08.694114 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ac811-f220-437e-a64c-be2bb43227c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:08.694760 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ac811-f220-437e-a64c-be2bb43227c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:08.696681 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ac811-f220-437e-a64c-be2bb43227c5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:08.819290 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1465/2935] 10.222.0.23 () {60 vars in 1153 bytes} [Mon Sep 5 14:50:08 2022] POST /identity/v3/projects => generated 385 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:50:08.824237 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384a594-dcb3-4c94-b992-e14ae70a50d6 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:08.835448 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384a594-dcb3-4c94-b992-e14ae70a50d6 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:08.855235 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:50:08.896551 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e1d99-f5e0-4dc9-ad00-5ffa46f452b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:08.897199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e1d99-f5e0-4dc9-ad00-5ffa46f452b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:08.897479 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e1d99-f5e0-4dc9-ad00-5ffa46f452b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:08.897774 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e1d99-f5e0-4dc9-ad00-5ffa46f452b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:08.898415 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e1d99-f5e0-4dc9-ad00-5ffa46f452b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:08.900369 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e1d99-f5e0-4dc9-ad00-5ffa46f452b8 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:09.023475 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1471/2936] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Sep 5 14:50:08 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 14:50:09.028239 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ac811-f220-437e-a64c-be2bb43227c5 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:09.038819 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ac811-f220-437e-a64c-be2bb43227c5 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:09.043364 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994cd1b-fbde-4fb0-ba0e-b46c445ecb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:09.043959 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994cd1b-fbde-4fb0-ba0e-b46c445ecb8c admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:09.044235 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994cd1b-fbde-4fb0-ba0e-b46c445ecb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:09.044509 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994cd1b-fbde-4fb0-ba0e-b46c445ecb8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:09.045181 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b994cd1b-fbde-4fb0-ba0e-b46c445ecb8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:09.046766 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b994cd1b-fbde-4fb0-ba0e-b46c445ecb8c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:09.057779 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1466/2937] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 14:50:09.062277 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e1d99-f5e0-4dc9-ad00-5ffa46f452b8 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:09.072915 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e1d99-f5e0-4dc9-ad00-5ffa46f452b8 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:09.078633 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39afc8-9e03-454e-a493-d0480d9aefa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:09.079361 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39afc8-9e03-454e-a493-d0480d9aefa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:09.079647 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39afc8-9e03-454e-a493-d0480d9aefa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:09.079926 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39afc8-9e03-454e-a493-d0480d9aefa7 admin admin] PATH_INFO: `/v3/projects/46aba63241614e54aa80f2dc65b9cc7b/users/1733e7542dde44088e3a5bc92878b255/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:09.096398 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39afc8-9e03-454e-a493-d0480d9aefa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46aba63241614e54aa80f2dc65b9cc7b, user_id=1733e7542dde44088e3a5bc92878b255, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:09.099138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39afc8-9e03-454e-a493-d0480d9aefa7 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:09.191986 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1472/2938] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:50:09 2022] PUT /identity/v3/projects/46aba63241614e54aa80f2dc65b9cc7b/users/1733e7542dde44088e3a5bc92878b255/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:50:09.195943 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994cd1b-fbde-4fb0-ba0e-b46c445ecb8c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:09.207298 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994cd1b-fbde-4fb0-ba0e-b46c445ecb8c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:09.266627 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce8b9b-addb-4a92-9a3d-f41f81bbab5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:09.267250 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce8b9b-addb-4a92-9a3d-f41f81bbab5b admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:09.267531 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce8b9b-addb-4a92-9a3d-f41f81bbab5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:09.267801 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce8b9b-addb-4a92-9a3d-f41f81bbab5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:09.268442 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce8b9b-addb-4a92-9a3d-f41f81bbab5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:09.270080 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce8b9b-addb-4a92-9a3d-f41f81bbab5b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:09.281715 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1467/2939] 10.222.0.23 () {58 vars in 1122 bytes} [Mon Sep 5 14:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 14:50:09.285942 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39afc8-9e03-454e-a493-d0480d9aefa7 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:09.296623 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39afc8-9e03-454e-a493-d0480d9aefa7 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:09.301400 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de92766-8202-4591-bb96-fc7128c09017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:09.302049 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de92766-8202-4591-bb96-fc7128c09017 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:09.302323 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de92766-8202-4591-bb96-fc7128c09017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:09.302591 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de92766-8202-4591-bb96-fc7128c09017 admin admin] PATH_INFO: `/v3/projects/46aba63241614e54aa80f2dc65b9cc7b/users/1733e7542dde44088e3a5bc92878b255/roles/f22e6e660eab44c5be25e3dee1e3042c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:09.304623 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de92766-8202-4591-bb96-fc7128c09017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46aba63241614e54aa80f2dc65b9cc7b, user_id=1733e7542dde44088e3a5bc92878b255, role_id=f22e6e660eab44c5be25e3dee1e3042c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:09.307389 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de92766-8202-4591-bb96-fc7128c09017 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:09.323859 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1473/2940] 10.222.0.23 () {60 vars in 1483 bytes} [Mon Sep 5 14:50:09 2022] PUT /identity/v3/projects/46aba63241614e54aa80f2dc65b9cc7b/users/1733e7542dde44088e3a5bc92878b255/roles/f22e6e660eab44c5be25e3dee1e3042c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:50:09.336164 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eba896-4645-4bb6-8e6c-ed2f126d5765 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:09.336727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eba896-4645-4bb6-8e6c-ed2f126d5765 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:09.336727 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eba896-4645-4bb6-8e6c-ed2f126d5765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:09.364097 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:50:09.367039 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-26eba896-4645-4bb6-8e6c-ed2f126d5765 None None] MFA Rules not processed for user `1733e7542dde44088e3a5bc92878b255`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:50:09.368263 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-26eba896-4645-4bb6-8e6c-ed2f126d5765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:50:09.443631 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1468/2941] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:50:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:50:09.454787 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de92766-8202-4591-bb96-fc7128c09017 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:09.456515 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4de92766-8202-4591-bb96-fc7128c09017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:50:09.517189 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de92766-8202-4591-bb96-fc7128c09017 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:09.520719 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9b4d4-a09f-4673-a52b-6bcac5412a6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:09.521368 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9b4d4-a09f-4673-a52b-6bcac5412a6a service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:09.525008 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9b4d4-a09f-4673-a52b-6bcac5412a6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:09.525008 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9b4d4-a09f-4673-a52b-6bcac5412a6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:09.580092 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9b4d4-a09f-4673-a52b-6bcac5412a6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:09.581683 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9b4d4-a09f-4673-a52b-6bcac5412a6a service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:09.590926 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1474/2942] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:50:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:50:11.539100 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eba896-4645-4bb6-8e6c-ed2f126d5765 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:11.540521 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-26eba896-4645-4bb6-8e6c-ed2f126d5765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:50:11.553526 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eba896-4645-4bb6-8e6c-ed2f126d5765 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:11.557337 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcf278-d048-4e45-8824-fd34c45fb373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:11.560215 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcf278-d048-4e45-8824-fd34c45fb373 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:11.560215 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcf278-d048-4e45-8824-fd34c45fb373 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:11.560215 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcf278-d048-4e45-8824-fd34c45fb373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:11.615773 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bcf278-d048-4e45-8824-fd34c45fb373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:11.617252 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bcf278-d048-4e45-8824-fd34c45fb373 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:11.626654 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1469/2943] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:50:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:50:13.091145 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9b4d4-a09f-4673-a52b-6bcac5412a6a service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:13.100427 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9b4d4-a09f-4673-a52b-6bcac5412a6a service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:13.104199 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e967a-18d0-46a5-beca-5572b96dc98a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7e1db2b6f70497ab535e0e9e86ec4ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:13.104836 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e967a-18d0-46a5-beca-5572b96dc98a service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:13.105138 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e967a-18d0-46a5-beca-5572b96dc98a service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:13.105413 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e967a-18d0-46a5-beca-5572b96dc98a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:13.115005 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e967a-18d0-46a5-beca-5572b96dc98a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:13.116432 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e967a-18d0-46a5-beca-5572b96dc98a service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:13.126843 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1475/2944] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:50:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:50:18.003628 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcf278-d048-4e45-8824-fd34c45fb373 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:18.066148 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcf278-d048-4e45-8824-fd34c45fb373 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:18.070584 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5c17d-1b74-4ce6-85d4-5487204258df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:18.071196 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5c17d-1b74-4ce6-85d4-5487204258df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:18.071472 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5c17d-1b74-4ce6-85d4-5487204258df admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:18.071754 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5c17d-1b74-4ce6-85d4-5487204258df admin admin] PATH_INFO: `/v3/users/89b397ed6aa04248aa8dba29d6f74bbf` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:18.072873 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5c17d-1b74-4ce6-85d4-5487204258df admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b397ed6aa04248aa8dba29d6f74bbf)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:18.074807 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5c17d-1b74-4ce6-85d4-5487204258df admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:18.244558 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:50:18.252422 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-64c5c17d-1b74-4ce6-85d4-5487204258df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b397ed6aa04248aa8dba29d6f74bbf'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:18.252674 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-64c5c17d-1b74-4ce6-85d4-5487204258df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b397ed6aa04248aa8dba29d6f74bbf'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:18.327720 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-64c5c17d-1b74-4ce6-85d4-5487204258df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b397ed6aa04248aa8dba29d6f74bbf'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:18.341386 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-64c5c17d-1b74-4ce6-85d4-5487204258df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b397ed6aa04248aa8dba29d6f74bbf'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:18.342031 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-64c5c17d-1b74-4ce6-85d4-5487204258df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b397ed6aa04248aa8dba29d6f74bbf'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:18.354554 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1470/2945] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:50:18 2022] DELETE /identity/v3/users/89b397ed6aa04248aa8dba29d6f74bbf => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:50:18.359691 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df43ffa-78d6-46bc-973a-c4683e536c5b None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:18.360183 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df43ffa-78d6-46bc-973a-c4683e536c5b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:18.360293 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df43ffa-78d6-46bc-973a-c4683e536c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:18.380820 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-6df43ffa-78d6-46bc-973a-c4683e536c5b None None] MFA Rules not processed for user `7609e1a1df8f4af7ad4a5bc5e3426829`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 14:50:18.382090 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6df43ffa-78d6-46bc-973a-c4683e536c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:50:18.391546 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:50:18.441811 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1476/2946] 10.222.0.23 () {58 vars in 958 bytes} [Mon Sep 5 14:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 14:50:18.451852 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5c17d-1b74-4ce6-85d4-5487204258df admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:18.453560 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-64c5c17d-1b74-4ce6-85d4-5487204258df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:50:18.512702 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5c17d-1b74-4ce6-85d4-5487204258df admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:18.516695 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58baddd-7ad9-4ad1-8ccc-c726ffee0ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0ec118e5a114429b3e1c91041f7caf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:18.522222 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58baddd-7ad9-4ad1-8ccc-c726ffee0ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:18.522222 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58baddd-7ad9-4ad1-8ccc-c726ffee0ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:18.522222 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58baddd-7ad9-4ad1-8ccc-c726ffee0ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:18.526906 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58baddd-7ad9-4ad1-8ccc-c726ffee0ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:18.528818 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58baddd-7ad9-4ad1-8ccc-c726ffee0ce0 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:18.539539 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1471/2947] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:50:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:50:18.934857 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df43ffa-78d6-46bc-973a-c4683e536c5b None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:18.936408 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6df43ffa-78d6-46bc-973a-c4683e536c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:50:18.949892 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df43ffa-78d6-46bc-973a-c4683e536c5b None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:18.955598 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783378e9-f83c-4b38-aff7-f9148cfd0c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:18.956789 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783378e9-f83c-4b38-aff7-f9148cfd0c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:18.956789 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783378e9-f83c-4b38-aff7-f9148cfd0c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:18.956980 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783378e9-f83c-4b38-aff7-f9148cfd0c9b admin admin] PATH_INFO: `/v3/projects/a95949b0c09b439fb190944d834fbbfa` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:18.958045 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783378e9-f83c-4b38-aff7-f9148cfd0c9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a95949b0c09b439fb190944d834fbbfa)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:18.960853 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783378e9-f83c-4b38-aff7-f9148cfd0c9b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:19.063013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-783378e9-f83c-4b38-aff7-f9148cfd0c9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a95949b0c09b439fb190944d834fbbfa', 'request_id': 'req-783378e9-f83c-4b38-aff7-f9148cfd0c9b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:19.070939 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-783378e9-f83c-4b38-aff7-f9148cfd0c9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a95949b0c09b439fb190944d834fbbfa', 'request_id': 'req-783378e9-f83c-4b38-aff7-f9148cfd0c9b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:19.128101 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-783378e9-f83c-4b38-aff7-f9148cfd0c9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a95949b0c09b439fb190944d834fbbfa', 'request_id': 'req-783378e9-f83c-4b38-aff7-f9148cfd0c9b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:19.141013 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-783378e9-f83c-4b38-aff7-f9148cfd0c9b admin admin] The token cache is being invalidate because project a95949b0c09b439fb190944d834fbbfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:50:19.141341 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-783378e9-f83c-4b38-aff7-f9148cfd0c9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:19.141995 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-783378e9-f83c-4b38-aff7-f9148cfd0c9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:19.143525 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1477/2948] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:50:18 2022] DELETE /identity/v3/projects/a95949b0c09b439fb190944d834fbbfa => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:50:19.147493 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58baddd-7ad9-4ad1-8ccc-c726ffee0ce0 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:19.157545 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58baddd-7ad9-4ad1-8ccc-c726ffee0ce0 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:19.218117 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b204ffd-337a-4061-a9ba-d8b93b2fe9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:19.218869 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b204ffd-337a-4061-a9ba-d8b93b2fe9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:19.219269 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b204ffd-337a-4061-a9ba-d8b93b2fe9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:19.219642 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b204ffd-337a-4061-a9ba-d8b93b2fe9eb admin admin] PATH_INFO: `/v3/users/ada414b6883d43cb822b7bd736efbacb` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:19.221140 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b204ffd-337a-4061-a9ba-d8b93b2fe9eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada414b6883d43cb822b7bd736efbacb)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:19.223094 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b204ffd-337a-4061-a9ba-d8b93b2fe9eb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:19.397253 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1b204ffd-337a-4061-a9ba-d8b93b2fe9eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada414b6883d43cb822b7bd736efbacb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:19.397881 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1b204ffd-337a-4061-a9ba-d8b93b2fe9eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada414b6883d43cb822b7bd736efbacb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:19.476283 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1b204ffd-337a-4061-a9ba-d8b93b2fe9eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada414b6883d43cb822b7bd736efbacb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:19.483047 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:50:19.490289 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1b204ffd-337a-4061-a9ba-d8b93b2fe9eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada414b6883d43cb822b7bd736efbacb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:19.491447 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-1b204ffd-337a-4061-a9ba-d8b93b2fe9eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada414b6883d43cb822b7bd736efbacb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:19.505323 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1472/2949] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:50:19 2022] DELETE /identity/v3/users/ada414b6883d43cb822b7bd736efbacb => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:50:20.187298 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783378e9-f83c-4b38-aff7-f9148cfd0c9b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:20.188774 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-783378e9-f83c-4b38-aff7-f9148cfd0c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:50:20.205951 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783378e9-f83c-4b38-aff7-f9148cfd0c9b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:20.266277 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39cae2-26ba-40d2-8e8c-a581fe5b1832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:20.266937 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39cae2-26ba-40d2-8e8c-a581fe5b1832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:20.267193 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39cae2-26ba-40d2-8e8c-a581fe5b1832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:20.267477 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39cae2-26ba-40d2-8e8c-a581fe5b1832 admin admin] PATH_INFO: `/v3/projects/c5a7950baa484e64b67c2214ae0f24eb` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:20.271643 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39cae2-26ba-40d2-8e8c-a581fe5b1832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5a7950baa484e64b67c2214ae0f24eb)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:20.271643 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39cae2-26ba-40d2-8e8c-a581fe5b1832 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:20.387589 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:50:20.394197 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fb39cae2-26ba-40d2-8e8c-a581fe5b1832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a7950baa484e64b67c2214ae0f24eb', 'request_id': 'req-fb39cae2-26ba-40d2-8e8c-a581fe5b1832'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:20.399714 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fb39cae2-26ba-40d2-8e8c-a581fe5b1832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a7950baa484e64b67c2214ae0f24eb', 'request_id': 'req-fb39cae2-26ba-40d2-8e8c-a581fe5b1832'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:20.474007 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fb39cae2-26ba-40d2-8e8c-a581fe5b1832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a7950baa484e64b67c2214ae0f24eb', 'request_id': 'req-fb39cae2-26ba-40d2-8e8c-a581fe5b1832'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:20.486654 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fb39cae2-26ba-40d2-8e8c-a581fe5b1832 admin admin] The token cache is being invalidate because project c5a7950baa484e64b67c2214ae0f24eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:50:20.486944 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fb39cae2-26ba-40d2-8e8c-a581fe5b1832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:20.487572 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-fb39cae2-26ba-40d2-8e8c-a581fe5b1832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:20.489050 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1478/2950] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:50:20 2022] DELETE /identity/v3/projects/c5a7950baa484e64b67c2214ae0f24eb => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 14:50:20.493035 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b204ffd-337a-4061-a9ba-d8b93b2fe9eb admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:20.494427 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1b204ffd-337a-4061-a9ba-d8b93b2fe9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:50:20.508180 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b204ffd-337a-4061-a9ba-d8b93b2fe9eb admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:20.567611 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66622c74-4489-4200-837f-ce8edaf85e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:20.568258 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66622c74-4489-4200-837f-ce8edaf85e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:20.568540 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66622c74-4489-4200-837f-ce8edaf85e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:20.568812 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66622c74-4489-4200-837f-ce8edaf85e06 admin admin] PATH_INFO: `/v3/users/1733e7542dde44088e3a5bc92878b255` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:20.569979 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66622c74-4489-4200-837f-ce8edaf85e06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1733e7542dde44088e3a5bc92878b255)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:20.572025 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66622c74-4489-4200-837f-ce8edaf85e06 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:20.818197 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-66622c74-4489-4200-837f-ce8edaf85e06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1733e7542dde44088e3a5bc92878b255'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:20.818969 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-66622c74-4489-4200-837f-ce8edaf85e06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1733e7542dde44088e3a5bc92878b255'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:20.899638 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-66622c74-4489-4200-837f-ce8edaf85e06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1733e7542dde44088e3a5bc92878b255'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:20.912284 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-66622c74-4489-4200-837f-ce8edaf85e06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1733e7542dde44088e3a5bc92878b255'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:20.913617 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-66622c74-4489-4200-837f-ce8edaf85e06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1733e7542dde44088e3a5bc92878b255'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:20.926664 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1473/2951] 10.222.0.23 () {58 vars in 1224 bytes} [Mon Sep 5 14:50:20 2022] DELETE /identity/v3/users/1733e7542dde44088e3a5bc92878b255 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:50:21.458060 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39cae2-26ba-40d2-8e8c-a581fe5b1832 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:50:21.459775 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fb39cae2-26ba-40d2-8e8c-a581fe5b1832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:50:21.477763 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39cae2-26ba-40d2-8e8c-a581fe5b1832 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:50:21.547910 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f46ba-42f4-416c-89f2-48c1e0dca165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7609e1a1df8f4af7ad4a5bc5e3426829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c738420b616e421c9aa849509b94fc5a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:50:21.548550 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f46ba-42f4-416c-89f2-48c1e0dca165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:50:21.548826 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f46ba-42f4-416c-89f2-48c1e0dca165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:50:21.549155 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f46ba-42f4-416c-89f2-48c1e0dca165 admin admin] PATH_INFO: `/v3/projects/46aba63241614e54aa80f2dc65b9cc7b` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:50:21.550268 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f46ba-42f4-416c-89f2-48c1e0dca165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46aba63241614e54aa80f2dc65b9cc7b)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:50:21.552195 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f46ba-42f4-416c-89f2-48c1e0dca165 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:50:21.864513 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-677f46ba-42f4-416c-89f2-48c1e0dca165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46aba63241614e54aa80f2dc65b9cc7b', 'request_id': 'req-677f46ba-42f4-416c-89f2-48c1e0dca165'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:21.873676 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-677f46ba-42f4-416c-89f2-48c1e0dca165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46aba63241614e54aa80f2dc65b9cc7b', 'request_id': 'req-677f46ba-42f4-416c-89f2-48c1e0dca165'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:22.105124 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-677f46ba-42f4-416c-89f2-48c1e0dca165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46aba63241614e54aa80f2dc65b9cc7b', 'request_id': 'req-677f46ba-42f4-416c-89f2-48c1e0dca165'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:22.119045 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-677f46ba-42f4-416c-89f2-48c1e0dca165 admin admin] The token cache is being invalidate because project 46aba63241614e54aa80f2dc65b9cc7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 14:50:22.119312 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-677f46ba-42f4-416c-89f2-48c1e0dca165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:22.120071 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-677f46ba-42f4-416c-89f2-48c1e0dca165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 14:50:22.121755 dv-cinder-842905-3-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1479/2952] 10.222.0.23 () {58 vars in 1233 bytes} [Mon Sep 5 14:50:21 2022] DELETE /identity/v3/projects/46aba63241614e54aa80f2dc65b9cc7b => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 14:50:30.922355 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:50:32.115522 dv-cinder-842905-3-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=60,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:54:03.199127 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66622c74-4489-4200-837f-ce8edaf85e06 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 14:54:03.200568 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-66622c74-4489-4200-837f-ce8edaf85e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:54:03.342824 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66622c74-4489-4200-837f-ce8edaf85e06 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 14:54:03.401796 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982b3ae-8b56-4d38-bbef-063a0b6f325d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1880dab32fa424a9356b3fe940d4856', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '975f49bcc95643fe876cc03d0d731423', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 14:54:03.402400 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982b3ae-8b56-4d38-bbef-063a0b6f325d service placement] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 14:54:03.402677 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982b3ae-8b56-4d38-bbef-063a0b6f325d service placement] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 14:54:03.402945 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982b3ae-8b56-4d38-bbef-063a0b6f325d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 14:54:03.404646 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8982b3ae-8b56-4d38-bbef-063a0b6f325d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 14:54:03.415535 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982b3ae-8b56-4d38-bbef-063a0b6f325d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 14:54:03.417272 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982b3ae-8b56-4d38-bbef-063a0b6f325d service placement] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 14:54:03.427080 dv-cinder-842905-3-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1474/2953] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Sep 5 14:54:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 14:54:13.422881 dv-cinder-842905-3-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}